From 85ae6b4f755f8a87be65a75edd47c631d2ad295f Mon Sep 17 00:00:00 2001 From: Tony Yun Date: Thu, 29 Sep 2022 11:16:44 -0400 Subject: [PATCH] add helper md --- helper.md | 16 +++++++++++++++- 1 file changed, 15 insertions(+), 1 deletion(-) diff --git a/helper.md b/helper.md index eaf3cb694..600274be8 100644 --- a/helper.md +++ b/helper.md @@ -3,9 +3,23 @@ ## Requirements - minimum 3~4GB memory setting for Docker -- local copy of `nurx-daga-dags` repo +- local copy of `nurx-data-dags` repo - local .env file in `docker` directory. (can fetch from [1password](https://my.1password.com/vaults/q53fddt66zfb7dwjqsilk2i3ee/allitems/u2yh2okx2veshij66rpo56qk5m), named `Airflow MWAA .env`) +The requirement.txt worked for me is(should be in `nurx-data-dags/requirements.txt`): (very identical to the main branch) +``` +s3fs==0.4.0 +splunk-sdk==1.6.16 +apache-airflow-backport-providers-google +shippo==2.0.2 +sqlanydb==1.0.11 +psycopg2-binary==2.9.3 +sqlalchemy-redshift==0.4.0 +SQLAlchemy +paramiko +protobuf~=3.20.0 +``` + ## To Bring Up the Env ```