Skip to content

Latest commit

 

History

History
23 lines (19 loc) · 794 Bytes

README.md

File metadata and controls

23 lines (19 loc) · 794 Bytes

Incremental Script

Generic ETL Utility to pull data from any data source to Snowflake or any Target Source.

docs:

https://akhilpatlolla.github.io/Generic_ETL_Utility_AWS_GLUE/

Notes

  1. You need you have all the respective JDBC connection drives in s3 and add those jar's to dependency path.
  2. Add connection and other required permission in order to access JDBC connection
  3. SSM parameter config object
    abcdefghijk = { "type":"mysql|redshift|oracle|sqlserver|postgresql",
    "user":"username",
    "multipleStatements":true,
    "password":"********",
    "port":5432|3306,
    "host":"p360-prod.mlprivate.net",
    "database":"program360" }
  4. Command like parameter for the job
    --db1 = abcdefghijk