ETL pipeline to extract real-time weather data from Open-Meteo API, transform it with Python & Pandas, and load it using Apache Airflow and Docker.
-
Updated
Jul 13, 2025 - Python
#
cloud-etl
Here are 3 public repositories matching this topic...
GitOps-driven Azure Data Factory pipeline that ingests multi-source data (GitHub + ADLS) into ADLS Bronze using dynamic, parameterized ETL workflows.
data-lake data-pipelines data-ingestion azure-data-factory portfolio-project gitops dynamic-pipelines adf-pipeline azure-data-engineering bronze-layer azure-project adls-gen2 cloud-etl github-ingestion source-to-bronze landing-to-bronze
-
Updated
Nov 19, 2025
This project demonstrates an end-to-end data pipeline built on cloud technologies, following the Medallion Architecture (Bronze–Silver–Gold). . Ingests raw data from cloud sources, processes via ETL/ELT in Databricks & DBT, orchestrated with Data Factory, and delivers clean, analytics-ready datasets stored in a scalable data lake.
azure-data-factory azure-databricks data-automation scalable-architecture elt-pipeline azure-data-lake-gen2 cloud-etl
-
Updated
Sep 28, 2025 - Jupyter Notebook
Improve this page
Add a description, image, and links to the cloud-etl topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the cloud-etl topic, visit your repo's landing page and select "manage topics."