GitHub - spark0698/seattle-fire-and-crime: This project implements an ETL (Extract - Transform - Load) data pipeline with the Seattle public datasets on Fire 911 calls and Crime, using Apache Airflow (orchestration), PySpark/GCP Dataproc Serverless (transformation) and GCP Cloud Storage/BIgQuery (storage)

spark0698 / seattle-fire-and-crime Public

Notifications You must be signed in to change notification settings
Fork 0
Star 0

This project implements an ETL (Extract - Transform - Load) data pipeline with the Seattle public datasets on Fire 911 calls and Crime, using Apache Airflow (orchestration), PySpark/GCP Dataproc Serverless (transformation) and GCP Cloud Storage/BIgQuery (storage)

lookerstudio.google.com/s/kZ5oaNUJSgM

0 stars 0 forks Branches Tags Activity

Star

Notifications

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 108 Commits
.github/workflows		.github/workflows
dags		dags
dataproc-dockerfile		dataproc-dockerfile
functions		functions
transformations		transformations
.gitignore		.gitignore
docker-compose.yaml		docker-compose.yaml