Project demonstrating how to automate Prefect 2.0 deployments to AWS ECS Fargate

Code examples showing flow deployment to various types of infrastructure

Deploy a Prefect flow to serverless AWS Lambda function

Project demonstrating how to automate Prefect 2.0 deployments to AWS EKS

Get started with Prefect by scheduling your Prefect flows with GitHub Actions

Data engineering project using Azure Data Factory and Apache Airflow

This is a repo designed to show the workflow of a data contract, with pre-commit hooks and GitHub Actions on how to have the contract power a data platform

Python package that simplifies the creation of AWS infrastructure for simulating real-time data streaming and batch processing, ideal for integrating into machine learning projects.

Blog space on data engineering, machine learning, platform engineering.

This project implements a real-time event streaming pipeline for a music streaming service, inspired by Spotify Wrapped and Billboard charts. The pipeline is powered by Apache Airflow, Apache Kafka, dbt, Docker, GCP, Spark-Streaming, and Terraform.