Projects completed in the Udacity Data Streaming Nanodegree program. Tech used: Apache Kafka, Kafka Connect, KSQL, Faust Stream Processing, Spark Structured Streaming

The goal of this project is aimed at optimizing Bank Marketing Model through building an event streaming pipeline around Apache Kafka and its ecosystem that communicates with a Machine learning model microservice. Utilizing this to display the likelihood and status of Bank Customers in real time.

Python bindings for RocksDB used by faust-streaming

This project cover latest skills to process data in real-time by building fluency in modern data engineering tools, such as Apache Spark, Kafka, Spark Streaming, and Kafka Streaming.

Django with Kafka, Debezium, and Faust for Email Sending using Change Data Capture

An end-to-end, web event stream processing pipeline

A simple Python-based distributed workflow engine

A highly-configurable, real-time data quality monitoring tool designed for streaming data

Graph streaming framework

Simple integration of FastAPI with Faust Python Stream Processing Fork

Generate avro schemas from python dataclasses, Pydantic models and Faust Records. Code generation from avro schemas. Serialize/Deserialize python instances with avro schemas.