Real time fraud analysis using Kafka Streams

What is happening here?

• Open source Debezium Postgres CDC and RabbitMQ Source connectors to stream customer data and credit card transactions in real time into Kafka Topic
• ksqlDB to process and enrich data streams in real time. Use aggregation and windowing to create a customer list of potentially stolen credit cards
• Open source Camel sink connector to load enriched data into MongoDB for real-time fraud analysis

Setup

• Install Docker and Docker Compose
• Then run the following commands

Terminal#1

git clone https://github.com/mehdihasan/real-time-fraud-analysis.git
cd real-time-fraud-analysis
./run.sh

Terminal#2

cd real-time-fraud-analysis
./run.sh

Teardown

Terminal#3

./td.sh

References

1. Debezium connector for PostgreSQL
2. Change Data Capture (CDC) With Kafka® Connect and the Debezium PostgreSQL® Source Connector
3. Utilize Real-Time, Enriched Data in Your Cloud Database
4. Camel-Kafka-connector RabbitMQ Source