Demo event analytics platform based on Apache Kafka (Confluent).

使用AWS托管服务的最佳实践样例

Spring boot demo app. Polls an external service and produces kafka topics which are sent to a kafka cluster (AWS-MSK). This topic is later consumed from the same demo app and returned when calling the REST API endpoint.

Oracle Database Automatic Diagnostic Repository messages (alert.log & listener.log) to Apache Kafka or Amazon Kinesis transfer

Oracle audit files to Apache Kafka/Amazon MKS/Amazon Kinesis transfer

Pinterest data pipeline - designing an end-to-end pipeline utilising AWS cloud technologies and Databricks for analysing real-time and historical pinterest-emulated data.

x-msk_cluster ECS Compose-X extension package

Pinterest's experiment analytics data pipeline which runs thousands of experiments per day and crunches billions of datapoints to provide valuable insights to improve the product.

Terraform module to create kafka resource on AWS. AWS MSK (Managed Streaming for Apache Kafka) is a fully managed service that simplifies the deployment, management, and operation of Apache Kafka clusters. Apache Kafka is an open-source distributed streaming platform used for building real-time streaming data p

CloudFormation templates to create AWS IoT Rule with Amazon MSK cluster integration.

A Cloud based Reddit stock sentiment analyzer that analyzes overall sentiment from a configurable selection of stock subreddits for each stock. The architecture utilizes AWS MSK (Kafka), AWS EMR (PySpark) and AWS Lambda (Python 3) for maximum scalability and the OpenAI API for sentiment analysis through prompt engineering.

Data lake demo using change data capture (CDC) on AWS

Strimzi-related Helm charts.

The CloudFormation Resource Provider Package For Amazon MSK Connect

Use-Case: Airline on-time performance

Streaming data pipeline to continuously load data from an Amazon MSK or MSK Serverless cluster to Amazon S3 using Amazon Kinesis Data Firehose.

🌳 A sustainable Terraform Package which creates resources for Messaging Services (EventBridge, MSK, SNS, SQS) on AWS

A serverless offline plugin that enables AWS MSK events

AWS MSK Connect workshop helps first time users explore and get started to deploy fully managed Apache Kafka Connect workloads using Amazon MSK Connect.

Pinterest's experiment analytics data pipeline which runs thousands of experiments per day and crunches billions of datapoints to provide valuable insights to improve the product.