Streaming kafka events using Spark in avro format and saving the events in parquet format
-
Updated
Apr 4, 2022 - Python
Streaming kafka events using Spark in avro format and saving the events in parquet format
Repository contains java application code to stream records to a Kinesis Stream, consume , de-duplicate and strictly order records and display records on a dashboard
An interactive AI platform with both terminal and web-based interfaces for real-time model interactions, featuring dynamic model integration and immediate feedback streaming. Developed by *The Vanguards*.
UDPStreamViewer is a Java Swing application that allows users to visualize video streams over the UDP protocol. It receives and displays real-time video
Real Time Streaming on the Arduino Car with Android App Controller
Simulates a real-time Smart City data pipeline with Kafka, Apache Spark, and S3. Streams and processes vehicle, GPS, weather, traffic, and emergency data with Dockerized components and Parquet storage for efficient, scalable data engineering
A real-time data pipeline project using Kafka, MongoDB, Elasticsearch, and PySpark. Streams raw data from Kafka, enriches it with sentiment analysis using Hugging Face models, stores results in MongoDB, and visualizes data in Elasticsearch with Kibana. Scalable solution for real-time data analytics and machine learning.
Custom protocol for Secure real-time streaming over UDP, developed for the Network and Computer Systems Security course
Add a description, image, and links to the real-time-streaming topic page so that developers can more easily learn about it.
To associate your repository with the real-time-streaming topic, visit your repo's landing page and select "manage topics."