From 282df94c746338fffd11ce9fa0aeb6e2f2521d68 Mon Sep 17 00:00:00 2001 From: Tamir Suliman Date: Fri, 20 Dec 2024 18:42:23 +0100 Subject: [PATCH] sss --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index 044aa05..db3e61e 100644 --- a/README.md +++ b/README.md @@ -13,7 +13,7 @@ Data pipeline architecture best practices refer to the recommended principles an * Document and test: Document the pipeline architecture, code, and dependencies, and ensure that the pipeline is thoroughly tested and validated before it is put into production. ## Diagram - +``` +--------------+ +-------------------+ +------------------+ +-----------------+ +--------------------+ +----------------+ +--------------------+ | Data Sources | ---> | Collection | ---> | Ingestion | ---> | Streaming | ---> | Processing | ---> | Storage | ---> | Visualization | +--------------+ +-------------------+ +------------------+ +-----------------+ +--------------------+ +----------------+ +--------------------+ @@ -23,7 +23,7 @@ Data pipeline architecture best practices refer to the recommended principles an [Files, APIs, [Elastic Agent, ArcSight, [Logstash] [Kafka, RabbitMQ, etc.] [Spark, Hadoop, etc.] [NoSQL, Elasticsearch, SQL] [PowerBI, Kibana, etc.] Databases, Fluentd, td-agent, etc.] Machine Learning, Python] IoT, apps, etc.] - +``` ### Data Pipeline Phases - Data Sources: Files, APIs, Databases, Network Devices, IOT etc