Skip to content

Commit

Permalink
sss
Browse files Browse the repository at this point in the history
  • Loading branch information
allamiro committed Dec 20, 2024

Verified

This commit was created on GitHub.com and signed with GitHub’s verified signature.
1 parent 5882e84 commit 282df94
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -13,7 +13,7 @@ Data pipeline architecture best practices refer to the recommended principles an
* Document and test: Document the pipeline architecture, code, and dependencies, and ensure that the pipeline is thoroughly tested and validated before it is put into production.

## Diagram

```
+--------------+ +-------------------+ +------------------+ +-----------------+ +--------------------+ +----------------+ +--------------------+
| Data Sources | ---> | Collection | ---> | Ingestion | ---> | Streaming | ---> | Processing | ---> | Storage | ---> | Visualization |
+--------------+ +-------------------+ +------------------+ +-----------------+ +--------------------+ +----------------+ +--------------------+
@@ -23,7 +23,7 @@ Data pipeline architecture best practices refer to the recommended principles an
[Files, APIs, [Elastic Agent, ArcSight, [Logstash] [Kafka, RabbitMQ, etc.] [Spark, Hadoop, etc.] [NoSQL, Elasticsearch, SQL] [PowerBI, Kibana, etc.]
Databases, Fluentd, td-agent, etc.] Machine Learning, Python]
IoT, apps, etc.]

```

### Data Pipeline Phases
- Data Sources: Files, APIs, Databases, Network Devices, IOT etc

0 comments on commit 282df94

Please sign in to comment.