Data pipeline involving pentaho DI, airflow and kafka. Run all services together using Docker.
-
Updated
Nov 22, 2021 - Python
Data pipeline involving pentaho DI, airflow and kafka. Run all services together using Docker.
An example Airflow Pipeline with Deeplake for Machine Learning
This post is focused on how to setup Apache Airflow 2 using DockerOperator with node.js and Gitlab container registry on Ubuntu 20
Add a description, image, and links to the dockeroperator topic page so that developers can more easily learn about it.
To associate your repository with the dockeroperator topic, visit your repo's landing page and select "manage topics."