To start working with Docker-Airflow you can run the following command:
Open your terminal then run the following commands:
git clone git@github.com:sastriodjamier/docker-airflow.git
source config.sh
This command will do the following things:
- Create
venv
directory if not exist. - Activate virtual environment.
- Update to latest pip.
- Install all pip packages defined in
requirements.txt
.
To start Docker-Airflow, you can run the following commands:
docker build -t airflow_image .
This command will do the following things:
- Build an airflow image.
- Install all pip packages defined in
requirements.txt
.
docker-compose up -d
This command will start Airflow and its dependencies in separate Docker containers, and the -d flag runs the containers in detached mode, allowing you to continue using your terminal.
Once Docker-Airflow is running, you can access the Airflow UI by navigating to http://localhost:8080 in your web browser.
From the Airflow UI, you can create and manage DAGs, which are used to define workflows in Airflow.
To stop working with Docker-Airflow , you can run the following commands:
docker-compose down
deactivate