Skip to content

Commit

Permalink
Merge pull request #6 from yvonnegitau/feature/dagster
Browse files Browse the repository at this point in the history
Fixing Docuementation
  • Loading branch information
yvonnegitau authored Feb 11, 2025
2 parents f03c6b2 + f73edd5 commit 2ddd5f5
Showing 1 changed file with 3 additions and 1 deletion.
4 changes: 3 additions & 1 deletion docs/orchestration.md
Original file line number Diff line number Diff line change
@@ -1,11 +1,13 @@
# Data Orchestration
For data orchestration we will be using Dagster. We will add Dagster to our docker compose. When running Dagster, one needs the below long running containers. :
For data orchestration we will be using Dagster. We will add Dagster to our docker compose. When running Dagster, one needs the below long running containers :

* Webserver
* Daemon
* Code Location (each code has its own container)
* Metadata database

Each run will be executed on its own container. Webserver and Daemon will have the same Docker image. We will also have files below which are a requirement:

* `workspace.yaml` tells the webserver and daemon the location of the code
* `dagster.yaml` configures the dagster instance

Expand Down

0 comments on commit 2ddd5f5

Please sign in to comment.