cli_usage.md

popgetter CLI

For countries which have been ported to Dagster, the downloads can be invoked via the Dagster CLI.

Run a single job

Typically there is a single job per country. For Belgium, the job is called job_be:

DAGSTER_HOME=$PWD/persist dagster job execute -m popgetter --job job_be

Run a single asset

Within a country, there are likely to be multiple assets. To materialize a single asset (and any required dependencies). The command gets the number of cars per census sector in Belgium.

DAGSTER_HOME=$PWD/persist dagster asset materialize -m popgetter --select be/get_car_per_sector

(Typically we organise assets with the country code as a prefix, to ensure that asset names are unique).

Run everything

(The quotes around the * are required to prevent it being interpreted by the shell.)

DAGSTER_HOME=$PWD/persist dagster asset materialize -m popgetter --select "*"