Home

Intro

This code hits several endpoints based on clients built to the API specs, grooms and deidentifies data to city spec, and uploads the groomed data into prepared Socrata endpoints.

This is the companion repo to the stat_dashboard_frontend

Issues

Please file found bugs or other issues here in the github repo, it's maintained and monitored.
Would you like to contribute a fix? Please do!

Install

git clone https://github.com/cityofsomerville/stat_dashboard_pipeline.git
cd stat_dashboard_pipeline

Development

pip install -e .

Production

pip install .

Credentials

Copy the config/sample_auth.yaml file and rename it to auth.yaml.
Put the credentials in the file within the empty quotation marks and save. Google Analytics credentials are pulled from Google Analytics via a JSON file. NOTE: To run the QScend API, you'll need to get your endpoint IP address whitelisted by QScend support.

Detailed Docs

Architecture Troubleshooting Unit Tests