Data Ingester

This repo currenly consists of two ways to load data into a mongo database. One is loading csvs into pandas and the other is a more general way to load a dask dataframe into a mongo database.

Create Enviroment

1. https://github.com/JonathanWoodell/Data_Ingester.git
2. python -m venv env
3. pip install -r .\requirements.txt
4. python main.py --config_file config.json