Efficient storage for large comparisons

[widdowquinn]

pandas dataframes may not be efficient for storage of or operations on large comparisons that produce tables with millions of results.

We should explore the possibilities of using other representations/extensions like

• dask: https://dask.org/
• HDF5: https://www.h5py.org/