redis server fills up after 256 timesteps

[apigott]

The Redis server has a (default) memory limit of 256 files on Mac. This can easily be overridden in the terminal with ulimit -n 1024 or any other arbitrary file limit.

However, in order to avoid massive memory requirements I propose flushing the Redis files using .flushall() on a daily basis.

In the meantime I've added a flush off the Redis database on start of each run

[apigott]

Solved by using a Singleton class for the Redis-server instantiation and passing the Redis-server to the Aggregator and MPCCalc classes.

Proposed solution above will not work because
self.redis_client = StrictRedis(host=os.environ.get('REDIS_HOST', 'localhost'), decode_responses=True)
creates a new pool of redis connections each time a new MPCCalc object is created (in each timestep) and the pool is the equivalent of an open file. Can be solved through passing a redis_client variable to each class. Furthermore the Singleton eliminates the possibility of opening more than one pool locally.

I allowed the aggregator class to act as the host to the Redis-server but this can be moved to main if it causes issues.

Error persists when MPCLogger is instantiated at every timestep. Resolved by creating logs at main and passing them through.

[apigott]

To clarify the system level file limit is no longer relevant and log runs work with arbitrary limits such as ulimit -n 256