Resource Constraints (Bin Packing/Slots)

[ramn51]

Need to give the scheduler the job based on the load. This load needs specification like ML job needs the amount of RAM and storage needed for the job. This means extension to existing logic of SUBMIT to include RAM size. Currently Job based on load is done but its not based on RAM rather the total tasks that a worker can take and this will make it properly resource aware.

[ramn51]

This means we need to do the scaling of workers by spreading the worker processes to balance resources.