Running multiple jobs at the same time

Thanks for the great repo. I have setup the repo and trying to server multiple requests at the same time, however, in a machine with 128 cores, I can only see that ~4 cores being used. Is there a parameters or something that I am not setting properly?