GPU Support for Containerized Processors (OpenTPOD Processors)

[junjuew]

The latest nvidia-docker requires "--gpus" flag to expose GPU to containers. (See here).

However, docker python API doesn't support "--gpus" flag yet. See this issue. The workaround mentioned in the issue seems too hacky to add for now. I suspect the official support for "--gpus" would come soon.

When "--gpus" is supported by docker python API, we want to add that parameter to this function call in order to enable inference on GPU.