To create the docker image, run the following command from the root of the repository

sudo docker build -t vllm . 

To run the docker image, run the following command from the root of the repository

sudo docker run --gpus all -it --rm -p 5000:5000 -e HUGGINGFACE_KEY=$HUGGINGFACE_KEY vllm