[Bug] get not run docker into container

[zlwu92]

Checklist

• 1. I have searched related issues but cannot get the expected help.
• 2. The bug has not been fixed in the latest version.
• 3. Please note that if the bug-related issue you submitted lacks corresponding environment info and a minimal reproducible demo, it will be challenging for us to reproduce and resolve the issue, reducing the likelihood of receiving feedback.
• 4. If the issue you raised is not a bug but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.
• 5. Please use English, otherwise it will be closed.

Describe the bug

Hi,

I am using command docker run --privileged --gpus all -it --rm --shm-size 32g -p 30000:30000 -v ~/.cache/huggingface:/root/.cache/huggingface --env "HF_TOKEN=xxxx" --ipc=host lmsysorg/sglang:dev --host 0.0.0.0 --port 30000 to run the docker.

After it finish pulling down the image,

I don't know why I get this error, nvidia-smi gets like this.

Reproduction

.

Environment

.

[Fridge003]

Hi @zlwu92 , could you please remove --host 0.0.0.0 --port 30000 in your command and try again? These two args are for server launching.