Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

can't build optimum-nvidia #96

Open
dahwin opened this issue Mar 16, 2024 · 1 comment
Open

can't build optimum-nvidia #96

dahwin opened this issue Mar 16, 2024 · 1 comment

Comments

@dahwin
Copy link

dahwin commented Mar 16, 2024

!TARGET_SM="90-real;89-real"
!git clone --recursive --depth=1 https://github.com/huggingface/optimum-nvidia.git
!cd optimum-nvidia/third-party/tensorrt-llm
!make -C docker release_build CUDA_ARCHS=$TARGET_SM
!cd ../.. && docker build -t <organisation_name/image_name>: -f docker/Dockerfile .

Cloning into 'optimum-nvidia'...
remote: Enumerating objects: 110, done.
remote: Counting objects: 100% (110/110), done.
remote: Compressing objects: 100% (94/94), done.
remote: Total 110 (delta 20), reused 54 (delta 3), pack-reused 0
Receiving objects: 100% (110/110), 770.51 KiB | 6.26 MiB/s, done.
Resolving deltas: 100% (20/20), done.
Submodule 'third-party/tensorrt-llm' (https://github.com/nvidia/tensorrt-llm) registered for path 'third-party/tensorrt-llm'
Cloning into '/kaggle/working/optimum-nvidia/third-party/tensorrt-llm'...
remote: Enumerating objects: 11120, done.
remote: Counting objects: 100% (1080/1080), done.
remote: Compressing objects: 100% (685/685), done.
remote: Total 11120 (delta 382), reused 905 (delta 366), pack-reused 10040
Receiving objects: 100% (11120/11120), 132.15 MiB | 34.95 MiB/s, done.
Resolving deltas: 100% (7362/7362), done.
fatal: remote error: upload-pack: not our ref 37aa4499520eea1d6c6dbc04a66d77bef00014f5
fatal: the remote end hung up unexpectedly
Fetched in submodule path 'third-party/tensorrt-llm', but it did not contain 37aa4499520eea1d6c6dbc04a66d77bef00014f5. Direct fetching of that commit failed.
make: *** docker: No such file or directory. Stop.
/bin/bash: organisation_name/image_name: No such file or directory

@jmurphyq
Copy link

cd third-party
rm -fr tensorrt-llm
git clone  https://github.com/nvidia/tensorrt-llm
cd tensorrt-llm
git submodule update --init --recursive
make -C docker release_build CUDA_ARCHS="90-real;89-real"
cd ../..
docker build -t <organisation_name/image_name>:<version> -f docker/Dockerfile .

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants