Installing llama-cpp via poetry

[Cirilus]

How to install the GPU llama-cpp via poetry? I used this code, but it doesn't work. If i use pip it works fine

CUDACXX=/usr/local/cuda-12/bin/nvcc CMAKE_ARGS="-DLLAMA_CUBLAS=on -DCMAKE_CUDA_ARCHITECTURES=all-major" FORCE_CMAKE=1 poetry run pip install llama-cpp-python

[Cirilus]

Just use

CUDACXX=/usr/local/cuda-12/bin/nvcc CMAKE_ARGS="-DLLAMA_CUBLAS=on -DCMAKE_CUDA_ARCHITECTURES=all-major" FORCE_CMAKE=1 poetry run pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir