Hello,
Is there currently a known issue with CUDA? Whenever I try to build with CUDA, I get an error at the step Compiling "llama-cpp-sys-2 (build)". When I build without CUDA, it completes successfully—although with a few warnings—and LTEngine starts and works, but without using the GPU (Nvidia 3080 Ti).
Hello,
Is there currently a known issue with CUDA? Whenever I try to build with CUDA, I get an error at the step Compiling "llama-cpp-sys-2 (build)". When I build without CUDA, it completes successfully—although with a few warnings—and LTEngine starts and works, but without using the GPU (Nvidia 3080 Ti).