Skip to content

Webui Wheels
Compare
Choose a tag to compare
@jllllll jllllll released this 20 Jul 01:26
· 117 commits to main since this release
textgen-webui
a484311
This commit was signed with the committer’s verified signature.
jllllll
GPG key ID: 7FCD00C417935797
Learn about vigilant mode.

These are basic/AVX/AVX2 wheels built under a different namespace to allow for simultaneous installation with the main llama-cpp-python package.

Installation can be done with this command:

python -m pip install llama-cpp-python-cuda --prefer-binary --extra-index-url=https://jllllll.github.io/llama-cpp-python-cuBLAS-wheels/textgen/AVX2/cu117

The index URL can be changed similarly to what is described in the main installation instructions.

Assets 4,535
Loading