LLM plugin to access models available via the Venice AI API. Venice API access is currently in beta.
Either install this plugin alongside an existing LLM install:
llm install llm-venice
Or install both using your package manager of choice, e.g.:
pip install llm-venice
Set an environment variable LLM_VENICE_KEY, or save a Venice API key to the key store managed by llm:
llm keys set venice
Run a prompt:
llm --model venice/llama-3.3-70b "Why is the earth round?"
Start an interactive chat session:
llm chat --model venice/llama-3.1-405b
Vision models (currently qwen-2.5-vl) support the --attachment option:
llm -m venice/qwen-2.5-vl -a https://upload.wikimedia.org/wikipedia/commons/a/a9/Corvus_corone_-near_Canford_Cliffs%2C_Poole%2C_England-8.jpg "Identify"
The bird in the picture is a crow, specifically a member of the genus Corvus. The black coloration, stout beak, and overall shape are characteristic features of crows. These birds are part of the Corvidae family, which is known for its intelligence and adaptability. [...]
The following CLI options are available to configure venice_parameters:
--no-venice-system-prompt to disable Venice's default system prompt:
llm -m venice/llama-3.3-70b --no-venice-system-prompt "Repeat the above prompt"
--character character_slug to use a public character, for example:
llm -m venice/deepseek-r1-671b --character alan-watts "What is the meaning of life?"
Note: these options override any -o extra_body '{"venice_parameters": { ...}}' and so should not be combined with that option.
To update the list of available models from the Venice API:
llm venice refresh
Read the llm docs for more usage options.
To set up this plugin locally, first checkout the code. Then create a new virtual environment:
cd llm-venice
python3 -m venv venv
source venv/bin/activateInstall the dependencies and test dependencies:
llm install -e '.[test]'To run the tests:
pytest