Skip to content

Commit

Permalink
Add ollama example to README
Browse files Browse the repository at this point in the history
I just spent a while trying to understand how to use a locally-running ollama instance, so adding some documentation to the README that would have saved me some time.
  • Loading branch information
devvmh authored Jan 4, 2025
1 parent 22b205d commit 945873e
Showing 1 changed file with 22 additions and 1 deletion.
23 changes: 22 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -55,7 +55,7 @@ The skill utilizes the `~/.config/mycroft/skills/skill-ovos-fallback-chatgpt.ope
}
```

### Configuration for use with Local AI
### Configuration for use with llama.cpp

```json
{
Expand All @@ -70,6 +70,27 @@ The skill utilizes the `~/.config/mycroft/skills/skill-ovos-fallback-chatgpt.ope
}
```

### Configuration for use with a locally-running instance of ollama

See https://ollama.com/blog/openai-compatibility

```json
{
"api_url": "http://localhost:11434/v1",
"key": "sk-xxx",
"persona": "You are a helpful voice assistant with a friendly tone and fun sense of humor. You respond in 40 words or fewer.",
"enable_memory": true,
"memory_size": 15,
"name": "llama",
"confirmation": false,
"__mycroft_skill_firstrun": false
}
```

## See also

https://github.com/OpenVoiceOS/ovos-solver-openai-persona-plugin/tree/dev

## Examples

- "Explain quantum computing in simple terms"
Expand Down

0 comments on commit 945873e

Please sign in to comment.