Support Stella-EN 1.5B v5 pre-tokenizer #11162
shermanhuman
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Currently llama.cpp doesn't seem to support Stella-en-1.5b-v5:
Error logs from LM Studio:
This Qwen based model scores highly on the MTEB leaderboard. I think running embedding models locally are a big win for privacy, and so a great addition to llama.cpp.
It does run on Ollama now, so maybe we can borrow from their fork?
Beta Was this translation helpful? Give feedback.
All reactions