Skip to content

Commit 4c3710a

Browse files
authored
chore(model gallery): add chuluun-qwen2.5-72b-v0.08 (#4689)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent 901b062 commit 4c3710a

File tree

1 file changed

+18
-0
lines changed

1 file changed

+18
-0
lines changed

gallery/index.yaml

Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -3305,6 +3305,24 @@
33053305
- filename: Art-v0-3B-Q4_K_M.gguf
33063306
sha256: 551acd326ce9a743b6e06e094865eb2f06c23c81c812ce221d757bf27ceec9f7
33073307
uri: huggingface://bartowski/Art-v0-3B-GGUF/Art-v0-3B-Q4_K_M.gguf
3308+
- !!merge <<: *qwen25
3309+
name: "chuluun-qwen2.5-72b-v0.08"
3310+
icon: https://huggingface.co/DatToad/Chuluun-Qwen2.5-72B-v0.08/resolve/main/Chuluun8-2.png
3311+
urls:
3312+
- https://huggingface.co/DatToad/Chuluun-Qwen2.5-72B-v0.08
3313+
- https://huggingface.co/bartowski/Chuluun-Qwen2.5-72B-v0.08-GGUF
3314+
description: |
3315+
This is a merge of pre-trained language models created using mergekit.
3316+
I re-ran the original Chuluun formula including the newly released Ink from Allura-Org. I've found the addition gives the model a lot more variability, likely because of aggressive de-slop applied to its dataset. Sometimes this means a word choice will be strange and you'll want to manually edit when needed, but it means you'll see less ministrations sparkling with mischief.
3317+
Because of this the best way to approach the model is to run multiple regens and choose the one you like, edit mercilessly, and continue. Like the original Chuluun this variant is very steerable for complex storywriting and RP. It's probably also a little spicier than v0.01 with both Magnum and whatever the heck Fizz threw into the data for Ink.
3318+
I've also been hearing praise for a level of character intelligence not seen in other models, including Largestral finetunes and merges. I'm not about to say any model of mine is smarter because it was a dumb idea to use Tess as the base and it somehow worked.
3319+
overrides:
3320+
parameters:
3321+
model: Chuluun-Qwen2.5-72B-v0.08-Q4_K_M.gguf
3322+
files:
3323+
- filename: Chuluun-Qwen2.5-72B-v0.08-Q4_K_M.gguf
3324+
sha256: 0fec82625f74a9a340837de7af287b1d9042e5aeb70cda2621426db99958b0af
3325+
uri: huggingface://bartowski/Chuluun-Qwen2.5-72B-v0.08-GGUF/Chuluun-Qwen2.5-72B-v0.08-Q4_K_M.gguf
33083326
- &smollm ## SmolLM
33093327
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
33103328
name: "smollm-1.7b-instruct"

0 commit comments

Comments
 (0)