Skip to content

Commit 3b6b37a

Browse files
authored
chore(model gallery): add deepseek-r1-qwen-2.5-32b-ablated (#4693)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
1 parent 8f5aa2d commit 3b6b37a

File tree

1 file changed

+19
-0
lines changed

1 file changed

+19
-0
lines changed

gallery/index.yaml

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -5476,6 +5476,25 @@
54765476
- filename: DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
54775477
sha256: 181a82a1d6d2fa24fe4db83a68eee030384986bdbdd4773ba76424e3a6eb9fd8
54785478
uri: huggingface://bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF/DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
5479+
- !!merge <<: *deepseek-r1
5480+
name: "deepseek-r1-qwen-2.5-32b-ablated"
5481+
icon: https://cdn-uploads.huggingface.co/production/uploads/6587d8dd1b44d0e694104fbf/0dkt6EhZYwXVBxvSWXdaM.png
5482+
urls:
5483+
- https://huggingface.co/NaniDAO/deepseek-r1-qwen-2.5-32B-ablated
5484+
- https://huggingface.co/bartowski/deepseek-r1-qwen-2.5-32B-ablated-GGUF
5485+
description: |
5486+
DeepSeek-R1-Distill-Qwen-32B with ablation technique applied for a more helpful (and based) reasoning model.
5487+
5488+
This means it will refuse less of your valid requests for an uncensored UX. Use responsibly and use common sense.
5489+
5490+
We do not take any responsibility for how you apply this intelligence, just as we do not for how you apply your own.
5491+
overrides:
5492+
parameters:
5493+
model: deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
5494+
files:
5495+
- filename: deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
5496+
sha256: 7f33898641ebe58fe178c3517efc129f4fe37c6ca2d8b91353c4539b0c3411ec
5497+
uri: huggingface://bartowski/deepseek-r1-qwen-2.5-32B-ablated-GGUF/deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
54795498
- &qwen2 ## Start QWEN2
54805499
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
54815500
name: "qwen2-7b-instruct"

0 commit comments

Comments
 (0)