File tree Expand file tree Collapse file tree 1 file changed +19
-0
lines changed Expand file tree Collapse file tree 1 file changed +19
-0
lines changed Original file line number Diff line number Diff line change 5476
5476
- filename: DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
5477
5477
sha256: 181a82a1d6d2fa24fe4db83a68eee030384986bdbdd4773ba76424e3a6eb9fd8
5478
5478
uri: huggingface://bartowski/DeepSeek-R1-Distill-Llama-70B-GGUF/DeepSeek-R1-Distill-Llama-70B-Q4_K_M.gguf
5479
+ - !!merge <<: *deepseek-r1
5480
+ name: "deepseek-r1-qwen-2.5-32b-ablated"
5481
+ icon: https://cdn-uploads.huggingface.co/production/uploads/6587d8dd1b44d0e694104fbf/0dkt6EhZYwXVBxvSWXdaM.png
5482
+ urls:
5483
+ - https://huggingface.co/NaniDAO/deepseek-r1-qwen-2.5-32B-ablated
5484
+ - https://huggingface.co/bartowski/deepseek-r1-qwen-2.5-32B-ablated-GGUF
5485
+ description: |
5486
+ DeepSeek-R1-Distill-Qwen-32B with ablation technique applied for a more helpful (and based) reasoning model.
5487
+
5488
+ This means it will refuse less of your valid requests for an uncensored UX. Use responsibly and use common sense.
5489
+
5490
+ We do not take any responsibility for how you apply this intelligence, just as we do not for how you apply your own.
5491
+ overrides:
5492
+ parameters:
5493
+ model: deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
5494
+ files:
5495
+ - filename: deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
5496
+ sha256: 7f33898641ebe58fe178c3517efc129f4fe37c6ca2d8b91353c4539b0c3411ec
5497
+ uri: huggingface://bartowski/deepseek-r1-qwen-2.5-32B-ablated-GGUF/deepseek-r1-qwen-2.5-32B-ablated-Q4_K_M.gguf
5479
5498
- &qwen2 ## Start QWEN2
5480
5499
url: "github:mudler/LocalAI/gallery/chatml.yaml@master"
5481
5500
name: "qwen2-7b-instruct"
You can’t perform that action at this time.
0 commit comments