Skip to content
New issue

v0.13.1

Closed Jul 12, 2024 100% complete
ENH: Added the parameter 'worker_ip' to the 'register' model. enhancement New feature or request
#1773 by hainaweiben was merged Jul 12, 2024 Loading…
QUESTION how to load mini cpmV 2.5 gguf model which has two model files with xinference? question Further information is requested
#1681 by Greatz08 was closed Jul 12, 2024
1
BUG: cache status missing for model id with quantization placeholder bug Something isn't working
#1849 by Zihann73 was merged Jul 12, 2024 Loading…
FEAT: Add support for Flexible Model feature
#1671 by shellc was merged Jul 12, 2024 Loading…
12
REF: Remove chatglm-cpp and Fix latest llama-cpp-python issue gpu refactor
#1844 by ChengjieLi28 was merged Jul 12, 2024 Loading…
1
当加载了llm模型Qwen1.5-14B-Chat-GPTQ-int4后，就不能加载m3e-base向量模型了 gpu
#1848 by worm128 was closed Jul 12, 2024
2
Xinference最新版本启动加载模型很容易崩溃 gpu
#1847 by worm128 was closed Jul 12, 2024
1
部署deepseek-coder-6.7b-instruct 并用oneapi代理，使用openai调用报错
#1845 by xxch was closed Jul 11, 2024
1 of 3 tasks
2
FIX: [UI] Fix download_hub bugs. bug Something isn't working
#1846 by yiboyasss was merged Jul 11, 2024 Loading…
DOC: update readme documentation Improvements or additions to documentation
#1815 by qinxuye was merged Jul 11, 2024 Loading…
FEAT: [UI] Specify download hub. feature
#1840 by yiboyasss was merged Jul 11, 2024 Loading…
FEAT: support choose download hub feature
#1841 by amumu96 was merged Jul 11, 2024 Loading…
bge-reranker-large推理异常 gpu
#1839 by caixiongjiang was closed Jul 11, 2024
1 of 3 tasks
6
cogvlm2 推理异常
#1836 by atlasroben was closed Jul 11, 2024
1 of 3 tasks
3
CHORE: Update issue template
#1833 by ChengjieLi28 was merged Jul 10, 2024 Loading…
1
对设备不适当的 ioctl 操作.
#1829 by xxch was closed Jul 10, 2024
1
模型为什么经常重启呢
#1831 by xxch was closed Jul 10, 2024
1
建议embeddingmodel参考fastchat加batch参数。
#1832 by Damonpkl was closed Jul 10, 2024
1
Failed to load model
#1828 by silver0919 was closed Jul 10, 2024
1
BUG: ChatTTS voice NoneType error bug Something isn't working
#1826 by halexan was closed Jul 10, 2024
1
CHORE: Close issue when it is stale
#1827 by ChengjieLi28 was merged Jul 10, 2024 Loading…
1
windows环境启动qwen2-instruct报错KeyError
#1739 by BarryCui was closed Jul 10, 2024
8
launch beg-reranker-base error trust_remote_code
#1751 by opsvr202 was closed Jul 10, 2024
1
embedding模型中是否可以在多个worker节点运行 question Further information is requested
#1756 by m199369309 was closed Jul 10, 2024
2
本地启动无法用gpu拉起自定义路径的本地模型 ValueError: [address=0.0.0.0:11083, pid=11576] Worker 0.0.0.0:11083 cannot use the GPUs with these indexes: [2]. Worker 0.0.0.0:11083 can only see these GPUs: []. gpu question Further information is requested
#1757 by shendepuren was closed Jul 10, 2024
6
Loading