-
GPU资源有限,一个模型都是提供多个服务。 |
Beta Was this translation helpful? Give feedback.
Answered by
fangyinc
Sep 11, 2023
Replies: 1 comment
-
目前的设计就是支持独立部署多模型服务的,DB-GPT 的webserver 能直接通过接口去调用远程的模型服务。 |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
fangyinc
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
目前的设计就是支持独立部署多模型服务的,DB-GPT 的webserver 能直接通过接口去调用远程的模型服务。