Skip to content

是否可以参照manager.py中的那5个REST调用,另外实现一个远程服务,再通过MODEL_SERVER配置进dbgpt里使用 #571

Answered by fangyinc
czhcc asked this question in Q&A
Discussion options

You must be logged in to vote

GPU资源有限,一个模型都是提供多个服务。 如果参照manager.py中的那5个REST调用,是否也可以挂到dbgpt里使用?

目前的设计就是支持独立部署多模型服务的,DB-GPT 的webserver 能直接通过接口去调用远程的模型服务。

Replies: 1 comment

Comment options

You must be logged in to vote
0 replies
Answer selected by fangyinc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Category
Q&A
Labels
None yet
2 participants