Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

使用本地Xinference运行,current_model参数是什么? #145

Open
tankGe opened this issue Aug 2, 2024 · 3 comments
Open

使用本地Xinference运行,current_model参数是什么? #145

tankGe opened this issue Aug 2, 2024 · 3 comments
Labels
solved For those issues already solved but stay open for more user can see

Comments

@tankGe
Copy link

tankGe commented Aug 2, 2024

Agently.AgentFactory()
.set_settings("current_model", "OAIClient")
.set_settings("model.OAIClient.auth.api_key", "nothing")
.set_settings("model.OAIClient.options", {"model": "my-llm"})
.set_settings("model.OAIClient.url", "http://127.0.0.1:9997/v1")

@Maplemx
Copy link
Owner

Maplemx commented Aug 3, 2024

就是"OAIClient",这个参数决定的是你用哪个模型插件进行模型请求

@Maplemx Maplemx added the solved For those issues already solved but stay open for more user can see label Aug 3, 2024
@tankGe
Copy link
Author

tankGe commented Aug 5, 2024

就是"OAIClient",这个参数决定的是你用哪个模型插件进行模型请求
是不是可以理解为这个参数两个参数值,一个OpenAI代表调用在线模型,一个OAIClient代表本地模型?

@Maplemx
Copy link
Owner

Maplemx commented Aug 12, 2024

就是"OAIClient",这个参数决定的是你用哪个模型插件进行模型请求
是不是可以理解为这个参数两个参数值,一个OpenAI代表调用在线模型,一个OAIClient代表本地模型?

不是,OAIClient是Agently框架为OpenAI-Like的模型提供的特殊的请求方案,兼容了一些常见的消息规范

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
solved For those issues already solved but stay open for more user can see
Projects
None yet
Development

No branches or pull requests

2 participants