Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

embedding模型中是否可以在多个worker节点运行 #1756

Closed
m199369309 opened this issue Jul 1, 2024 · 2 comments
Closed

embedding模型中是否可以在多个worker节点运行 #1756

m199369309 opened this issue Jul 1, 2024 · 2 comments
Labels
question Further information is requested
Milestone
v0.13.1

Comments

@m199369309
Copy link

image，在集群环境中，注册了多个worker，设置embedding模型时，worker ip仅支持填写一个worker，如果此时replica设置为2，模型的所有副本是在一个worker上运行？还是副本会平均跑到多个worker上？
@m199369309 m199369309 added the question Further information is requested label Jul 1, 2024
@XprobeBot XprobeBot added this to the v0.12.4 milestone Jul 1, 2024
@codingl2k1
Copy link
Contributor

选了 GPU 当 replica=2 会分布到两个 GPU 卡运行。

@m199369309
Copy link
Author

选了 GPU 当 replica=2 会分布到两个 GPU 卡运行。

如果2个worker节点，每个1个GPU，那这时 replica=2 ，是分布到2个worker？

@XprobeBot XprobeBot modified the milestones: v0.13.0, v0.13.1 Jul 5, 2024
@ChengjieLi28 ChengjieLi28 closed this as not planned Won't fix, can't repro, duplicate, stale Jul 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
question Further information is requested
Projects
None yet
Milestone
v0.13.1
Development

No branches or pull requests
4 participants
@m199369309 @ChengjieLi28 @XprobeBot @codingl2k1