Is it possible to launch multi-node runs without pdsh? #2819
Answered
by
wzj423
kyleliang919
asked this question in
Q&A
-
|
I am on a slurm system and I don not have sudo access to install pdsh? Is there a way to use deepspeed to run multiple node without the launcher? |
Beta Was this translation helpful? Give feedback.
Answered by
wzj423
Oct 25, 2023
Replies: 1 comment
-
|
Yes. Simply use |
Beta Was this translation helpful? Give feedback.
0 replies
Answer selected by
loadams
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Yes. Simply use
torchruninstead ofdeepspeed, see this example here. #1603 (comment)