Skip to content

Commit 3077262

Browse files
committed
docs: update docs
1 parent fa56980 commit 3077262

File tree

1 file changed

+5
-5
lines changed

1 file changed

+5
-5
lines changed

README.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -2,7 +2,7 @@
22
ZeroBand is a production ready codebase for decentralized training of LLM
33

44

5-
## developlment
5+
## Developlment
66

77
install uv
88

@@ -40,22 +40,22 @@ run your code using
4040
uv run ...
4141
```
4242

43-
## quick check
43+
## Quick check
4444

4545
To check that everything is working you can do
4646

4747
```bash
48-
ZERO_BAND_LOG_LEVEL=DEBUG torchrun --nproc_per_node=2 src/zeroband/train.py @configs/debug/normal.toml
48+
ZERO_BAND_LOG_LEVEL=DEBUG torchrun --nproc_per_node=2 src/zeroband/train.py @configs/debug/normal.toml
4949
```
5050

51-
## run diloco
51+
## Run diloco
5252

5353
To run diloco locally you can use the helper script `scripts/simulatsimulate_multi_nodee_mutl.sh`
5454

5555
:note: you need 4 gpus to run the following command
5656

5757
```bash
58-
ZERO_BAND_LOG_LEVEL=DEBUG ./scripts/simulate_multi_node.sh 2 2 src/zeroband/train.py @configs/debug/diloco.toml
58+
ZERO_BAND_LOG_LEVEL=DEBUG ./scripts/simulate_multi_node_diloco.sh 2 2 src/zeroband/train.py @configs/debug/diloco.toml
5959
```
6060

6161
if you have only two gpus

0 commit comments

Comments
 (0)