skip and guard torch.distributed accordingly
#5324
| Job | Run time |
|---|---|
| 10m 30s | |
| 31m 57s | |
| 10m 45s | |
| 30m 42s | |
| 7m 31s | |
| 27m 26s | |
| 12m 18s | |
| 24m 42s | |
| 26m 29s | |
| 25m 0s | |
| 24m 8s | |
| 28m 0s | |
| 1s | |
| 4h 19m 29s |
torch.distributed accordingly
#5324
| Job | Run time |
|---|---|
| 10m 30s | |
| 31m 57s | |
| 10m 45s | |
| 30m 42s | |
| 7m 31s | |
| 27m 26s | |
| 12m 18s | |
| 24m 42s | |
| 26m 29s | |
| 25m 0s | |
| 24m 8s | |
| 28m 0s | |
| 1s | |
| 4h 19m 29s |