add DDP

layumi · Jan 24, 2024 · d045eeb · d045eeb
1 parent bce32d1
commit d045eeb
Show file tree

Hide file tree

Showing 3 changed files with 9 additions and 0 deletions.
diff --git a/.train.py.swp b/.train.py.swp
diff --git a/=2.0.0 b/=2.0.0
@@ -0,0 +1,7 @@
+Looking in indexes: https://pypi.org/simple, https://pypi.ngc.nvidia.com
+Requirement already satisfied: torch in /home/zzd/miniconda3/lib/python3.7/site-packages (1.10.2)
+Requirement already satisfied: torchvision in /home/zzd/miniconda3/lib/python3.7/site-packages (0.11.3)
+Requirement already satisfied: torchaudio in /home/zzd/miniconda3/lib/python3.7/site-packages (0.10.2)
+Requirement already satisfied: typing_extensions in /home/zzd/miniconda3/lib/python3.7/site-packages (from torch) (3.7.4.3)
+Requirement already satisfied: numpy in /home/zzd/miniconda3/lib/python3.7/site-packages (from torchvision) (1.21.4)
+Requirement already satisfied: pillow!=8.3.0,>=5.3.0 in /home/zzd/miniconda3/lib/python3.7/site-packages (from torchvision) (6.1.0)
diff --git a/DDP.sh b/DDP.sh
@@ -0,0 +1,2 @@
+python -m torch.distributed.launch --nproc_per_node=2  --master_port=6005 train_DDP.py 
+