Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[CI] Add a new environment called pytorch-min-ci #7522

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

[CI] Add a new environment called pytorch-min-ci #7522

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions docker/Dockerfile.ci_cpu
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,10 +23,19 @@ RUN bash /install/ubuntu_install_conda.sh

ENV CONDA_ALWAYS_YES="true"

# torch
COPY install/conda_env/torch_cpu.yml /install/conda_env/torch_cpu.yml
COPY install/conda_env/torch_common_pip.txt /install/conda_env/torch_common_pip.txt

# torch latest
COPY install/conda_env/torch_cpu_pip.txt /install/conda_env/torch_cpu_pip.txt
RUN ["/bin/bash", "-i", "-c", "conda env create -f /install/conda_env/torch_cpu.yml"]

# torch min
COPY install/conda_env/torch_cpu_pip_min.txt /install/conda_env/torch_cpu_pip_min.txt
RUN ["/bin/bash", "-i", "-c", "conda env create -f /install/conda_env/torch_cpu_min.yml"]
# torch end

COPY install/conda_env/tensorflow_cpu.yml /install/conda_env/tensorflow_cpu.yml
RUN ["/bin/bash", "-i", "-c", "conda env create -f /install/conda_env/tensorflow_cpu.yml"]

Expand Down
9 changes: 9 additions & 0 deletions docker/Dockerfile.ci_gpu
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,10 +16,19 @@ RUN bash /install/ubuntu_install_conda.sh

ENV CONDA_ALWAYS_YES="true"

# torch
COPY install/conda_env/torch_gpu.yml /install/conda_env/torch_gpu.yml
COPY install/conda_env/torch_common_pip.txt /install/conda_env/torch_common_pip.txt

# torch latest
COPY install/conda_env/torch_gpu_pip.txt /install/conda_env/torch_gpu_pip.txt
RUN ["/bin/bash", "-i", "-c", "conda env create -f /install/conda_env/torch_gpu.yml"]

# torch min
COPY install/conda_env/torch_gpu_pip_min.txt /install/conda_env/torch_gpu_pip_min.txt
RUN ["/bin/bash", "-i", "-c", "conda env create -f /install/conda_env/torch_gpu_min.yml"]
# torch end

COPY install/conda_env/tensorflow_gpu.yml /install/conda_env/tensorflow_gpu.yml
RUN ["/bin/bash", "-i", "-c", "conda env create -f /install/conda_env/tensorflow_gpu.yml"]

Expand Down
22 changes: 22 additions & 0 deletions docker/install/conda_env/torch_common_pip.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,22 @@
--find-links https://download.pytorch.org/whl/torch_stable.html
cython
matplotlib
networkx
nltk
nose
numpy
ogb
pandas
psutil
pydantic
pytest
pyyaml
rdflib
requests[security]==2.28
scikit-learn
scipy
torchdata
torcheval
torchmetrics
torch_geometric
tqdm
1 change: 1 addition & 0 deletions docker/install/conda_env/torch_cpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,4 +4,5 @@ dependencies:
- pip
- pip:
- --find-links https://download.pytorch.org/whl/torch_stable.html
- --requirement torch_common_pip.txt
- --requirement torch_cpu_pip.txt
8 changes: 8 additions & 0 deletions docker/install/conda_env/torch_cpu_min.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
name: pytorch-min-ci
dependencies:
- python=3.10
- pip
- pip:
- --find-links https://download.pytorch.org/whl/torch_stable.html
- --requirement torch_common_pip.txt
- --requirement torch_cpu_pip_min.txt
23 changes: 1 addition & 22 deletions docker/install/conda_env/torch_cpu_pip.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,25 +1,4 @@
--find-links https://download.pytorch.org/whl/torch_stable.html
cython
filelock
matplotlib
networkx
nltk
nose
numpy
ogb
pandas
psutil
pyarrow
pydantic
pytest
pyyaml
rdflib
requests[security]==2.28
scikit-learn
scipy
torch==2.3.0+cpu
torchdata
torcheval
torchmetrics
torch_geometric
tqdm
torch==2.3.1+cpu
4 changes: 4 additions & 0 deletions docker/install/conda_env/torch_cpu_pip_min.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
--find-links https://download.pytorch.org/whl/torch_stable.html
filelock
pyarrow
torch==2.1.0+cpu
1 change: 1 addition & 0 deletions docker/install/conda_env/torch_gpu.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -4,4 +4,5 @@ dependencies:
- pip
- pip:
- --find-links https://download.pytorch.org/whl/torch_stable.html
- --requirement torch_common_pip.txt
- --requirement torch_gpu_pip.txt
8 changes: 8 additions & 0 deletions docker/install/conda_env/torch_gpu_min.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
name: pytorch-min-ci
dependencies:
- python=3.10
- pip
- pip:
- --find-links https://download.pytorch.org/whl/torch_stable.html
- --requirement torch_common_pip.txt
- --requirement torch_gpu_pip_min.txt
23 changes: 1 addition & 22 deletions docker/install/conda_env/torch_gpu_pip.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,23 +1,2 @@
--find-links https://download.pytorch.org/whl/torch_stable.html
cython
matplotlib
networkx
nltk
nose
numpy
ogb
pandas
psutil
pydantic
pytest
pyyaml
rdflib
requests[security]==2.28
scikit-learn
scipy
torch==2.3.0+cu121
torchdata
torcheval
torchmetrics
torch_geometric
tqdm
torch==2.3.1+cu121
2 changes: 2 additions & 0 deletions docker/install/conda_env/torch_gpu_pip_min.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,2 @@
--find-links https://download.pytorch.org/whl/torch_stable.html
torch==2.1.0+cu121
2 changes: 1 addition & 1 deletion python/setup.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -229,7 +229,7 @@ def get_lib_file_path(lib_name, backend=""):
"torchdata>=0.5.0",
"pandas",
]
if "DGLBACKEND" in os.environ and os.environ["DGLBACKEND"] != "pytorch":
if "DGLBACKEND" in os.environ and "pytorch" not in os.environ["DGLBACKEND"]:
install_requires.pop(install_requires.index("torchdata>=0.5.0"))

setup(
Expand Down
Loading