Cannot install dependencies

[Aloha-Churchill]

While running the provided installation script install_requirements.sh, the setup fails when trying to install pytorch-lightning==1.7.2.

ERROR: Ignored the following versions that require a different python version: 2.5.0 Requires-Python >=3.9; 2.5.0.post0 Requires-Python >=3.9; 2.5.0rc0 Requires-Python >=3.9; 2.5.1 Requires-Python >=3.9; 2.5.1.post0 Requires-Python >=3.9; 2.5.1rc0 Requires-Python >=3.9; 2.5.1rc1 Requires-Python >=3.9; 2.5.1rc2 Requires-Python >=3.9; 2.5.2 Requires-Python >=3.9; 2.5.3 Requires-Python >=3.9; 2.5.4 Requires-Python >=3.9; 2.5.5 Requires-Python >=3.9
ERROR: Could not find a version that satisfies the requirement pytorch-lightning==1.7.2 (from versions: 0.0.2, 0.2, 0.2.2, 0.2.3, 0.2.4, 0.2.4.1, 0.2.5, 0.2.5.1, 0.2.5.2, 0.2.6, 0.3, 0.3.1, 0.3.2, 0.3.3, 0.3.4, 0.3.4.1, 0.3.5, 0.3.6, 0.3.6.1, 0.3.6.3, 0.3.6.4, 0.3.6.5, 0.3.6.6, 0.3.6.7, 0.3.6.8, 0.3.6.9, 0.4.0, 0.4.1, 0.4.2, 0.4.3, 0.4.4, 0.4.5, 0.4.6, 0.4.7, 0.4.8, 0.4.9, 0.5.0, 0.5.1, 0.5.1.2, 0.5.1.3, 0.5.2, 0.5.2.1, 0.5.3, 0.5.3.1, 0.5.3.2, 0.5.3.3, 0.6.0, 0.7.1, 0.7.3, 0.7.5, 0.7.6, 0.8.1, 0.8.3, 0.8.4, 0.8.5, 0.9.0, 0.10.0, 1.0.0, 1.0.1, 1.0.2, 1.0.3, 1.0.4, 1.0.5, 1.0.6, 1.0.7, 1.0.8, 1.1.0, 1.1.1, 1.1.2, 1.1.3, 1.1.4, 1.1.5, 1.1.6, 1.1.7, 1.1.8, 1.2.0rc0, 1.2.0rc1, 1.2.0rc2, 1.2.0, 1.2.1, 1.2.2, 1.2.3, 1.2.4, 1.2.5, 1.2.6, 1.2.7, 1.2.8, 1.2.9, 1.2.10, 1.3.0rc1, 1.3.0rc2, 1.3.0rc3, 1.3.0, 1.3.1, 1.3.2, 1.3.3, 1.3.4, 1.3.5, 1.3.6, 1.3.7, 1.3.7.post0, 1.3.8, 1.4.0rc0, 1.4.0rc1, 1.4.0rc2, 1.4.0, 1.4.1, 1.4.2, 1.4.3, 1.4.4, 1.4.5, 1.4.6, 1.4.7, 1.4.8, 1.4.9, 1.5.0rc0, 1.5.0rc1, 1.5.0, 1.5.1, 1.5.2, 1.5.3, 1.5.4, 1.5.5, 1.5.6, 1.5.7, 1.5.8, 1.5.9, 1.5.10, 1.5.10.post0, 1.6.0rc0, 1.6.0rc1, 1.6.0, 1.6.1, 1.6.2, 1.6.3, 1.6.4, 1.6.5, 1.6.5.post0, 1.7.0rc0, 1.7.0rc1, 1.7.0, 1.7.1, 1.7.2, 1.7.3, 1.7.4, 1.7.5, 1.7.6, 1.7.7, 1.8.0rc0, 1.8.0rc1, 1.8.0rc2, 1.8.0, 1.8.0.post1, 1.8.1, 1.8.2, 1.8.3, 1.8.3.post0, 1.8.3.post1, 1.8.3.post2, 1.8.4, 1.8.4.post0, 1.8.5, 1.8.5.post0, 1.8.6, 1.9.0rc0, 1.9.0, 1.9.1, 1.9.2, 1.9.3, 1.9.4, 1.9.5, 2.0.0rc0, 2.0.0, 2.0.1, 2.0.1.post0, 2.0.2, 2.0.3, 2.0.4, 2.0.5, 2.0.6, 2.0.7, 2.0.8, 2.0.9, 2.0.9.post0, 2.1.0rc0, 2.1.0rc1, 2.1.0, 2.1.1, 2.1.2, 2.1.3, 2.1.4, 2.2.0rc0, 2.2.0, 2.2.0.post0, 2.2.1, 2.2.2, 2.2.3, 2.2.4, 2.2.5, 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.4.0)
ERROR: No matching distribution found for pytorch-lightning==1.7.2

After downgrading pip to < 24.1, I run into a new issue

ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
markdown 3.7 requires importlib-metadata>=4.4; python_version < "3.10", but you have importlib-metadata 3.10.1 which is incompatible.

After changing this, there are other dependency issues. My pip check shows

$ pip check
DEPRECATION: omegaconf 2.0.6 has a non-standard dependency specifier PyYAML>=5.1.*. pip 24.1 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of omegaconf or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at https://github.com/pypa/pip/issues/12063
DEPRECATION: pytorch-lightning 1.7.2 has a non-standard dependency specifier torch>=1.9.*. pip 24.1 will enforce this behaviour change. A possible replacement is to upgrade to a newer version of pytorch-lightning or contact the author to suggest that they release a version with a conforming dependency specifiers. Discussion can be found at https://github.com/pypa/pip/issues/12063
black 21.4b2 requires appdirs, which is not installed.
black 21.4b2 requires mypy-extensions, which is not installed.
black 21.4b2 requires pathspec, which is not installed.
black 21.4b2 requires regex, which is not installed.
black 21.4b2 requires toml, which is not installed.
hydra-core 1.0.5 requires importlib-resources, which is not installed.
markdown 3.7 has requirement importlib-metadata>=4.4; python_version < "3.10", but you have importlib-metadata 3.10.1.

In looking into JonasSchult/Mask3D#193
I suspect perhaps one of the previous dependencies is outdated.

If you have any updates on this, I would be interested to know and will keep testing. Thank you very much for your time and help! :)

My Environment:

• OS: Ubuntu 22.04 (x86_64)
• Python: 3.8 (from Conda environment openmask3d)
• Conda version: 24.x (Miniconda install)
• NVIDIA Driver: 560.28.03
• CUDA Version: 12.6
• GPU: NVIDIA GeForce RTX 4050 Laptop GPU

[rahimbaig28]

fresh env

conda create -n mask3d python=3.8 -y
conda activate mask3d

use pip from Lightning 1.7 era

python -m pip install --upgrade "pip==23.2.1" "setuptools<70" wheel

install PyTorch (compatible with Lightning 1.7.x)

conda install -y -c pytorch -c nvidia pytorch==1.13.1 torchvision==0.14.1 pytorch-cuda=11.8

install working Lightning stack

pip install
"pytorch-lightning==1.7.7"
"torchmetrics==0.9.3"
"omegaconf==2.1.2"
"hydra-core==1.1.2"
"markdown==3.4.1"
"importlib-metadata==4.13.0"

fix dev-tooling warnings

pip install "black==21.4b2" appdirs mypy-extensions pathspec regex toml
Reason:
New pip ≥ 24.1 enforces dependency specs that old packages (Lightning 1.7 / Hydra 1.0) violate.
Locking pip 23.2.1 and compatible deps restores a stable 2022-era environment.

If you can upgrade to Python ≥ 3.9, switch to pytorch-lightning>=2.2,<2.5 instead — it’s fully modern and resolves these conflicts automatically.