space efficient non-isolated caches? or use deps solver like micromamba?

[goyalyashpal]

hi all! greetings of the day.

i just found pipx & was thinking to use it for things like:

• ides:thonny, jupyterlab,
• python devtools: ruff black mypy autopep8 flake8
• utils like: pygments
• ... etc

currently,

• other than few shared/Lib like pip, setuptools
• rest all go to their own isolated dirs (right?)
• which will increase the duplicacy over time and consume lots of space
• like i want to use pygments as an app for myself, but other python apps like jupyter use it as a lib too, so, unnecessary duplication for isolation is just plain wastage of resources

so, i was thinking if it would be possible to:

• store atomic & versioned package in one common cache dir
• and then link the required libs from there using symlinks etc...

this seems to be similar to the way

• the proper dependency solvers like micromamba do it in python world,
• or the pnpm does for the node world.

[goyalyashpal]

• found a similar issue over at pipenv: how to share large packages between projects/environments? pipenv#6077