Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

python312Packages.numpyro: reduce number of pytest parallel workers to reduce RAM usage #372111

Merged
merged 1 commit into from
Jan 9, 2025

Conversation

GaetanLepage
Copy link
Contributor

@GaetanLepage GaetanLepage commented Jan 8, 2025

Things done

Running with the default number of jobs, RAM usage reaches more than 100GB.
This patch restricts the number of parallel workers to 8 to prevent causing problems when rebuilding this package.

cc @fabaff

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@GaetanLepage
Copy link
Contributor Author

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 372111


x86_64-linux

❌ 4 packages failed to build:
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
✅ 10 packages built:
  • python312Packages.arviz
  • python312Packages.arviz.dist
  • python312Packages.corner
  • python312Packages.corner.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.numpyro
  • python312Packages.numpyro.dist
  • python312Packages.nutpie
  • python312Packages.nutpie.dist

aarch64-linux

❌ 4 packages failed to build:
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
✅ 10 packages built:
  • python312Packages.arviz
  • python312Packages.arviz.dist
  • python312Packages.corner
  • python312Packages.corner.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.numpyro
  • python312Packages.numpyro.dist
  • python312Packages.nutpie
  • python312Packages.nutpie.dist

aarch64-darwin

❌ 4 packages failed to build:
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.numpyro
  • python312Packages.numpyro.dist

@GaetanLepage GaetanLepage force-pushed the numpyro branch 3 times, most recently from 6f0104e to 25d3852 Compare January 8, 2025 16:23
@NickCao NickCao merged commit efc8686 into NixOS:master Jan 9, 2025
23 of 27 checks passed
@GaetanLepage GaetanLepage deleted the numpyro branch January 9, 2025 14:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants