Skip to content

python312Packages.numpyro: reduce number of pytest parallel workers to reduce RAM usage#372111

Merged
NickCao merged 1 commit intoNixOS:masterfrom
GaetanLepage:numpyro
Jan 9, 2025
Merged

python312Packages.numpyro: reduce number of pytest parallel workers to reduce RAM usage#372111
NickCao merged 1 commit intoNixOS:masterfrom
GaetanLepage:numpyro

Conversation

@GaetanLepage
Copy link
Contributor

@GaetanLepage GaetanLepage commented Jan 8, 2025

Things done

Running with the default number of jobs, RAM usage reaches more than 100GB.
This patch restricts the number of parallel workers to 8 to prevent causing problems when rebuilding this package.

cc @fabaff

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
  • Tested basic functionality of all binary files (usually in ./result/bin/)
  • 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

Add a 👍 reaction to pull requests you find important.

@GaetanLepage GaetanLepage requested a review from fabaff January 8, 2025 12:06
@github-actions github-actions bot added 6.topic: python Python is a high-level, general-purpose programming language. 10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux. labels Jan 8, 2025
@GaetanLepage
Copy link
Contributor Author

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 372111


x86_64-linux

❌ 4 packages failed to build:
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
✅ 10 packages built:
  • python312Packages.arviz
  • python312Packages.arviz.dist
  • python312Packages.corner
  • python312Packages.corner.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.numpyro
  • python312Packages.numpyro.dist
  • python312Packages.nutpie
  • python312Packages.nutpie.dist

aarch64-linux

❌ 4 packages failed to build:
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.pymc
  • python312Packages.pymc.dist
✅ 10 packages built:
  • python312Packages.arviz
  • python312Packages.arviz.dist
  • python312Packages.corner
  • python312Packages.corner.dist
  • python312Packages.flowmc
  • python312Packages.flowmc.dist
  • python312Packages.numpyro
  • python312Packages.numpyro.dist
  • python312Packages.nutpie
  • python312Packages.nutpie.dist

aarch64-darwin

❌ 4 packages failed to build:
  • python312Packages.bambi
  • python312Packages.bambi.dist
  • python312Packages.numpyro
  • python312Packages.numpyro.dist

@GaetanLepage GaetanLepage force-pushed the numpyro branch 3 times, most recently from 6f0104e to 25d3852 Compare January 8, 2025 16:23
@NickCao NickCao merged commit efc8686 into NixOS:master Jan 9, 2025
21 of 25 checks passed
@GaetanLepage GaetanLepage deleted the numpyro branch January 9, 2025 14:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

6.topic: python Python is a high-level, general-purpose programming language. 10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants