Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
79 commits
Select commit Hold shift + click to select a range
c316b27
seperate data preparation and pipeline run
anschaible Mar 26, 2025
cab76af
tests on sharding
anschaible Mar 28, 2025
a622e28
issues with sharding galaxy
anschaible Apr 15, 2025
9d01319
get rid of reshape data, pmap and the extra dimension in the arrays
anschaible Apr 23, 2025
f599f73
remove chunking of particles for spectral lookup
anschaible Apr 23, 2025
54a71ec
sharding implementation works on one device
anschaible Apr 23, 2025
249eb80
use multiple cpus
anschaible Apr 23, 2025
d0b5d77
works on multiple cpus, and olso forparticle number not modulodevides…
anschaible Apr 23, 2025
3c7d2e6
experiment with sharding, does not work for large particle sizes yet
anschaible Apr 24, 2025
76e9abf
comment code
anschaible Apr 24, 2025
739f85b
sharding nochmal chunken
anschaible Apr 25, 2025
ceeb4dc
current sharding version, still not fully working
anschaible Apr 28, 2025
3d28d2a
implement shard map according to Leonard hints
anschaible Apr 28, 2025
b51e08f
sharding now works, remove for loop through jax.for_i is still missing
anschaible Apr 28, 2025
53ed291
work on sharding experiments
MaHaWo May 5, 2025
ef8c069
work on sharding test pipeline in separate notebook
MaHaWo May 5, 2025
4396590
reset single function notebook
MaHaWo May 5, 2025
1cadba4
finish test notebook
MaHaWo May 6, 2025
dceb560
pipeline execution .py file
anschaible May 12, 2025
6c1133a
test
anschaible May 19, 2025
9938581
test
anschaible May 19, 2025
6020fef
sharding works now, I assume
anschaible May 20, 2025
5b4f76d
nihao and illustris config
anschaible May 20, 2025
bb5adbd
to calculate mock NIHAOS with mastar
anschaible May 25, 2025
e107c13
issue with memory and underflow/overflow
anschaible May 26, 2025
0c0ae51
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] May 26, 2025
aabcde0
Implement review comment: offset = (_wave[1] - _wave[0]) / 2.
anschaible May 28, 2025
249b51a
add particle spectra individually to the in the beginning empty datacube
anschaible May 29, 2025
349fc21
lax scan over particles and and add them to datacube
anschaible Jun 2, 2025
49a6496
lax.scan works and produces same results as old shard map, bit slower…
anschaible Jun 2, 2025
d14bd2b
notebook for comparison between old and new method in shard_map
anschaible Jun 3, 2025
eb75420
notebook changes
anschaible Jun 3, 2025
61d6156
notebooks
anschaible Jun 3, 2025
199fd3f
merge conflicts
anschaible Jun 3, 2025
8a94248
Merge branch 'main' into restructure-pipelinefunctions
anschaible Jun 3, 2025
8128662
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 3, 2025
af5d7d4
implement rotation matrix storage and read in for NIHAO
anschaible Jun 5, 2025
3871f2e
pytests
anschaible Jun 6, 2025
4ad3013
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 6, 2025
98be912
fix some more pytests
anschaible Jun 6, 2025
2e19506
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 6, 2025
4003c8e
fix some more pytests
anschaible Jun 10, 2025
d513123
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 10, 2025
28c0d0d
some more pytests
anschaible Jun 10, 2025
85e92ed
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 10, 2025
f4386c5
comment out some notebook cells
anschaible Jun 10, 2025
beae26c
some more notebook cells commented out
anschaible Jun 10, 2025
aa580ce
Merge branch 'gsf-splitting-nihao' into restructure-pipelinefunctions
anschaible Jun 11, 2025
dfe019d
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 11, 2025
5344e9d
fix failing pytests
anschaible Jun 11, 2025
35e1370
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jun 11, 2025
a1743b5
delete notebook
anschaible Jun 11, 2025
30fb69e
Update rubix/core/ifu.py
anschaible Jun 17, 2025
1422247
scaling relation on cpu
anschaible Jul 2, 2025
07cb666
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 2, 2025
5da0011
Timing on gpus
anschaible Jul 2, 2025
8867c6b
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 2, 2025
f94b12c
scaling relations for computation
anschaible Jul 2, 2025
760b063
minor: deleting some lines that were already commented out in the fit…
anschaible Jul 2, 2025
5235b6f
change timing
anschaible Jul 3, 2025
315a2b6
scaling
anschaible Jul 3, 2025
0ca0a58
Merge branch 'main' into restructure-pipelinefunctions
Jul 3, 2025
1518894
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 3, 2025
090a4e2
fix failing test after merge.
Jul 3, 2025
20fe06c
updated notebook cells with `#NBVAL_SKIP`
Jul 3, 2025
f0759af
change pipeline config name
anschaible Jul 4, 2025
3506110
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 4, 2025
844c902
remove outdated stuff
anschaible Jul 4, 2025
91941ff
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Jul 4, 2025
9dda882
added padding function
Jul 9, 2025
d2f0d15
fix tests of ifu pipelin
Jul 9, 2025
34e558e
fix failing pytests
Jul 10, 2025
8c8aaf2
update core data regarding Haralds and Tobias comments
anschaible Nov 4, 2025
85f743f
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Nov 4, 2025
6fe3212
change core modules regarding comments
anschaible Nov 4, 2025
f884b84
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Nov 4, 2025
3935dd7
changes according to Haralds review comments
anschaible Nov 4, 2025
42d6129
[pre-commit.ci] auto fixes from pre-commit.com hooks
pre-commit-ci[bot] Nov 4, 2025
7c150c8
fixing failing pytest
anschaible Nov 4, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
3 changes: 3 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -176,3 +176,6 @@ rubix/spectra/ssp/templates/fsps.h5
notebooks/frames
notebooks/frames/*
notebooks/data/*

# don´t add .env files
*.env
Loading
Loading