Skip to content

First result from dandi hub#79

Closed
oruebel wants to merge 2 commits intodisable_remote_lindi_rfs_genfrom
new_results_from_DANDIHub
Closed

First result from dandi hub#79
oruebel wants to merge 2 commits intodisable_remote_lindi_rfs_genfrom
new_results_from_DANDIHub

Conversation

@oruebel
Copy link
Contributor

@oruebel oruebel commented Nov 21, 2024

This is the first result from DANDIHub . This is before the ICEphys Zarr file was changed. I'm running again now

@oruebel
Copy link
Contributor Author

oruebel commented Nov 21, 2024

Here the CLI output from that run:

jovyan@jupyter-oruebel:~/nwb_benchmarks$ nwb_benchmarks run
/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/__init__.py:16: UserWarning: tshark not found. Set TSHARK_PATH in the environment or install tshark on the default path.
  warnings.warn(msg)
· Discovering benchmarks
· Running 24 total benchmarks (1 commits * 1 environments * 24 benchmarks)
[ 0.00%] · For nwb_benchmarks commit 61b361be <main>:
[ 0.00%] ·· Building for existing-py_opt_conda_bin_python3.11
[ 0.00%] ·· Benchmarking existing-py_opt_conda_bin_python3.11
[ 4.17%] ··· time_remote_file_reading.DirectFileReadBenchmark.time_read_hdf5_fsspec_no_cache                                                                                                                                                                                                                   ok
[ 4.17%] ··· ========================================================================================== ==========
                                                       s3_url                                                     
             ------------------------------------------------------------------------------------------ ----------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   124±9ms  
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   181±6ms  
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   114±10ms 
             ========================================================================================== ==========

[ 8.33%] ··· time_remote_file_reading.DirectFileReadBenchmark.time_read_hdf5_fsspec_with_cache                                                                                                                                                                                                                 ok
[ 8.33%] ··· ========================================================================================== ==========
                                                       s3_url                                                     
             ------------------------------------------------------------------------------------------ ----------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   110±10ms 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   207±8ms  
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   165±6ms  
             ========================================================================================== ==========

[12.50%] ··· time_remote_file_reading.DirectFileReadBenchmark.time_read_hdf5_remfile                                                                                                                                                                                                                           ok
[12.50%] ··· ========================================================================================== ==========
                                                       s3_url                                                     
             ------------------------------------------------------------------------------------------ ----------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   92.4±2ms 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   162±7ms  
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   121±4ms  
             ========================================================================================== ==========

[16.67%] ··· time_remote_file_reading.DirectFileReadBenchmark.time_read_hdf5_remfile_with_cache                                                                                                                                                                                                                ok
[16.67%] ··· ========================================================================================== ==========
                                                       s3_url                                                     
             ------------------------------------------------------------------------------------------ ----------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   101±4ms  
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   163±10ms 
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   114±2ms  
             ========================================================================================== ==========

[20.83%] ··· time_remote_file_reading.DirectFileReadBenchmark.time_read_hdf5_ros3                                                                                                                                                                                                                              ok
[20.83%] ··· ========================================================================================== ===========
                                                       s3_url                                                      
             ------------------------------------------------------------------------------------------ -----------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    211±1ms  
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   215±0.8ms 
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   213±0.9ms 
             ========================================================================================== ===========

[25.00%] ··· time_remote_file_reading.DirectZarrFileReadBenchmark.time_read_zarr                                                                                                                                                                                                                               ok
[25.00%] ··· ============================================================== ============
                                         s3_url                                         
             -------------------------------------------------------------- ------------
              s3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/   40.8±10ms  
              s3://dandiarchive/zarr/c8c6b848-fbc6-4f58-85ff-e3f2618ee983/   20.0±0.4ms 
             ============================================================== ============

[29.17%] ··· time_remote_file_reading.DirectZarrFileReadBenchmark.time_read_zarr_force_no_consolidated                                                                                                                                                                                                         ok
[29.17%] ··· ============================================================== ============
                                         s3_url                                         
             -------------------------------------------------------------- ------------
              s3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/    82.4±4ms  
              s3://dandiarchive/zarr/c8c6b848-fbc6-4f58-85ff-e3f2618ee983/   90.6±0.5ms 
             ============================================================== ============

[33.33%] ··· time_remote_file_reading.NWBFileReadBenchmark.time_read_hdf5_nwbfile_fsspec_no_cache                                                                                                                                                                                                              ok
[33.33%] ··· ========================================================================================== ===========
                                                       s3_url                                                      
             ------------------------------------------------------------------------------------------ -----------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   36.9±0.2s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   7.22±0.2s 
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    6.23±0s  
             ========================================================================================== ===========

[37.50%] ··· time_remote_file_reading.NWBFileReadBenchmark.time_read_hdf5_nwbfile_fsspec_with_cache                                                                                                                                                                                                            ok
[37.50%] ··· ========================================================================================== ============
                                                       s3_url                                                       
             ------------------------------------------------------------------------------------------ ------------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   20.2±0.03s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   2.85±0.2s  
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   1.39±0.03s 
             ========================================================================================== ============

[41.67%] ··· time_remote_file_reading.NWBFileReadBenchmark.time_read_hdf5_nwbfile_remfile                                                                                                                                                                                                                      ok
[41.67%] ··· ========================================================================================== ============
                                                       s3_url                                                       
             ------------------------------------------------------------------------------------------ ------------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   22.1±0.03s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   1.56±0.1s  
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   1.63±0.02s 
             ========================================================================================== ============

[45.83%] ··· time_remote_file_reading.NWBFileReadBenchmark.time_read_hdf5_nwbfile_remfile_with_cache                                                                                                                                                                                                           ok
[45.83%] ··· ========================================================================================== ============
                                                       s3_url                                                       
             ------------------------------------------------------------------------------------------ ------------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   22.3±0.01s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   1.55±0.09s 
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   1.65±0.01s 
             ========================================================================================== ============

[50.00%] ··· time_remote_file_reading.NWBFileReadBenchmark.time_read_hdf5_nwbfile_ros3                                                                                                                                                                                                                         ok
[50.00%] ··· ========================================================================================== ============
                                                       s3_url                                                       
             ------------------------------------------------------------------------------------------ ------------
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   1.18±0.07m 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   1.08±0.3s  
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   1.38±0.2s  
             ========================================================================================== ============

[54.17%] ··· time_remote_file_reading.NWBLindiFileReadRemoteReferenceFileSystemBenchmark.time_read_lindi_jsonrfs                                                                                                                                                                                       1/3 failed
[54.17%] ··· ========================================================================================================= =========
                                                               s3_url                                                           
             --------------------------------------------------------------------------------------------------------- ---------
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d   1.20±0s 
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504    failed 
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841   224±5ms 
             ========================================================================================================= =========
             

[58.33%] ··· time_remote_file_reading.NWBLindiFileReadRemoteReferenceFileSystemBenchmark.time_read_lindi_nwbfile                                                                                                                                                                                       1/3 failed
[58.33%] ··· ========================================================================================================= ============
                                                               s3_url                                                              
             --------------------------------------------------------------------------------------------------------- ------------
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d   4.46±0.01s 
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504     failed   
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841   21.1±0.02s 
             ========================================================================================================= ============
             

[62.50%] ··· time_remote_file_reading.NWBZarrFileReadBenchmark.time_read_zarr_nwbfile                                                                                                                                                                                                                  1/2 failed
[62.50%] ··· ============================================================== ============
                                         s3_url                                         
             -------------------------------------------------------------- ------------
              s3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/     failed   
              s3://dandiarchive/zarr/c8c6b848-fbc6-4f58-85ff-e3f2618ee983/   2.67±0.03s 
             ============================================================== ============
             

[66.67%] ··· time_remote_file_reading.NWBZarrFileReadBenchmark.time_read_zarr_nwbfile_force_no_consolidated                                                                                                                                                                                            1/2 failed
[66.67%] ··· ============================================================== ===========
                                         s3_url                                        
             -------------------------------------------------------------- -----------
              s3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/     failed  
              s3://dandiarchive/zarr/c8c6b848-fbc6-4f58-85ff-e3f2618ee983/   13.9±0.3s 
             ============================================================== ===========
             

[70.83%] ··· time_remote_slicing.FsspecNoCacheContinuousSliceBenchmark.time_slice                                                                                                                                                                                                                              ok
[70.83%] ··· ========================================================================================== ================== =============================================================== ============
                                                       s3_url                                              object_name                               slice_range                                       
             ------------------------------------------------------------------------------------------ ------------------ --------------------------------------------------------------- ------------
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))           3.51±0.01s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))    730±4ms   
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0                       (slice(0, 30000, None),)                     122±0.6μs  
             ========================================================================================== ================== =============================================================== ============

[75.00%] ··· time_remote_slicing.FsspecWithCacheContinuousSliceBenchmark.time_slice                                                                                                                                                                                                                            ok
[75.00%] ··· ========================================================================================== ================== =============================================================== ============
                                                       s3_url                                              object_name                               slice_range                                       
             ------------------------------------------------------------------------------------------ ------------------ --------------------------------------------------------------- ------------
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))           2.33±0.02s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))    212±4ms   
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0                       (slice(0, 30000, None),)                      197±10μs  
             ========================================================================================== ================== =============================================================== ============

[79.17%] ··· time_remote_slicing.LindiFileReadRemoteReferenceFileSystemContinuousSliceBenchmark.time_slice                                                                                                                                                                                            1/27 failed
[79.17%] ··· ========================================================================================================= ================== =============================================================== ===========
                                                               s3_url                                                     object_name                               slice_range                                      
             --------------------------------------------------------------------------------------------------------- ------------------ --------------------------------------------------------------- -----------
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))           22.7±0.1s 
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d   ElectricalSeries                      (slice(0, 30000, None),)                        n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/2f1/4b0/2f14b0a6-067e-4489-81ae-27d6857cdf0d    data_00002_AD0                       (slice(0, 30000, None),)                        n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504   ElectricalSeries                      (slice(0, 30000, None),)                        n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))     failed  
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/813/1b9/8131b99f-004a-4946-8bde-f2895bf42504    data_00002_AD0                       (slice(0, 30000, None),)                        n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841   ElectricalSeries                      (slice(0, 30000, None),)                        n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a    
              https://dandi-api-staging-dandisets.s3.amazonaws.com/blobs/8b1/f9e/8b1f9e4e-c5bb-4c25-acee-3c99327aa841    data_00002_AD0                       (slice(0, 30000, None),)                      224±7ms  
             ========================================================================================================= ================== =============================================================== ===========
             

[83.33%] ··· time_remote_slicing.RemfileNoCacheContinuousSliceBenchmark.time_slice                                                                                                                                                                                                                             ok
[83.33%] ··· ========================================================================================== ================== =============================================================== ============
                                                       s3_url                                              object_name                               slice_range                                       
             ------------------------------------------------------------------------------------------ ------------------ --------------------------------------------------------------- ------------
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))           2.55±0.01s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))    362±20ms  
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0                       (slice(0, 30000, None),)                     21.8±0.2μs 
             ========================================================================================== ================== =============================================================== ============

[87.50%] ··· time_remote_slicing.RemfileWithCacheContinuousSliceBenchmark.time_slice                                                                                                                                                                                                                           ok
[87.50%] ··· ========================================================================================== ================== =============================================================== ============
                                                       s3_url                                              object_name                               slice_range                                       
             ------------------------------------------------------------------------------------------ ------------------ --------------------------------------------------------------- ------------
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))           2.76±0.01s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))    385±10ms  
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries                      (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries                       (slice(0, 30000, None),)                        n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))              n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))      n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0                       (slice(0, 30000, None),)                     22.0±0.2μs 
             ========================================================================================== ================== =============================================================== ============

[91.67%] ··· time_remote_slicing.Ros3ContinuousSliceBenchmark.time_slice                                                                                                                                                                                                                                       ok
[91.67%] ··· ========================================================================================== ================== =============================================================== =============
                                                       s3_url                                              object_name                               slice_range                                        
             ------------------------------------------------------------------------------------------ ------------------ --------------------------------------------------------------- -------------
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))            8.22±0.08s 
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))       n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   ElectricalSeries                      (slice(0, 30000, None),)                         n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))               n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))       n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29   TwoPhotonSeries                       (slice(0, 30000, None),)                         n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))               n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))       n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c49/311/c493119b-4b99-4b14-bc03-65bb28cfbd29    data_00002_AD0                       (slice(0, 30000, None),)                         n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))               n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))       n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   ElectricalSeries                      (slice(0, 30000, None),)                         n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))               n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))   1.31±0.02ms 
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541   TwoPhotonSeries                       (slice(0, 30000, None),)                         n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))               n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))       n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/38c/c24/38cc240b-77c5-418a-9040-a7f582ff6541    data_00002_AD0                       (slice(0, 30000, None),)                         n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries            (slice(0, 30000, None), slice(0, 384, None))               n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))       n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   ElectricalSeries                      (slice(0, 30000, None),)                         n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries             (slice(0, 30000, None), slice(0, 384, None))               n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))       n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a   TwoPhotonSeries                       (slice(0, 30000, None),)                         n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0             (slice(0, 30000, None), slice(0, 384, None))               n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0    (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None))       n/a     
              https://dandiarchive.s3.amazonaws.com/blobs/c98/3a4/c983a4e1-097a-402c-bda8-e6a41cb7e24a    data_00002_AD0                       (slice(0, 30000, None),)                     21.3±0.01μs 
             ========================================================================================== ================== =============================================================== =============

[95.83%] ··· time_remote_slicing.ZarrContinuousSliceBenchmark.time_slice                                                                                                                                                                                                                               1/8 failed
[95.83%] ··· ============================================================== ================= ========================== ===============================================================
             --                                                                                                                      slice_range                                        
             -------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------
                                         s3_url                                object_name     (slice(0, 30000, None),)   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None)) 
             ============================================================== ================= ========================== ===============================================================
              s3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/    data_00002_AD0            failed                                         n/a                              
              s3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/   TwoPhotonSeries             n/a                                           n/a                              
              s3://dandiarchive/zarr/c8c6b848-fbc6-4f58-85ff-e3f2618ee983/    data_00002_AD0             n/a                                           n/a                              
              s3://dandiarchive/zarr/c8c6b848-fbc6-4f58-85ff-e3f2618ee983/   TwoPhotonSeries             n/a                                         152±3ms                            
             ============================================================== ================= ========================== ===============================================================
             For parameters: 's3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/', 'data_00002_AD0', (slice(0, 30000, None),)
             Traceback (most recent call last):
               File "/opt/conda/lib/python3.11/site-packages/asv_runner/server.py", line 179, in _run_server
                 _run(run_args)
               File "/opt/conda/lib/python3.11/site-packages/asv_runner/run.py", line 65, in _run
                 skip = benchmark.do_setup()
                        ^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/asv_runner/benchmarks/time.py", line 80, in do_setup
                 result = Benchmark.do_setup(self)
                          ^^^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/asv_runner/benchmarks/_base.py", line 632, in do_setup
                 setup(*self._current_params)
               File "/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/benchmarks/time_remote_slicing.py", line 210, in setup
                 self.nwbfile, self.io = read_zarr_nwbfile(s3_url=s3_url, mode="r")
                                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
               File "/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/core/_streaming.py", line 264, in read_zarr_nwbfile
                 nwbfile = io.read()
                           ^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                 return func(args[0], **pargs)
                        ^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/backends/io.py", line 60, in read
                 container = self.__manager.construct(f_builder)
                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                 return func(args[0], **pargs)
                        ^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/build/manager.py", line 286, in construct
                 result = self.__type_map.construct(builder, self, None)
                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                 return func(args[0], **pargs)
                        ^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/build/manager.py", line 827, in construct
                 return obj_mapper.construct(builder, build_manager, parent)
                        ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                 return func(args[0], **pargs)
                        ^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1330, in construct
                 subspecs = self.__get_subspec_values(builder, self.spec, manager)
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1259, in __get_subspec_values
                 self.__get_sub_builders(groups, spec.groups, manager, ret)
               File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1310, in __get_sub_builders
                 ret.update(self.__get_subspec_values(sub_builder, subspec, manager))
                            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1259, in __get_subspec_values
                 self.__get_sub_builders(groups, spec.groups, manager, ret)
               File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1288, in __get_sub_builders
                 for parent_dt in manager.namespace_catalog.get_hierarchy(ns, dt):
                                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                 return func(args[0], **pargs)
                        ^^^^^^^^^^^^^^^^^^^^^^
               File "/opt/conda/lib/python3.11/site-packages/hdmf/spec/namespace.py", line 328, in get_hierarchy
                 raise KeyError("'%s' not a namespace" % namespace)
             KeyError: "'ndx-mies' not a namespace"

[100.00%] ··· time_remote_slicing.ZarrForceNoConsolidatedContinuousSliceBenchmark.time_slice                                                                                                                                                                                                            1/8 failed
[100.00%] ··· ============================================================== ================= ========================== ===============================================================
              --                                                                                                                      slice_range                                        
              -------------------------------------------------------------------------------- ------------------------------------------------------------------------------------------
                                          s3_url                                object_name     (slice(0, 30000, None),)   (slice(0, 3, None), slice(0, 796, None), slice(0, 512, None)) 
              ============================================================== ================= ========================== ===============================================================
               s3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/    data_00002_AD0            failed                                         n/a                              
               s3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/   TwoPhotonSeries             n/a                                           n/a                              
               s3://dandiarchive/zarr/c8c6b848-fbc6-4f58-85ff-e3f2618ee983/    data_00002_AD0             n/a                                           n/a                              
               s3://dandiarchive/zarr/c8c6b848-fbc6-4f58-85ff-e3f2618ee983/   TwoPhotonSeries             n/a                                         153±3ms                            
              ============================================================== ================= ========================== ===============================================================
              For parameters: 's3://dandiarchive/zarr/2e8d0cb4-c5d4-4abc-88d8-2581c3cf7f5a/', 'data_00002_AD0', (slice(0, 30000, None),)
              Traceback (most recent call last):
                File "/opt/conda/lib/python3.11/site-packages/asv_runner/server.py", line 179, in _run_server
                  _run(run_args)
                File "/opt/conda/lib/python3.11/site-packages/asv_runner/run.py", line 65, in _run
                  skip = benchmark.do_setup()
                         ^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/asv_runner/benchmarks/time.py", line 80, in do_setup
                  result = Benchmark.do_setup(self)
                           ^^^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/asv_runner/benchmarks/_base.py", line 632, in do_setup
                  setup(*self._current_params)
                File "/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/benchmarks/time_remote_slicing.py", line 229, in setup
                  self.nwbfile, self.io = read_zarr_nwbfile(s3_url=s3_url, mode="r-")
                                          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                File "/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/core/_streaming.py", line 264, in read_zarr_nwbfile
                  nwbfile = io.read()
                            ^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                  return func(args[0], **pargs)
                         ^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/backends/io.py", line 60, in read
                  container = self.__manager.construct(f_builder)
                              ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                  return func(args[0], **pargs)
                         ^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/build/manager.py", line 286, in construct
                  result = self.__type_map.construct(builder, self, None)
                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                  return func(args[0], **pargs)
                         ^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/build/manager.py", line 827, in construct
                  return obj_mapper.construct(builder, build_manager, parent)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                  return func(args[0], **pargs)
                         ^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1330, in construct
                  subspecs = self.__get_subspec_values(builder, self.spec, manager)
                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1259, in __get_subspec_values
                  self.__get_sub_builders(groups, spec.groups, manager, ret)
                File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1310, in __get_sub_builders
                  ret.update(self.__get_subspec_values(sub_builder, subspec, manager))
                             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1259, in __get_subspec_values
                  self.__get_sub_builders(groups, spec.groups, manager, ret)
                File "/opt/conda/lib/python3.11/site-packages/hdmf/build/objectmapper.py", line 1288, in __get_sub_builders
                  for parent_dt in manager.namespace_catalog.get_hierarchy(ns, dt):
                                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/utils.py", line 668, in func_call
                  return func(args[0], **pargs)
                         ^^^^^^^^^^^^^^^^^^^^^^
                File "/opt/conda/lib/python3.11/site-packages/hdmf/spec/namespace.py", line 328, in get_hierarchy
                  raise KeyError("'%s' not a namespace" % namespace)
              KeyError: "'ndx-mies' not a namespace"

/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/setup/_reduce_results.py:69: UserWarning: In intermediate results for test case time_remote_file_reading.NWBLindiFileReadRemoteReferenceFileSystemBenchmark.time_read_lindi_jsonrfs: 
        Length mismatch between flattened joint parameters (3) and result samples (2)!

Please raise an issue and share your intermediate results file.
  warnings.warn(message=message)
/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/setup/_reduce_results.py:69: UserWarning: In intermediate results for test case time_remote_file_reading.NWBLindiFileReadRemoteReferenceFileSystemBenchmark.time_read_lindi_nwbfile: 
        Length mismatch between flattened joint parameters (3) and result samples (2)!

Please raise an issue and share your intermediate results file.
  warnings.warn(message=message)
/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/setup/_reduce_results.py:69: UserWarning: In intermediate results for test case time_remote_file_reading.NWBZarrFileReadBenchmark.time_read_zarr_nwbfile: 
        Length mismatch between flattened joint parameters (2) and result samples (1)!

Please raise an issue and share your intermediate results file.
  warnings.warn(message=message)
/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/setup/_reduce_results.py:69: UserWarning: In intermediate results for test case time_remote_file_reading.NWBZarrFileReadBenchmark.time_read_zarr_nwbfile_force_no_consolidated: 
        Length mismatch between flattened joint parameters (2) and result samples (1)!

Please raise an issue and share your intermediate results file.
  warnings.warn(message=message)
/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/setup/_reduce_results.py:69: UserWarning: In intermediate results for test case time_remote_slicing.LindiFileReadRemoteReferenceFileSystemContinuousSliceBenchmark.time_slice: 
        Length mismatch between flattened joint parameters (3) and result samples (2)!

Please raise an issue and share your intermediate results file.
  warnings.warn(message=message)
/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/setup/_reduce_results.py:69: UserWarning: In intermediate results for test case time_remote_slicing.ZarrContinuousSliceBenchmark.time_slice: 
        Length mismatch between flattened joint parameters (2) and result samples (1)!

Please raise an issue and share your intermediate results file.
  warnings.warn(message=message)
/home/jovyan/nwb_benchmarks/src/nwb_benchmarks/setup/_reduce_results.py:69: UserWarning: In intermediate results for test case time_remote_slicing.ZarrForceNoConsolidatedContinuousSliceBenchmark.time_slice: 
        Length mismatch between flattened joint parameters (2) and result samples (1)!

Please raise an issue and share your intermediate results file.
  warnings.warn(message=message)

@oruebel
Copy link
Contributor Author

oruebel commented Nov 22, 2024

These were just first-light results for DANDIhub. Relevant results are on #78 so this is not needed any more.

@oruebel oruebel closed this Nov 22, 2024
@CodyCBakerPhD CodyCBakerPhD deleted the new_results_from_DANDIHub branch August 15, 2025 13:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@oruebel