Release Notes v2022.11.10

Release Notes 2022-11-10

In Memoriam

Mike Merrill (@mhmerrill), one of the co-founders of Arkouda, recently passed away. Without his leadership and contributions, the project would not exist. It's hard to overstate Mike's impact. He was a great person and will be dearly missed. Our deepest condolences to his family.

Major updates:

• Issues #487, #1558, #1559, #1846, #1877, #1887 and PR #1879 - Rework HDF5 structure and schema, enable writing to a single file, and add documentation of schema
  • NOTE: Files written with tag v2022.10.13 or earlier need to be read with the legacyHDF5 flag set and re-written with the new format
• Issue #1891 - Fixes bug in IDNA decode
• Issues #1776, #1847, #1852, and #1867 - Optimize GroupBy on small strings

Minor fixes:

• PR #1858 and Issue #1859 - Switches to C++17 for Arrow compilation and updates Arrow version to 9.0.0
• Issue #1801 - Reorganizes structure of the symbol table
• Issue #1779 - Adds documentation for creating a new symbol table entry
• Issues #1839 and #1889 - Update MessageArgs parameter for CommandMap functions
• Issue #1837 - Resolves intermittent failures in GroupBy prod aggregate test
• Issue #1868 - Adds name property to AbstractSymEntry
• Issue #1854 - Takes advantage of set and generator comprehensions in client code
• Issue #1842 - Updates COMPARISON.md

---

Auto-generated release notes

• Closes #1836 - Removing gasnet from CI by @Ethan-DeBandi99 in #1841
• Closes #1839 - generic_msg Parameter Update by @Ethan-DeBandi99 in #1840
• Closes #1837: Intermittent failures in groupby prod aggregate test by @pierce314159 in #1838
• Closes #1842: Update COMPARISON.md by @jaketrookman in #1843
• Closes #1847: Small String GroupBy benchmark by @pierce314159 in #1848
• Closes #1852: Add small string groupby perf to run_benchmarks by @pierce314159 in #1853
• Closes #1854 - Take advantage of set and generator comprehensions in client code by @sotiriskaragiannis in #1856
• Switch to C++17 for Arrow compilation by @bmcdonald3 in #1858
• Closes #1859- Updating Arrow version to 9.0.0 by @Ethan-DeBandi99 in #1860
• Closes #1801 - Reorganizes Symbol Table by @Ethan-DeBandi99 in #1861
• Closes #1776: GroupBy Strings Optimization by @pierce314159 in #1851
• Closes #1857 - Remove OPTIONAL_CHECKS by @Ethan-DeBandi99 in #1863
• Closes #1865 - Remove unused return value in MultiTypeSymbolTable by @jeremiah-corrado in #1866
• Part of #1867: String GroupBy optimizations are timing out nightly tests by @pierce314159 in #1869
• Closes #1559, #1558, & #487 - HDF5 Upgrades by @Ethan-DeBandi99 in #1845
• Closes #1868 - AbstractSymEntry Name Property by @Ethan-DeBandi99 in #1870
• Closes #1846 - HDF5 Documentation by @Ethan-DeBandi99 in #1849
• Part of #1404: Add 10/03/22 sort scalability graphs from SGI 8600 by @ronawho in #1872
• Closes #1877 - HDF5 Updates Fail Nightly by @Ethan-DeBandi99 in #1878
• Temporarily drop python 3.11 testing from CI by @ronawho in #1883
• Add missing localize call to dsetname by @bmcdonald3 in #1879
• Closes #1779 - New Symbol Table Entry Generation Documentation by @Ethan-DeBandi99 in #1874
• Swap order of zippered for-loops in which an unbounded range was the leader by @bradcray in #1880
• Closes #1885 - Updating mypy to use >=0.931,<0.990 by @joshmarshall1 in #1886
• Closes #1887 - HDF5 Empty String Set Write by @Ethan-DeBandi99 in #1888
• Closes #1891 - IDNA Bug by @Ethan-DeBandi99 in #1892
• Closes #1889 - MessageArgs Parameter for CommandMap Functions by @Ethan-DeBandi99 in #1890

New Contributors

• @jaketrookman made their first contribution in #1843
• @sotiriskaragiannis made their first contribution in #1856
• @jeremiah-corrado made their first contribution in #1866

Full Changelog: v2022.10.13...v2022.11.10