Skip to content

6.1.0: Pandas 2 support

Compare
Choose a tag to compare
@tkilias tkilias released this 25 Jul 20:04
· 102 commits to master since this release
62dc950

Summary

This releases adds support for Pandas 2 pyarrow dtype columns for emitting dataframes from Python UDFs. Furthermore, it fixes a silent data corruption when emitting dateframes with float16 dtype columns from Python UDFs.

Note: We could not update scipy in the standard 7.* flavors such that these still contain CVE-2023-29824, because the fixed scipy version is not available for Python 3.7 which is still used in these flavors. We are going to replace Python 3.7 with Python 3.8 in the next release and than also update scipy. See also following GitHub issue.

Note: We also needed to remove numba-scipy from the standard 8.0.0 flavor, because it blocked the security update for scipy.

Package Version Comparison between Release 6.0.0 and 6.1.0

Script-Language-Container-Tool (Exaslct)

This release uses version 0.17.0 of the container tool.

Bug Fixes

  • #792: Fixed Github workflow publish-test-container by updating script-languages-container-tool to 0.17.0 and script-languages-container-ci to 1.1.0
  • #796: Fixed silent data corruption when emitting dataframes with float16 dtype columns from Python UDFs
  • #819: Fixed CI, adapted project to Exasol 8 and updated apt packages

Features / Enhancements

  • #793: Added support for Pandas 2 pyarrow dtype columns for emitting data from Python UDFs

Documentation

n/a

Refactoring

n/a

Security

  • #785: Updated Ubuntu packages
  • #789: Updated Ubuntu packages
  • #777: Updated redis-py to fix CVE-2023-28859
  • #800: Updated Ubuntu packages
  • #803: Updated Ubuntu packages
  • #815: Updated Ubuntu packages and poetry.lock
  • #822: Updated scipy to 1.10.1 in standard 8.0.0 flavor to fix CVE-2023-29824. For this we had to remove scipy-numba. Updated apt packages.