python-v0.14.0
wjones127
released this
05 Dec 17:32
·
593 commits
to main
since this release
New features
- feat: adopt kernel schemas and improve protocol support by @roeap in #1756
- feat: drop python 3.7 and adopt 3.12 by @roeap in #1859
- feat: expose cleanup_metadata in Python by @r3stl355 in #1826
- feat: handle protocol compatibility by @roeap in #1807
- feat(python): expose
convert_to_deltalake
by @ion-elgreco in #1842 - feat(python): add pyarrow to delta compatible schema conversion in writer/merge by @ion-elgreco in #1820
- feat(python): expose create to DeltaTable class by @ion-elgreco in #1932
- feat(python): expose rust writer as additional engine v2 by @ion-elgreco in #1891
- feat: extend write_deltalake to accept Deltalake schema by @r3stl355 in #1922
Bug Fixes
- fix: prevent writing checkpoints with a version that does not exist in table state by @rtyler in #1863
- fix: checkpoint error with Azure Synapse by @PierreDubrulle in #1848
- fix: improve catalog failure error message, add missing Glue native-tls feature dependency by @r3stl355 in #1883
- fix: use physical name for column name lookup in partitions by @aersam in #1836
- fix(rust/python):
optimize.compact
not working with tables with mixed large/normal arrow by @ion-elgreco in #1926 - fix: support os.PathLike for table references by @bolkedebruin in #1809
- fix: add buffer flushing to filesystem writes by @r3stl355 in #1911
- fix: fail fast for opening non-existent path by @dimonchik-suvorov in #1917
- fix: compare timestamp partition values as timestamps instead of strings by @sigorbor in #1895
- fix: add high-level checking for append-only tables by @junjunjd in #1887
- fix: prune each merge bin with only 1 file by @haruband in #1902
- fix: get rid of panic in during table by @dimonchik-suvorov in #1928
Other Changes
- docs: add release action by @r3stl355 in #1801
- chore: upgrade to the latest dynamodb-lock crate by @rtyler in #1816
- refactor: default logstore implementation by @dispanser in #1742
- ci: adopt
ruff format
for formatting by @roeap in #1841 - chore: upgrade datafusion 33 by @Blajda in #1775
- docs: add docs on small file compaction with optimize by @MrPowers in #1850
- refactor: express log schema in delta types by @roeap in #1876
- refactor: merge to use logical plans by @Blajda in #1720
- chore: create benchmarks for merge by @Blajda in #1857
- docs: on append, overwrite, delete and z-ordering by @MrPowers in #1897
- docs: update python docs link in readme.md by @thomasfrederikhoeck in #1899
- docs: update docs home page and add pandas integration by @MrPowers in #1905
- ci: run doctest in CI for Python API examples by @marijncv in #1840
- docs: delta lake arrow integration page by @MrPowers in #1914
- docs: fix all examples and change overall structure by @ion-elgreco in #1931
- refactor: simplify
DeltaTableState
by @roeap in #1877 - docs: add logo, dark mode, boost search by @ion-elgreco in #1936
- refactor: prefer usage of metadata and protocol fields by @roeap in #1935
New Contributors
- @PierreDubrulle made their first contribution in #1848
- @thomasfrederikhoeck made their first contribution in #1899
- @dimonchik-suvorov made their first contribution in #1917
- @sigorbor made their first contribution in #1895
- @bolkedebruin made their first contribution in #1809
Full Changelog: python-v0.13.0...python-v0.14.0