Releases: epoch8/datapipe
Releases · epoch8/datapipe
v0.14.7-alpha.2
- Relax version requirement for rich dependency by @elephantum in #367
v0.14.7-alpha.1
- Make CLI accept multiple
--namevalues
v0.15.0-alpha.4
- Deprecate Python 3.9
v0.15.0-alpha.3
InputSpec and key mapping
See key-mapping.md for motivation
- Renamed
JoinSpectoInputSpec - Added
keysparameter toInputSpecandComputeInputto support joining tables with different key names - Added
DataFieldaccessor forInputSpec.keys
v0.15.0-alpha.2
- Introduced
MetaPlane/TableMeta/TransformMetainterfaces to decouple
metadata management from the compute plane - Added SQL reference implementation (
SQLMetaPlane,SQLTableMeta,
SQLTransformMeta) and rewiredDataStore,DataTable, and batch transform
steps to consume the new meta plane API - Added meta-plane design doc and removed legacy
MetaTableplumbing in lints,
migrations, and tests - Make CLI accept multiple
--namevalues
v0.14.6
- Allow
DataTableobjects directly inComputeStep.input_dtsparameter (auto-wraps inComputeInput) - Add backward compatibility for DataTable API in BatchTransformStep
- Add optional
force_vectors_to_ramparameter toQdrantStore - Moved calculating checksum from MetaTable to TableStore
- Added PandasParquetFile adapter for TableStoreFiledir to store pandas DataFrames in parquet
- Added hash_row for BytesFile and PILFile
- Added use_adapter_hash parameter in TableStoreFiledir for backward compatibility
- Support for Python 3.13 and Python 3.14
- Support for Numpy 2.0
- Removed dependency on
iteration-utilities
v0.14.5
- Fix for getting existing idx of empy meta-table
- Add
keep_existing=TruetoTransformMetaTableto prevent table metadata conflicts (temporary fix) - Enhance
RedisStorewith multi-node cluster support and password authentication
v0.14.4
- Relax SQLAlchemy requirement to allow 1.4.x support
v0.14.3
- New table store:
datapipe.store.neo4j.Neo4JStorefor graph databases
v0.14.2
New stuff:
- New table store:
datapipe.store.elastic.ElasticStore
Internal changes:
- Convert dependency management to UV
- Fix
datapipe.types.OrmTabletype - Add
TableStore.capsto introspect what features does specific table store supports - Implement abstract test suite for TableStore:
datapipe.store.tests.abstract.AbstractBaseStoreTests - Refactor
test_table_storeto useAbstractBaseStoreTests