Releases: Kimahriman/hdfs-native
Releases Β· Kimahriman/hdfs-native
v0.10.3
What's Changed
- Release GIL by @Kimahriman in #153
- Fsspec buffered reading by @Kimahriman in #156
- Allow using default fs for fsspec and pass storage options to client by @Kimahriman in #158
Full Changelog: v0.10.2...v0.10.3
v0.10.2
What's Changed
- Support looking up default fs if hostname isn't provided by @Kimahriman in #139
- Add more output to errors by @Kimahriman in #144
- Don't log a warning on a retriable RPCError by @Kimahriman in #143
- Add reprs for py classes by @Kimahriman in #146
- Loosen locking around RPC calls for better multi-threading by @Kimahriman in #148
- Better observer namenode support by @Kimahriman in #149
Full Changelog: v0.10.1...v0.10.2
v0.10.1
What's Changed
- Add support for
dfs.client.failover.resolve-needed
by @Kimahriman in #136 - Add more failover config support by @Kimahriman in #138
Full Changelog: v0.10.0...v0.10.1
v0.10.0
Behavior changes
- Update with config constructor to still read config files first by @Kimahriman in #119
- Dynamically load libgssapi_krb5 at runtime by @Kimahriman in #127
New Features
- Add setTimes support by @Kimahriman in #116
- Add setOwner support by @Kimahriman in #117
- Add setPermission support by @Kimahriman in #122
- Add setReplication support by @Kimahriman in #124
- Add getContentSummary support by @Kimahriman in #125
- Create fsspec file system by @Kimahriman in #120
Other updates
- Bump versions of deprecated actions by @Kimahriman in #121
- Use
whoami
instead ofusers
for better compatibility by @Kimahriman in #128 - Python API improvements adding default values to some arguments by @Kimahriman in #132
Full Changelog: v0.9.4...v0.10.0
v0.9.4
What's Changed
- Fix initializing logging in Python by @Kimahriman in #110
- Change replicated reader to eagerly cleanup the DataNode connection by @Kimahriman in #111
Full Changelog: v0.9.3...v0.9.4
v0.9.3
What's Changed
- Bump integration tests to use Hadoop 3.4.0 by @Kimahriman in #98
- Fix new clippy lint by @Kimahriman in #99
- Offload reading packets to separate task by @Kimahriman in #104
- Move object store implementation to its own repo @Kimahriman in #105
- Stream erasure coded reads by cell by @Kimahriman in #107
Full Changelog: v0.9.2...v0.9.3
v0.9.2
Bug fixes
- Added
typing-extensions
as a dependency to the Python library - Fixed certain positioned reads for erasure coded files
Full Changelog: v0.9.1...v0.9.2
v0.9.1
Key Features
- Token-based SASL sessions now support all protection types (authentication, integrity, and privacy)
- Added encrypted data transfer support, including SASL based encryption and AES stream cipher based encryption
What's Changed
- Custom digest-md5 implementation by @Kimahriman in #84
- Add integrity support to token sasl by @Kimahriman in #88
- Add encryption support to token SASL by @Kimahriman in #90
- Support SASL based data transfer encryption by @Kimahriman in #92
- feat: Configure optional
kerberos
feature for Python package by @yjshen in #91 - Consolidate Python deps with workspace and update CI to deploy Kerberos feature by @Kimahriman in #93
- Fix erasure coded reads when a block is missing by @Kimahriman in #86
- Add support for encrypting data transfers with AES by @Kimahriman in #94
- Support forced data transfer protection by @Kimahriman in #95
New Contributors
Full Changelog: v0.8.0...v0.9.1
v0.8.0
Key Features
- Up to a 5x read and write throughput increase by using a faster CRC implementation
- DataNode SASL negotiation support (authentication only)
What's Changed
- Add simple benchmarks by @Kimahriman in #75
- Add simple example by @Kimahriman in #77
- Use faster CRC implementation by @Kimahriman in #78
- Support DataNode connection reuse by @Kimahriman in #80
- Add support for datanode sasl negotation by @Kimahriman in #81
Full Changelog: v0.7.0...v0.8.0
v0.7.0
What's Changed
- chore: use hashmap to transfer config in create_with_config method by @zuston in #66
- Improved write resiliency through datanode heartbeating (#68) and lease renewal (#72) by @Kimahriman
- Bump objectstore to 0.9 by @Kimahriman in #73
- deps: Bump prost to 0.12 by @Xuanwo in #71
Full Changelog: v0.6.0...v0.7.0