Skip to content

v0.0.26 - Better RDDs, EDN Support and Data-Oriented Schemas

Pre-release
Pre-release
Compare
Choose a tag to compare
@anthony-khong anthony-khong released this 09 Sep 01:55
· 124 commits to develop since this release
v0.0.26
59c16f2
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.
  • Schema option for read functions: all read functions now support a :schema option, which can be an actual Spark schema or its data-oriented version.
  • Basic support for EDN: read-edn! and write-edn! are now available with an added dependency of metosin/jsonista. The functions may not be performant, but can come in handy for small-data compositions.
  • More RDD functions: this closes the RDD function gaps to sparkplug and adds variadicity to functions that take in more than one RDDs.
  • RDD name unmangling: this follows sparkplug model of unmangling RDD names after each transformation.
  • Version bump for dependencies: nrepl bumped to 0.8.1.
Assets 3
Loading