Skip to content

v0.6.0 (Spark 3.1) - 2021-03-05

Compare
Choose a tag to compare
@EnricoMi EnricoMi released this 14 Jul 10:32
· 79 commits to spark-3.3 since this release

Added

  • Adds support to read string predicates with language tags like <http://www.w3.org/2000/01/rdf-schema#label@en> (issue #63).
    This works with any source and mode except the node source in wide mode. Note that reading into GraphFrames is based on the wide mode, so only the untagged language strings can be read there. Filter pushdown is not supported for multi-language predicates yet (issue #68).
  • Adds readable exception and suggests next steps when GRPC fails with RESOURCE_EXHAUSTED code.
  • Missing maxLeaseId in cluster state response defaults to 1000L to avoid an exception.

Changed

  • Improves predicate partitioning on projection pushdown as it creates full partitions.
  • Fixes bug that did not push predicate value filter correctly down to Dgraph causing incorrect results (issue #82)
  • Fixes bug in reading geo and password data types.
  • Tests against Dgraph 20.03, 20.07 and 20.11.
  • Moved Java Dgraph client to 20.11.0.
  • Upgraded all dependencies to latest versions.