v0.6.0 (Spark 3.0) - 2021-03-05
EnricoMi
released this
14 Jul 10:31
·
82 commits
to spark-3.3
since this release
Added
- Adds support to read string predicates with language tags like
<http://www.w3.org/2000/01/rdf-schema#label@en>
(issue #63).
This works with any source and mode except the node source in wide mode. Note that reading into GraphFrames is based on the wide mode, so only the untagged language strings can be read there. Filter pushdown is not supported for multi-language predicates yet (issue #68). - Adds readable exception and suggests next steps when GRPC fails with
RESOURCE_EXHAUSTED
code. - Missing
maxLeaseId
in cluster state response defaults to1000L
to avoid an exception.
Changed
- Improves predicate partitioning on projection pushdown as it creates full partitions.
- Fixes bug that did not push predicate value filter correctly down to Dgraph causing incorrect results (issue #82)
- Fixes bug in reading
geo
andpassword
data types. - Tests against Dgraph 20.03, 20.07 and 20.11.
- Moved Java Dgraph client to 20.11.0.
- Upgraded all dependencies to latest versions.