Skip to content

Latest commit

 

History

History
11 lines (9 loc) · 1.04 KB

README.md

File metadata and controls

11 lines (9 loc) · 1.04 KB

OSM PBF Data Source for Apache Spark

Build Status Coverage Status

  • A library for parsing and querying OSM PBF data with Apache Spark, for Spark SQL and DataFrames.
  • This package support processing OSM PBF File directly through DataInputStream or distributed through apache spark.
  • This package extends DataSourceV2 to take advantage of fast processing and push down/fliter optimization.
  • This package support reading as type safe Dataset Dataset[OSMInternalRow] to take advantage of spark Dataset optimization.

Version Requirements

Currently support scala 2.11 and spark 2.4.x.