Elly is a Hadoop HDFS and Yarn client. It provides:
- A familiar Julia
ClusterManager
interface, making it possible to use the familiar Julia parallel constructs on any Hadoop/Yarn cluster:addprocs
,@parallel
,spawn
,pmap
, etc. - Lower level APIs to write native Yarn applications.
- A familiar Julia IO API for accessing HDFS files. It is a pure Julia
implementation with no dependencies on
libhdfs
.
- Since Elly uses the newer Protobuf interface, it requires a Hadoop 2.2+ distribution.