Skip to content

paulsonvinsent/datos

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

12 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Datos

Data movement simplified

Motivation

In modern enterprise application its quite common for many sub systems like realtime-system, batch-system, anomaly-detection-system, auditing-system etc to process the input in parallel from a common source. This is a problem space in self when dimensions like processing atomicity, transactions and no single point of failure becomes priority. datos addresses this problem by decoupling input source system from the subsystems and there by provides in-memory data translations and data compression. This advancement will make the subsystems efficient and support realtime event handling practical.

Get started

  1. Clone this repository.

  2. Configure this file Workers.json
    Notes: * Path follows common-vfs naming pattern
    * Supported compression formats are GZIP,BZIP2,ZIP,XZ,DEFLATE and PACK200.

  3. Run assembly script.

  4. Start Datos with datos script.