-
Notifications
You must be signed in to change notification settings - Fork 1
Home
The purpose of this solution is to build and execute Data Pipelines. Nothing new under the sun of course, however it aims to make this task very easy and by just using some configuration to build those data pipelines. in other words by using pipelite you can create quite powerful data intergation stuff without typing any lines of code !
pipelite is a Data Pipeline solution by design !
The way this solution is built is also totally extensible and enables all developers to extend its capabilities by addin new Data connectors and/or data pipelite.transformers.
π Currently this solution provides data access and load from these data sources :
π External file (csv)
π External Excel Spreadsheet (xls, xlsx, xlsm, xlsb, odf, ods and odt) (read only)
π External XES File (read only)
π€ ODBC Data Sources (checked with SQL Server, SQLite) by using an configurable SQL query (Read Only)
π’ SAP Read Table via SAP RFC (Read Only)
π’ ABBYY Timeline PI(write only in Repository)
π And provides those transformers
π Pass Through (Ex. just to change the Data Sources names IN-OUT)
πΆ Dataset Profiling
π Concat 2 Data sources
π SubString
π Column Transformation
π Join data sources
π€ Rename Column Name
This is the beggining and pipelite is designed to be extensible ... So if you have in mind some new good stuff in mind you'd like to add, just join the community ;-)
π Home
π Main concepts
π» Installation
π¨ Configuration
π Running
Supported Data Sources
π CSV File
π XES File
π Excel File
π€ ODBC
π’ SAP
π’ ABBYY Timeline
Supported Transformations
π Pass Through
πΆ Dataset Profiling
π Concat 2 Data sources
π SubString
π Column Transformation
π Join data sources
π Lookup
π€ Rename Column Name
Extending pipelite
β
how to
β
Adding new Data sources
β
Adding new Transformers
β
Adding new Pipelines