v0.0.0.9003
Pre-release
Key features added in this release
Meta-pipelines
Meta-pipelines can now be defined. The meta-pipeline construct is one which allows users to export pipelines they have created for a particular use case to a general analysis flow which can be used for a different dataset and different set of parameters. A pipeline is one where the data can change, though retaining the same schema, and the same set of parameters for the functions. A meta-pipeline is one where only the analysis flow, function dependencies and so on are retained. The specific parameters for each of the functions can be set differently for a new use case.
The objective of a meta-pipeline is to define and execute reusable analysis flows. They can be used to:
- Document best practices for a particular problem
- Templatize analyses for particular situations
Meta-pipelines can be created by exporting from pipelines, and new pipelines instantiated from a meta-pipeline, with an easy-to-use method to set the new values of parameters.
This means that our foundation bricks can be represented as meta-pipelines.
One more vignette on meta-pipelines has been added to the package, to explain its usage. The rendered version can be viewed here.
Function registration and execution improvements
- Some issues with respect to function registration have been fixed.
- Parsing for formula semantics has been improved