Skip to content

Releases: ParaGroup/WindFlow

WindFlow version 2.8.2

15 Apr 15:06
Compare
Choose a tag to compare

New release with the following features:
-enabled the generation of the PipeGraph structure with nice diagrams based on the Graphviz library (cgraphs). This can be enabled by compiling with the macro -DGRAPHVIZ_WINDFLOW, which adds a dependency with the cgraphs and gvc libraries;
-statistics enabled with the macro TRACE_WINDFLOW are now more accurate and can be read during the execution of the PipeGraph (in addition to dump log files at the end of the processing);
-PipeGraph execution can now be started asynchronously with the start() and wait_end() methods;
-for windowed GPU operators, it is now possible to specify the device (before it was the default one only).

WindFlow version 2.8.0

18 Mar 13:32
841614a
Compare
Choose a tag to compare

New release with the following features in addition to minor bug fixing:
-the Filter operator has been extended with a new set of function signatures admitted;
-the Win_Seq_GPU node has been modified to overlap the processing of a batch on the GPU with the buffering on the next batch;
-added two new operators (Key_FFAT and Key_FFAT_GPU) processing windows using the FlatFAT aggregator. On GPU, the FlatFAT has been modified in order to process efficiently all the windows within the same batch of inputs.

WindFlow version 2.6.0

23 Jan 17:45
Compare
Choose a tag to compare

New release with the following features:
-Added support to time-based windowed operators in DEFAULT processing mode (i.e. out-of-order processing of data streams). When a window has been triggered and its result produced, no futher tuple within the window boundaries can be received and processed (i.e. late tuples are dropped);
-To reduce the impact of dropped tuples at the previous point, time-based windows can be created with an additional lateness parameter (in addition to the conventional window length and slide) to delay the firing of the window and the finalization of its result (this reduces the number of dropped tuples at the expense of higher latency).

WindFlow version 2.4.4

29 Dec 18:08
Compare
Choose a tag to compare

Release providing minor improvements enhancing version 2.4.2. In particular:
-added new runtime checks to avoid adding/chaining more than one time the same instance of an operator;
-all the operators are made not copyable and not movable.

WindFlow version 2.4.2

21 Dec 16:21
Compare
Choose a tag to compare

New release with minor modifications. Introduced two compilation macros to enable tracing of operators at the WindFlow and FastFlow levels. Respectively, the macros are TRACE_WINDFLOW and TRACE_FASTFLOW. Proper logging files will be written. Warning: tracing has a substantial impact on performance.

WindFlow version 2.4.0

15 Dec 11:21
Compare
Choose a tag to compare

Major changes to the library. Introduced two processing modes of the PipeGraph (streaming environment):
-DEFAULT mode: each replica of the operators can receive input disordered (not ordered by their timestamps). This mode does not have the overhead of ordering the streams in case of shuffle connections. In the present release, windowed operators (Keyed Farm, Windowed Farm, Paned Farm and Windowed Map-Reduce) and their GPU variants cannot be used (they cannot be added to any MultiPipe);
-DETERMINISTIC mode: input streams are always ordered by timestamp at every shuffle connection. Each replica of any operator receives inputs ordered by timestamp. In this mode all the windowed operators and their GPU variants can be regularly added to MultiPipes.
This modification allows avoiding the overhead of reordering the stream for applications that do not need this.

WindFlow version 2.2.0

07 Dec 08:26
Compare
Choose a tag to compare

New release with additional features and bug fixing. More specifically:
-extended the set of graphs (topologies) that WindFlow can represent. Merge of MultiPipes MPs={MP1, ..., MPn} is now possible in three cases: i) MPs are all the leaves of some independent trees; ii) MPs are all the leaves of a sub-tree; iii) MPs are all the leaves of m>1 sub-trees of the same tree (i.e. at the same level). See the examples in /src for a clearer understanding;
-fixed an important bug in the keyed distribution to operator's replicas after a splitting;
-added a warning if the Source is instantiated with a function compliant with the single-loop signature (deprecated).

WindFlow version 2.0.0

29 Nov 23:13
Compare
Choose a tag to compare

New release of the library including several modifications:
-the merge operation on MultiPipes is made homogeneous by removing the distinction between merge() and self-merge();
-added further support to the merge of MultiPipes to extend the topologies modeled by the library;
-added a dynamic "type checking" to make add/chain of operators and merge/split of MultiPipes type safe.

WindFlow version 1.8.0

04 Nov 06:29
71d650e
Compare
Choose a tag to compare

Added the self-merge of an already splitted MultiPipe instance. This operation creates a new MultiPipe receiving the merge of the output streams of all the branches of a splitted MultiPipe. This allows creating more complex acyclic graphs (though not still completely generic).

WindFlow version 1.6.0

23 Oct 06:45
a8f5a5c
Compare
Choose a tag to compare

Added the PipeGraph environment to get MultiPipe instances that can be splitted and merged (nor arbitrarily yet, merge of splitted MultiPipe instances is not allowed). The web page now reflects the new API provided starting from this release.