v0.11.0

New features

• CNCF OpenTelemetry source, sink and cncf::otel tremor-script library adds log, trace, metrics OpenTelemetry support
• Fixes module path function resolution for tremor-cli doc tool to use unified path resolution
• Removed the vsn.sh script which checks if the lockfile is up to date and replaces it with the --locked flag #798
• Allow using '_' as seperators in numeric literals #645
• Refactor kafka metadata variables to be under a single record $kafka.
• Add support for Kafka message headers, available through the $kafka.headers metadata variable.
• Add the cb offramp for testing upstream circuit breaker behaviour #779
• Add the kafka onramp config retry_failed_events to acoid retrying failed events, and polling_interval to control how often kafka is polled for new messages if none were available previously #779
• Add kv connector with the supported operations put, get, delete, scan, cas.
• Add discord badge to README.md.
• Handle signals and terminate properly on Ctrl+C in docker #806
• Update to rust 1.50.0
• Emit error events to the err port on exceeding concurrent requests limit for rest and elastic offramps.
• Add the max_groups and emit_empty_windows settings on window definitions #828
• Restrict event and event metadata references in the SELECT clause of a windowed select statement #828
• Improve default visibility of tremor info logs from packages #850
• Include the request info of a response for a linked rest offramp, available through the $response.request metadata variable.
• Emit warnings when a window with emit_empty_windows without guards is used.
• Extend match to handle top-level ~ extractors in match #834
• Extend match to allow more assign expressions (i.e. case a = ~ glob|snot*| => or case v = _ =>)
• Match pipeline improvements: tree search for ==, grouping based on shared keys, re-ordering of exclusive case statements
• Optimize glob matches of the form glob|snot*| or glob|*badger| to cheaper prefix and suffix checks
• Remove warnings for match w/o default if a _ case or a v = _ case exists
• Add --exprs-only to dbg ast to not show metadata
• Add Delete and Update to ES sink #822
• Add more metadata to Kafka source #874
• Update to simd-json 0.4
• Add tests covering basic operations and string interpolation for tremor-script#721
• Add offramp and onramp for NATS.io.
• Add a stdin onramp.
• Add tests covering arrays and records for tremor-script#721
• Support for non caching UDP sink #900

Fixes

• Fix kafka onramp hanging with no message in the queue, leading to delayed offset commits #779
• Fail the kafka onramp if any of the configured topics could not be subscribed to #779
• Tremor no longer requires a home dir for operations that do not need a config #782
• Add performance section to PR template.
• Fix markdown for discord link.
• Fix lalrpop builds when extra folders exist.
• Refactor operator metrics collection to eliminate clones in most cases.
• Fix systemd spec file to load tremor files in /etc/tremor/config #784
• Do not crash when we can not execute a config file #792
• Sort the artefacts while running the benchmarks so that the benchmark run is more deterministic #825
• Remove the bench_pipe_passthrough_csv benchmark #825
• Fix a bug in the test bench command that was giving false negatives when the benchmarks were failing #816
• Fix time based windows to not emit empty windows anymore and to not error if they contain event references #828
• Do not commit an empty topic-partition-list in the kafka onramp and improve logging for better debugging
• Fix kafka consumer offset lag of at least 1 continually by using offset + 1 when committing.
• Fix issue where binary not (!) was not getting lexed correctly #833
• Fix missing ack/fail insight events with offramps that dont support guaranteed delivery (e.g. udp, stdout) #870
• Fix wrong error message for misconfigured UDP sinks