feat(new transform): #24655 Add a transformer to translate absolute to incremental metrics.

[johannesfloriangeiger]

Summary

See title, add a transformer that can translate absolute to incremental metrics, the counterpart to the existing "Incremental to Absolute" Transformer.

This addresses the second observed issue in #24655 where the AWS CloudWatch Metric Sink will not properly rotate buffer files when processing absolute counter metrics. My working theory is that because the sink will translate absolute counters to incremental counters the event that gets sent to CloudWatch eventually differs from the event that the sink receives - and thus, the buffer is never rotated because the original metric is never acknowledged. Ideally, the AWS CloudWatch Metric Sink would not buffer incoming metrics until after they are pre-processed (i.e., filter out all unsupported metrics and translate all absolute counters into incremental ones) but I assume that's a bigger piece of Vector architecture change? So, this transformer acts as a workaround as it allows users to pre-process absolute metrics before they reach the sink and thus letting the buffer rotate again properly as the event that gets sent is the same as the sink receives.

Vector configuration

data_dir = "."

[sources.static_metrics]
type = "static_metrics"
metrics = [
    { name = "test_metric_0", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_1", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_2", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_3", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_4", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_5", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_6", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_7", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_8", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_9", kind = "absolute", tags = { }, value.gauge.value = 42 },
    { name = "test_metric_10", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_11", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_12", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_13", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_14", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_15", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_16", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_17", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_18", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_19", kind = "absolute", tags = { }, value.counter.value = 42 },
    { name = "test_metric_20", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_21", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_22", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_23", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_24", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_25", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_26", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_27", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_28", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_29", kind = "incremental", tags = { }, value.counter.value = 42 },
    { name = "test_metric_30", kind = "absolute", tags = { }, value.aggregated_histogram.buckets = [{ le = 10, count = 1, upper_limit = 42.0 }], value.aggregated_histogram.count = 42, value.aggregated_histogram.sum = 42 },
]

[transforms.absolute_counter_metrics_filter]
inputs = ["static_metrics"]
type = "filter"
condition = '.type == "counter" && .kind == "absolute"'

[transforms.absolute_counter_to_incremental]
type = "absolute_to_incremental"
inputs = ["absolute_counter_metrics_filter"]

[transforms.other_metrics_filter]
inputs = ["static_metrics"]
type = "filter"
condition = '.type == "gauge" || (.type == "counter" && .kind == "incremental")'

[sinks.aws_cloudwatch_metrics]
type = "aws_cloudwatch_metrics"
inputs = ["absolute_counter_to_incremental", "other_metrics_filter"]
default_namespace = "default"
healthcheck.enabled = true
buffer.type = "disk"
buffer.max_size = 2097184

How did you test this PR?

Manually, see above configuration and observe that the buffer files rotate correctly.

Change Type

• Bug fix
• New feature
• Dependencies
• Non-functional (chore, refactoring, docs)
• Performance

Is this a breaking change?

• Yes
• No

Does this PR include user facing changes?

• Yes. Please add a changelog fragment based on our guidelines.
• No. A maintainer will apply the no-changelog label to this PR.

References

• Closes: AWS CloudWatch metric sink not cleaning up buffer files consistently #24655

Notes

• Please read our Vector contributor resources.
• Do not hesitate to use @vectordotdev/vector to reach out to us regarding this PR.
• Some CI checks run only after we manually approve them.
  • We recommend adding a pre-push hook, please see this template.
  • Alternatively, we recommend running the following locally before pushing to the remote branch:
    • make fmt
    • make check-clippy (if there are failures it's possible some of them can be fixed with make clippy-fix)
    • make test
• After a review is requested, please avoid force pushes to help us review incrementally.
  • Feel free to push as many commits as you want. They will be squashed into one before merging.
  • For example, you can run git merge origin master and git push.
• If this PR introduces changes Vector dependencies (modifies Cargo.lock), please
  run make build-licenses to regenerate the license inventory and commit the changes (if any). More details here.