Skip to content

deltatocumulative: Number of buckets in exponential histograms should be capped #33277

Closed
@euroelessar

Description

@euroelessar

Component(s)

processor/deltatocumulative

What happened?

Description

Currently size of an individual histogram is unbounded and can grow until OOM is reached.
This is prominent if an application has large distribution of data overall but only relatively small in an individual delta datapoint. In this case cumulative aggregation keeps the scale but keeps growing number of buckets to fit all the data.

Steps to Reproduce

Send two histogram datapoints with the same scale but drastically different offsets.

Expected Result

Cumulative exponential histogram is downscaled to keep around ≈160 buckets.

Actual Result

Exponential histogram grows number of buckets instead, leading to OOM.

Collector version

v0.101.0

Environment information

Environment

OS: Linux
Compiler(if manually compiled): go 1.22.2

OpenTelemetry Collector configuration

No response

Log output

No response

Additional context

No response

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions