Skip to content

Conversation

@sandeshkr419
Copy link
Member

Description

The hll field type stores pre-aggregated cardinality data using HyperLogLog++ (HLL++) sketch data structures. This field type is designed for internal use by OpenSearch and its plugins (such as the ISM plugin for multi-tier rollup operations) to enable efficient cardinality aggregation on rolled-up data.

Key Features

  • Efficient Storage: Stores approximate cardinality estimates in compact binary format sketches
  • Merge Support: Supports merging multiple HLL++ sketches during aggregation
  • Configurable Precision: Allows tuning the accuracy-memory tradeoff via precision parameter
  • Rollup Integration: Designed for use with ISM plugin rollup operations

Parameters

  • precision (optional): Integer between 4 and 18 (consistent with OpenSearch) that controls the accuracy-memory tradeoff
    • Default: 12 (keeping consistent with OpenSearch Cardinality Aggregation)
    • Higher precision = better accuracy but more memory

Related Issues

Resolves #[Issue number to be closed when this PR is merged]

Check List

  • Functionality includes testing.
  • API changes companion pull request created, if applicable.
  • Public documentation issue/PR created, if applicable.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.
For more information on following Developer Certificate of Origin and signing off your commits, please check here.

Signed-off-by: Sandesh Kumar <sandeshkr419@gmail.com>
@coderabbitai
Copy link

coderabbitai bot commented Nov 30, 2025

Important

Review skipped

Draft detected.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

✨ Finishing touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment

Comment @coderabbitai help to get the list of available commands and usage tips.

@sandeshkr419 sandeshkr419 changed the title hll changes for cardinality rollup HLL field Mapper for Cardinality Rollups Nov 30, 2025
@github-actions
Copy link
Contributor

❌ Gradle check result for 97b7392: FAILURE

Please examine the workflow log, locate, and copy-paste the failure(s) below, then iterate to green. Is the failure a flaky test unrelated to your change?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant