[META] [Star Tree] [Search] Supported Queries to resolve via star tree

[sandeshkr419]

Please describe the end goal of this project

This issue keeps a tracker of supported aggregations & query shapes which can be resolved via star-tree composite indices and the star-tree implementation (if possible) should benefit the performance for the query shape.
This will basically keep a track of supported and planned query shapes which can utilize star-tree aggregation for faster computation.
Community - Please do share/comment on what all you think should be prioritized.

Milestone 1 (Simple Metric Aggregations)

The primary goal of Milestone 1 is to utilize star-tree to resolve metric aggregation queries (max, min, avg, sum, value count) over numeric fields along with support of a single query as well. This milestone lays out the building blocks of how star-tree approach can be integrated in within a search request to resolve it.

• (merged to 2.18) Metric Aggregation
  [Star Tree][Search][RFC] Parse aggregation request to resolve via star tree data structure #14871
  [Star Tree] [Search] Support for metric aggregations with/without term query #15289
• (merged to 2.18) Metric Aggregation with numeric field term query
  [Star Tree][Search][RFC] Parse aggregation request to resolve via star tree data structure #14871
  [Star Tree] [Search] Support for metric aggregations with/without term query #15289

Milestone 2 (Extending queries over supported Aggregations)

The primary goal of Milestone 2 is support certain queries within above aggregation requests like term/terms query, boolean query over numeric/keyword fields.

• (merged to 2.19) Support for keyword field term query in star-tree supported aggregations
  [Star Tree] [Search] Support for keyword field in term query with metric aggregations #16537
  Extensible design to add new query and field type support for Star Tree #17137
• (merged to 2.19) Support for multi-terms numeric/keyword query in star-tree supported aggregations
  [Star Tree] [Search] Support for terms query with metric aggregations #16538
  Extensible design to add new query and field type support for Star Tree #17137
• (merged to 2.19) Support for numeric range query in star-tree supported aggregations
  [Star Tree] [Search] Support for numeric range query with metric aggregations #16539
  Extensible design to add new query and field type support for Star Tree #17137
• (TBD in 3.0) Support for IP field term query in star-tree supported aggregations
  [Star Tree] [Search] Support for IP field in supported queries with star-tree supported aggregations #16547
• Support for boolean query in star-tree supported aggregations
  [Star Tree] [Search] Support of Boolean Queries in Aggregations supported by Star-tree #17267
• Support for date field type in star-tree supported aggregations
  [Star Tree] [Search] Support for date type field in supported queries with star-tree supported aggregations #17270

Milestone 3 (Bucket Aggregations)

The primary goal of Milestone 3 is to support single-level bucket aggregations like date histogram, range aggregations, single bucket aggregations, etc

• (merged to 2.19) Date histogram with metric aggregation
  [Star Tree] [Search] Date histogram with metric aggregation #16552
  [Star Tree] [Search] Resolving Date histogram with metric aggregation using star-tree #16674
• (TBD in 3.0) Bucket terms Aggregation with metric aggregation
  [Star Tree] [Search] Bucket terms Aggregation with metric aggregation #16551
• Range aggregation with metric aggregation
  [Star Tree] [Search] Range Aggregations with metric aggregation #16553
  [Star Tree] [Search] Resolving Range aggregations with Star-tree #17273

Milestone 4 (Nested Aggregations)

The goal of this milestone is to extend the star-tree support to resolve nested aggregations, multi-terms aggregations.

• Multi-terms aggregation
• Nested bucket aggregation
  [Star Tree] [Search] Nested Aggregations #17274
• Filter aggregation
  [Star Tree] [Search] Support to resolve filter aggregations via star-tree #17269

Benchmarking Setup

• Introduce workloads in OSB to track performance gains using star-tree
  [Star Tree] [Search] Workloads to trigger aggregations supported by star-tree opensearch-benchmark-workloads#570

Related component

Search:Aggregations

[expani]

@sandeshkr419 @getsaurabh02 Kindly assign this to me.

[sandeshkr419]

Capturing post 2.19 items to investigate:

• Optimize numeric conversions - [Star Tree] [Search] Keyword & Numeric Terms Aggregation #17165 (comment)
• Utilize star-tree in bucket aggregations without any sub-aggregations - [Star Tree] [Search] Resolving Date histogram with metric aggregation using star-tree #16674 (comment)
• Evaluate correctness of DEPTH_FIRST execution in bucket aggregations - [Star Tree] [Search] Keyword & Numeric Terms Aggregation #17165
• Evaluate if deferrable collectors also need to extend pre-computation framework