[aws] [cloudwatch_metrics] Map aws.dimensions field as object (#11883)

Change the mapping type for the `aws.dimensions` field from `flattened` to `object`.

Currently, all `*_metrics` data streams but one use the `object` mapping. The `cloudwatch_metrics` data stream uses the `flattened` type instead.

We need to unify the mapping of `aws.dimensions` across all metrics-related data streams in the AWS integration.
 If all data streams use the exact mapping for `aws.dimensions`, users will be able to query and build a dashboard that correlates data across different data streams.

Author: zmoog

packages/aws/changelog.yml

@@ -1,4 +1,9 @@
 # newer versions go on top
+- version: "2.37.0"
+  changes:
+    - description: Map aws.dimensions as object instead of flattened in CloudWatch metrics.
+      type: enhancement
+      link: https://github.com/elastic/integrations/pull/11883
 - version: "2.36.2"
   changes:
     - description: Include pipeline test examples to accommodate the new Cloudtrail format for the `CreateGroup` and `UpdateGroup` event types.

packages/aws/data_stream/cloudwatch_metrics/fields/package-fields.yml

@@ -5,15 +5,15 @@
       type: flattened
       description: |
         Tag key value pairs from aws resources.
-    - name: dimensions
-      type: flattened
+    - name: dimensions.*
+      type: keyword
+      dimension: true
       description: |
         Metric dimensions.
     - name: dimensions_fingerprint
       type: keyword
       description: |
         Autogenerated ID representing the fingerprint of the aws.dimensions object
-      dimension: true
 - name: 'aws.*.metrics.*.*'
   type: object
   object_type: double

packages/aws/docs/cloudwatch.md

@@ -183,7 +183,7 @@ Please refer to the following [document](https://www.elastic.co/guide/en/ecs/cur
 | agent.id | Unique identifier of this agent (if one exists). Example: For Beats this would be beat.id. | keyword |  |
 | aws.\*.metrics.\*.\* | Metrics that returned from Cloudwatch API query. | object | gauge |
 | aws.cloudwatch.namespace | The namespace specified when query cloudwatch api. | keyword |  |
-| aws.dimensions | Metric dimensions. | flattened |  |
+| aws.dimensions.\* | Metric dimensions. | keyword |  |
 | aws.dimensions_fingerprint | Autogenerated ID representing the fingerprint of the aws.dimensions object | keyword |  |
 | aws.tags | Tag key value pairs from aws resources. | flattened |  |
 | cloud.account.id | The cloud account or organization id used to identify different entities in a multi-tenant environment. Examples: AWS account id, Google Cloud ORG Id, or other unique identifier. | keyword |  |

packages/aws/manifest.yml

@@ -1,7 +1,7 @@
 format_version: 3.0.0
 name: aws
 title: AWS
-version: 2.36.2
+version: 2.37.0
 description: Collect logs and metrics from Amazon Web Services (AWS) with Elastic Agent.
 type: integration
 categories: