Cortex 1.16.0-rc.0

This release contains 227 contributions from 27 contributors. We also have 10 new contributors. Thank you all for the contribution!

Some notable changes release are:

• Store Gateway multilevel index cache
• Object storage backend for runtime config
• Disable specific rule groups in Ruler
• List rules supports filtering by rule name, rule group and file
• Allow tenant shard size to be a percent of total instances for Querier and Store Gateway
• Various improvement on metrics

Cortex

• [CHANGE] AlertManager: include reason label in cortex_alertmanager_notifications_failed_total. #5409
• [CHANGE] Ruler: Added user label to cortex_ruler_write_requests_total, cortex_ruler_write_requests_failed_total, cortex_ruler_queries_total, and cortex_ruler_queries_failed_total metrics. #5312
• [CHANGE] Alertmanager: Validating new fields on the PagerDuty AM config. #5290
• [CHANGE] Ingester: Creating label native-histogram-sample on the cortex_discarded_samples_total to keep track of discarded native histogram samples. #5289
• [CHANGE] Store Gateway: Rename cortex_bucket_store_cached_postings_compression_time_seconds to cortex_bucket_store_cached_postings_compression_time_seconds_total. #5431
• [CHANGE] Store Gateway: Rename cortex_bucket_store_cached_series_fetch_duration_seconds to cortex_bucket_store_series_fetch_duration_seconds and cortex_bucket_store_cached_postings_fetch_duration_seconds to cortex_bucket_store_postings_fetch_duration_seconds. Add new metric cortex_bucket_store_chunks_fetch_duration_seconds. #5448
• [CHANGE] Store Gateway: Remove idle_timeout, max_conn_age, pool_size, min_idle_conns fields for Redis index cache and caching bucket. #5448
• [CHANGE] Store Gateway: Add flag -store-gateway.sharding-ring.zone-stable-shuffle-sharding to enable store gateway to use zone stable shuffle sharding. #5489
• [CHANGE] Bucket Index: Add series_max_size and chunk_max_size to bucket index. #5489
• [CHANGE] StoreGateway: Rename cortex_bucket_store_chunk_pool_returned_bytes_total and cortex_bucket_store_chunk_pool_requested_bytes_total to cortex_bucket_store_chunk_pool_operation_bytes_total. #5552
• [CHANGE] Query Frontend/Querier: Make build info API disabled by default and add feature flag api.build-info-enabled to enable it. #5533
• [CHANGE] Purger: Do no use S3 tenant kms key when uploading deletion marker. #5575
• [CHANGE] Ingester: Shipper always allows uploading compacted blocks to ship OOO compacted blocks. #5625
• [CHANGE] DDBKV: Change metric name from dynamodb_kv_read_capacity_total to dynamodb_kv_consumed_capacity_total and include Delete, Put, Batch dimension. #5487
• [CHANGE] Compactor: Adding the userId on the compact dir path. #5524
• [CHANGE] Ingester: Remove deprecated ingester metrics. #5472
• [FEATURE] Store Gateway: Implementing multi level index cache. #5451
• [FEATURE] Ruler: Add support for disabling rule groups. #5521
• [FEATURE] Support object storage backends for runtime configuration file. #5292
• [FEATURE] Ruler: Add support for Limit field on RuleGroup. #5528
• [FEATURE] AlertManager: Add support for Webex, Discord and Telegram Receiver. #5493
• [FEATURE] Ingester: added -admin-limit-message to customize the message contained in limit errors.#5460
• [FEATURE] AlertManager: Update version to v0.26.0 and bring in Microsoft Teams receiver. #5543
• [FEATURE] Store Gateway: Support lazy expanded posting optimization. Added new flag blocks-storage.bucket-store.lazy-expanded-postings-enabled and new metrics cortex_bucket_store_lazy_expanded_postings_total, cortex_bucket_store_lazy_expanded_posting_size_bytes_total and cortex_bucket_store_lazy_expanded_posting_series_overfetched_size_bytes_total. #5556.
• [FEATURE] Store Gateway: Add max_downloaded_bytes_per_request to limit max bytes to download per store gateway request. #5179
• [FEATURE] Added 2 flags -alertmanager.alertmanager-client.grpc-max-send-msg-size and -alertmanager.alertmanager-client.grpc-max-recv-msg-size to configure alert manager grpc client message size limits. #5338
• [FEATURE] Querier/StoreGateway: Allow the tenant shard sizes to be a percent of total instances. #5393
• [FEATURE] Added the flag -alertmanager.api-concurrency to configure alert manager api concurrency limit. #5412
• [FEATURE] Store Gateway: Add -store-gateway.sharding-ring.keep-instance-in-the-ring-on-shutdown to skip unregistering instance from the ring in shutdown. #5421
• [FEATURE] Ruler: Support for filtering rules in the API. #5417
• [FEATURE] Compactor: Add -compactor.ring.tokens-file-path to store generated tokens locally. #5432
• [FEATURE] Query Frontend: Add -frontend.retry-on-too-many-outstanding-requests to re-enqueue 429 requests if there are multiple query-schedulers available. #5496
• [FEATURE] Store Gateway: Add -blocks-storage.bucket-store.max-inflight-requests for store gateways to reject further series requests upon reaching the limit. #5553
• [FEATURE] Store Gateway: Support filtered index cache. #5587
• [ENHANCEMENT] Update go version to 1.21.3. #5630
• [ENHANCEMENT] Store Gateway: Add cortex_bucket_store_block_load_duration_seconds histogram to track time to load blocks. #5580
• [ENHANCEMENT] Querier: retry chunk pool exhaustion error in querier rather than query frontend. #5569
• [ENHANCEMENT] Alertmanager: Added flag -alertmanager.alerts-gc-interval to configure alerts Garbage collection interval. #5550
• [ENHANCEMENT] Query Frontend: enable vertical sharding on binary expr . #5507
• [ENHANCEMENT] Query Frontend: Include user agent as part of query frontend log. #5450
• [ENHANCEMENT] Query: Set CORS Origin headers for Query API #5388
• [ENHANCEMENT] Query Frontend: Add cortex_rejected_queries_total metric for throttled queries. #5356
• [ENHANCEMENT] Query Frontend: Optimize the decoding of SampleStream. #5349
• [ENHANCEMENT] Compactor: Check ctx done when uploading visit marker. #5333
• [ENHANCEMENT] AlertManager: Add cortex_alertmanager_dispatcher_aggregation_groups and cortex_alertmanager_dispatcher_alert_processing_duration_seconds metrics for dispatcher. #5592
• [ENHANCEMENT] Store Gateway: Added new flag blocks-storage.bucket-store.series-batch-size to control how many series to fetch per batch in Store Gateway. #5582.
• [ENHANCEMENT] Querier: Log query stats when querying store gateway. #5376
• [ENHANCEMENT] Ruler: Add cortex_ruler_rule_group_load_duration_seconds and cortex_ruler_rule_group_sync_duration_seconds metrics. #5609
• [ENHANCEMENT] Ruler: Add contextual info and query statistics to log #5604
• [ENHANCEMENT] Distributor/Ingester: Add span on push path #5319
• [ENHANCEMENT] Query Frontend: Reject subquery with too small step size. #5323
• [ENHANCEMENT] Compactor: Exposing Thanos accept-malformed-index to Cortex compactor. #5334
• [ENHANCEMENT] Log: Avoid expensive log.Valuer evaluation for disallowed levels. #5297
• [ENHANCEMENT] Improving Performance on the API Gzip Handler. #5347
• [ENHANCEMENT] Dynamodb: Add puller-sync-time to allow different pull time for ring. #5357
• [ENHANCEMENT] Emit querier max_concurrent as a metric. #5362
• [ENHANCEMENT] Avoid sort tokens on lifecycler autoJoin. #5394
• [ENHANCEMENT] Do not resync blocks in running store gateways during rollout deployment and container restart. #5363
• [ENHANCEMENT] Store Gateway: Add new metrics cortex_bucket_store_sent_chunk_size_bytes, cortex_bucket_store_postings_size_bytes and cortex_bucket_store_empty_postings_total. #5397
• [ENHANCEMENT] Add jitter to lifecycler heartbeat. #5404
• [ENHANCEMENT] Store Gateway: Add config estimated_max_series_size_bytes and estimated_max_chunk_size_bytes to address data overfetch. #5401
• [ENHANCEMENT] Distributor/Ingester: Add experimental -distributor.sign_write_requests flag to sign the write requests. #5430
• [ENHANCEMENT] Store Gateway/Querier/Compactor: Handling CMK Access Denied errors. #5420 #5442 #5446
• [ENHANCEMENT] Alertmanager: Add the alert name in error log when it get throttled. #5456
• [ENHANCEMENT] Querier: Retry store gateway on different zones when zone awareness is enabled. #5476
• [ENHANCEMENT] Compactor: allow unregister_on_shutdown to be configurable. #5503
• [ENHANCEMENT] Querier: Batch adding series to query limiter to optimize locking. #5505
• [ENHANCEMENT] Store Gateway: add metric cortex_bucket_store_chunk_refetches_total for number of chunk refetches. #5532
• [ENHANCEMENT] BasicLifeCycler: allow final-sleep during shutdown #5517
• [ENHANCEMENT] All: Handling CMK Access Denied errors. #5420 #5542
• [ENHANCEMENT] Querier: Retry store gateway client connection closing gRPC error. #5558
• [ENHANCEMENT] QueryFrontend: Add generic retry for all APIs. #5561.
• [ENHANCEMENT] Querier: Check context before notifying scheduler and frontend. #5565
• [ENHANCEMENT] QueryFrontend: Add metric for number of series requests. #5373
• [ENHANCEMENT] Store Gateway: Add histogram metrics for total time spent fetching series and chunks per request. #5573
• [ENHANCEMENT] Store Gateway: Check context in multi level cache. Add cortex_store_multilevel_index_cache_fetch_duration_seconds and cortex_store_multilevel_index_cache_backfill_duration_seconds to measure fetch and backfill latency. #5596
• [ENHANCEMENT] Ingester: Added new ingester TSDB metrics cortex_ingester_tsdb_head_samples_appended_total, cortex_ingester_tsdb_head_out_of_order_samples_appended_total, cortex_ingester_tsdb_snapshot_replay_error_total, cortex_ingester_tsdb_sample_ooo_delta and cortex_ingester_tsdb_mmap_chunks_total. #5624
• [ENHANCEMENT] Query Frontend: Handle context error before decoding and merging responses. #5499
• [ENHANCEMENT] Store-Gateway and AlertManager: Add a wait_instance_time_out to context to avoid waiting forever. #5581
• [BUGFIX] Compactor: Fix possible division by zero during compactor config valid...

Cortex 1.15.3

This release includes:

• Distributor: Fix potential data corruption in cases of timeout between distributors and ingesters. #5422

Cortex 1.15.2

This release includes Go runtime upgrade to 1.20.4 to address critical CVE.

• [ENHANCEMENT] Update Go version to 1.20.4. #5299

Cortex 1.15.1

This release includes:

• [CHANGE] Alertmanager: Validating new fields on the PagerDuty AM config. #5290
• [BUGFIX] Querier: Convert gRPC ResourceExhausted status code from store gateway to 422 limit error. #5286

Cortex 1.15.0

This release contains 177 contributions from 24 contributors. We also have 13 new contributors. Thank you all for the contribution!

Some notable changes release are:

• Out of order samples ingestion
• MultiKey KV ring for DynamoDB
• Snappy-block gRPC compression
• Redis as index cache and caching bucket backend
• ARM images support
• Thanos PromQL engine support
• Multiples performance improvements and bug fixes

Cortex

• [CHANGE] Storage: Make Max exemplars config per tenant instead of global configuration. #5080 #5122
• [CHANGE] Alertmanager: Local file disclosure vulnerability in OpsGenie configuration has been fixed. #5045
• [CHANGE] Rename oltp_endpoint to otlp_endpoint to match opentelemetry spec and lib name. #5068
• [CHANGE] Distributor/Ingester: Log warn level on push requests when they have status code 4xx. Do not log if status is 429. #5103
• [CHANGE] Tracing: Use the default OTEL trace sampler when -tracing.otel.exporter-type is set to awsxray. #5141
• [CHANGE] Ingester partial error log line to debug level. #5192
• [CHANGE] Change HTTP status code from 503/422 to 499 if a request is canceled. #5220
• [CHANGE] Store gateways summary metrics have been converted to histograms cortex_bucket_store_series_blocks_queried, cortex_bucket_store_series_data_fetched, cortex_bucket_store_series_data_size_touched_bytes, cortex_bucket_store_series_data_size_fetched_bytes, cortex_bucket_store_series_data_touched, cortex_bucket_store_series_result_series #5239
• [FEATURE] Querier/Query Frontend: support Prometheus /api/v1/status/buildinfo API. #4978
• [FEATURE] Ingester: Add active series to all_user_stats page. #4972
• [FEATURE] Ingester: Added -blocks-storage.tsdb.head-chunks-write-queue-size allowing to configure the size of the in-memory queue used before flushing chunks to the disk . #5000
• [FEATURE] Query Frontend: Log query params in query frontend even if error happens. #5005
• [FEATURE] Ingester: Enable snapshotting of In-memory TSDB on disk during shutdown via -blocks-storage.tsdb.memory-snapshot-on-shutdown. #5011
• [FEATURE] Query Frontend/Scheduler: Add a new counter metric cortex_request_queue_requests_total for total requests going to queue. #5030
• [FEATURE] Build ARM docker images. #5041
• [FEATURE] Query-frontend/Querier: Create spans to measure time to merge promql responses. #5041
• [FEATURE] Querier/Ruler: Support the new thanos promql engine. This is an experimental feature and might change in the future. #5093
• [FEATURE] Added zstd as an option for grpc compression #5092
• [FEATURE] Ring: Add new kv store option dynamodb. #5026
• [FEATURE] Cache: Support redis as backend for caching bucket and index cache. #5057
• [FEATURE] Querier/Store-Gateway: Added -blocks-storage.bucket-store.ignore-blocks-within allowing to filter out the recently created blocks from being synced by queriers and store-gateways. #5166
• [FEATURE] AlertManager/Ruler: Added support for keep_firing_for on alerting rulers.
• [FEATURE] Alertmanager: Add support for time_intervals. #5102
• [FEATURE] Added snappy-block as an option for grpc compression #5215
• [FEATURE] Enable experimental out-of-order samples support. Added 2 new configs ingester.out_of_order_time_window and blocks-storage.tsdb.out_of_order_cap_max. #4964
• [ENHANCEMENT] Querier: limit series query to only ingesters if start param is not specified. #4976
• [ENHANCEMENT] Query-frontend/scheduler: add a new limit frontend.max-outstanding-requests-per-tenant for configuring queue size per tenant. Started deprecating two flags -query-scheduler.max-outstanding-requests-per-tenant and -querier.max-outstanding-requests-per-tenant, and change their value default to 0. Now if both the old flag and new flag are specified, the old flag's queue size will be picked. #4991
• [ENHANCEMENT] Query-tee: Add /api/v1/query_exemplars API endpoint support. #5010
• [ENHANCEMENT] Let blocks_cleaner delete blocks concurrently(default 16 goroutines). #5028
• [ENHANCEMENT] Query Frontend/Query Scheduler: Increase upper bound to 60s for queue duration histogram metric. #5029
• [ENHANCEMENT] Query Frontend: Log Vertical sharding information when query_stats_enabled is enabled. #5037
• [ENHANCEMENT] Ingester: The metadata APIs should honour querier.query-ingesters-within when querier.query-store-for-labels-enabled is true. #5027
• [ENHANCEMENT] Query Frontend: Skip instant query roundtripper if sharding is not applicable. #5062
• [ENHANCEMENT] Push reduce one hash operation of Labels. #4945 #5114
• [ENHANCEMENT] Alertmanager: Added -alertmanager.enabled-tenants and -alertmanager.disabled-tenants to explicitly enable or disable alertmanager for specific tenants. #5116
• [ENHANCEMENT] Upgraded Docker base images to alpine:3.17. #5132
• [ENHANCEMENT] Add retry logic to S3 bucket client. #5135
• [ENHANCEMENT] Update Go version to 1.20.1. #5159
• [ENHANCEMENT] Distributor: Reuse byte slices when serializing requests from distributors to ingesters. #5193
• [ENHANCEMENT] Query Frontend: Add number of chunks and samples fetched in query stats. #5198
• [ENHANCEMENT] Implement grpc.Compressor.DecompressedSize for snappy to optimize memory allocations. #5213
• [ENHANCEMENT] Querier: Batch Iterator optimization to prevent transversing it multiple times query ranges steps does not overlap. #5237
• [BUGFIX] Updated golang.org/x/net dependency to fix CVE-2022-27664. #5008
• [BUGFIX] Fix panic when otel and xray tracing is enabled. #5044
• [BUGFIX] Fixed no compact block got grouped in shuffle sharding grouper. #5055
• [BUGFIX] Fixed ingesters with less tokens stuck in LEAVING. #5061
• [BUGFIX] Tracing: Fix missing object storage span instrumentation. #5074
• [BUGFIX] Ingester: Fix Ingesters returning empty response for metadata APIs. #5081
• [BUGFIX] Ingester: Fix panic when querying metadata from blocks that are being deleted. #5119
• [BUGFIX] Ring: Fix case when dynamodb kv reaches the limit of 25 actions per batch call. #5136
• [BUGFIX] Query-frontend: Fix shardable instant queries do not produce sorted results for sort, sort_desc, topk, bottomk functions. #5148, #5170
• [BUGFIX] Querier: Fix /api/v1/series returning 5XX instead of 4XX when limits are hit. #5169
• [BUGFIX] Compactor: Fix issue that shuffle sharding planner return error if block is under visit by other compactor. #5188
• [BUGFIX] Fix S3 BucketWithRetries upload empty content issue #5217
• [BUGFIX] Query Frontend: Disable absent, absent_over_time and scalar for vertical sharding. #5221
• [BUGFIX] Catch context error in the s3 bucket client. #5240
• [BUGFIX] Fix query frontend remote read empty body. #5257
• [BUGFIX] Fix query frontend incorrect error response format at SplitByQuery middleware. #5260

Cortex 1.15.0-rc.2

Over v1.15.0-rc.1 to include two bug fixes.

• [BUGFIX] Fix query frontend remote read empty body. #5257
• [BUGFIX] Fix query frontend incorrect error response format at SplitByQuery middleware. #5260

Cortex 1.15.0-rc.1

Over v1.15.0-rc.0 to include some bug fixes and performance improvements.

• [CHANGE] Store gateways summary metrics have been converted to histograms cortex_bucket_store_series_blocks_queried, cortex_bucket_store_series_data_fetched, cortex_bucket_store_series_data_size_touched_bytes, cortex_bucket_store_series_data_size_fetched_bytes, cortex_bucket_store_series_data_touched, cortex_bucket_store_series_result_series #5239
• [ENHANCEMENT] Querier: Batch Iterator optimization to prevent transversing it multiple times query ranges steps does not overlap. #5237
• [BUGFIX] Catch context error in the s3 bucket client. #5240

Cortex 1.15.0-rc.0

This release contains 172 contributions from 24 contributors. We also have 13 new contributors. Thank you all for the contribution!

Some notable changes release are:

• Out of order samples ingestion
• MultiKey KV ring for DynamoDB
• Snappy-block gRPC compression
• Redis as index cache and caching bucket backend
• Arm images support
• Thanos PromQL engine support
• Multiples performance improvements and bug fixes

Cortex

• [CHANGE] Storage: Make Max exemplars config per tenant instead of global configuration. #5080 #5122
• [CHANGE] Alertmanager: Local file disclosure vulnerability in OpsGenie configuration has been fixed. #5045
• [CHANGE] Rename oltp_endpoint to otlp_endpoint to match opentelemetry spec and lib name. #5068
• [CHANGE] Distributor/Ingester: Log warn level on push requests when they have status code 4xx. Do not log if status is 429. #5103
• [CHANGE] Tracing: Use the default OTEL trace sampler when -tracing.otel.exporter-type is set to awsxray. #5141
• [CHANGE] Ingester partial error log line to debug level. #5192
• [CHANGE] Change HTTP status code from 503/422 to 499 if a request is canceled. #5220
• [FEATURE] Querier/Query Frontend: support Prometheus /api/v1/status/buildinfo API. #4978
• [FEATURE] Ingester: Add active series to all_user_stats page. #4972
• [FEATURE] Ingester: Added -blocks-storage.tsdb.head-chunks-write-queue-size allowing to configure the size of the in-memory queue used before flushing chunks to the disk . #5000
• [FEATURE] Query Frontend: Log query params in query frontend even if error happens. #5005
• [FEATURE] Ingester: Enable snapshotting of In-memory TSDB on disk during shutdown via -blocks-storage.tsdb.memory-snapshot-on-shutdown. #5011
• [FEATURE] Query Frontend/Scheduler: Add a new counter metric cortex_request_queue_requests_total for total requests going to queue. #5030
• [FEATURE] Build ARM docker images. #5041
• [FEATURE] Query-frontend/Querier: Create spans to measure time to merge promql responses. #5041
• [FEATURE] Querier/Ruler: Support the new thanos promql engine. This is an experimental feature and might change in the future. #5093
• [FEATURE] Added zstd as an option for grpc compression #5092
• [FEATURE] Ring: Add new kv store option dynamodb. #5026
• [FEATURE] Cache: Support redis as backend for caching bucket and index cache. #5057
• [FEATURE] Querier/Store-Gateway: Added -blocks-storage.bucket-store.ignore-blocks-within allowing to filter out the recently created blocks from being synced by queriers and store-gateways. #5166
• [FEATURE] AlertManager/Ruler: Added support for keep_firing_for on alerting rulers.
• [FEATURE] Alertmanager: Add support for time_intervals. #5102
• [FEATURE] Added snappy-block as an option for grpc compression #5215
• [FEATURE] Enable experimental out-of-order samples support. Added 2 new configs ingester.out_of_order_time_window and blocks-storage.tsdb.out_of_order_cap_max. #4964
• [ENHANCEMENT] Querier: limit series query to only ingesters if start param is not specified. #4976
• [ENHANCEMENT] Query-frontend/scheduler: add a new limit frontend.max-outstanding-requests-per-tenant for configuring queue size per tenant. Started deprecating two flags -query-scheduler.max-outstanding-requests-per-tenant and -querier.max-outstanding-requests-per-tenant, and change their value default to 0. Now if both the old flag and new flag are specified, the old flag's queue size will be picked. #4991
• [ENHANCEMENT] Query-tee: Add /api/v1/query_exemplars API endpoint support. #5010
• [ENHANCEMENT] Let blocks_cleaner delete blocks concurrently(default 16 goroutines). #5028
• [ENHANCEMENT] Query Frontend/Query Scheduler: Increase upper bound to 60s for queue duration histogram metric. #5029
• [ENHANCEMENT] Query Frontend: Log Vertical sharding information when query_stats_enabled is enabled. #5037
• [ENHANCEMENT] Ingester: The metadata APIs should honour querier.query-ingesters-within when querier.query-store-for-labels-enabled is true. #5027
• [ENHANCEMENT] Query Frontend: Skip instant query roundtripper if sharding is not applicable. #5062
• [ENHANCEMENT] Push reduce one hash operation of Labels. #4945 #5114
• [ENHANCEMENT] Alertmanager: Added -alertmanager.enabled-tenants and -alertmanager.disabled-tenants to explicitly enable or disable alertmanager for specific tenants. #5116
• [ENHANCEMENT] Upgraded Docker base images to alpine:3.17. #5132
• [ENHANCEMENT] Add retry logic to S3 bucket client. #5135
• [ENHANCEMENT] Update Go version to 1.20.1. #5159
• [ENHANCEMENT] Distributor: Reuse byte slices when serializing requests from distributors to ingesters. #5193
• [ENHANCEMENT] Query Frontend: Add number of chunks and samples fetched in query stats. #5198
• [ENHANCEMENT] Implement grpc.Compressor.DecompressedSize for snappy to optimize memory allocations. #5213
• [BUGFIX] Updated golang.org/x/net dependency to fix CVE-2022-27664. #5008
• [BUGFIX] Fix panic when otel and xray tracing is enabled. #5044
• [BUGFIX] Fixed no compact block got grouped in shuffle sharding grouper. #5055
• [BUGFIX] Fixed ingesters with less tokens stuck in LEAVING. #5061
• [BUGFIX] Tracing: Fix missing object storage span instrumentation. #5074
• [BUGFIX] Ingester: Fix Ingesters returning empty response for metadata APIs. #5081
• [BUGFIX] Ingester: Fix panic when querying metadata from blocks that are being deleted. #5119
• [BUGFIX] Ring: Fix case when dynamodb kv reaches the limit of 25 actions per batch call. #5136
• [BUGFIX] Query-frontend: Fix shardable instant queries do not produce sorted results for sort, sort_desc, topk, bottomk functions. #5148, #5170
• [BUGFIX] Querier: Fix /api/v1/series returning 5XX instead of 4XX when limits are hit. #5169
• [BUGFIX] Compactor: Fix issue that shuffle sharding planner return error if block is under visit by other compactor. #5188
• [BUGFIX] Fix S3 BucketWithRetries upload empty content issue #5217
• [BUGFIX] Query Frontend: Disable absent, absent_over_time and scalar for vertical sharding. #5221

Cortex 1.14.1

This release includes:

• [CHANGE] Alertmanager: Local file disclosure vulnerability in OpsGenie configuration has been fixed. #5045
  • CVE-2022-23536
• [BUGFIX] Fix panic when otel and xray tracing is enabled. #5044
• [FEATURE] Build ARM docker images. #5041

Docker Images:

• quay.io/cortexproject/cortex:v1.14.1
• cortexproject/cortex:v1.14.1

Cortex 1.13.2

This release includes:

• [CHANGE] Alertmanager: Local file disclosure vulnerability in OpsGenie configuration has been fixed. #5045
  • CVE-2022-23536

Docker Images:

• quay.io/cortexproject/cortex:v1.13.2
• cortexproject/cortex:v1.13.2