You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This release contains 168 contributions from 29 contributors. We also have 16 new contributors. Thank you all for the contributions!
Some notable changes release are:
Experimental OTLP ingestion
Experimental minimize spread token generator strategy on Ingester
Advanced query scheduling with Query Priority
ListRules API high availability by rule group replication and backup
Various improvements on Store Gateway Index Cache
mem-ballast-size-bytes flag has been marked as deprecated and not functional anymore
-querier.ingester-streaming flag has been marked as deprecated and ingester streaming is always enabled now
querier.iterators and querier.batch-iterators flags have been marked as deprecated and batch iterator is always enabled in Querier now
Cortex
[CHANGE] Azure Storage: Upgraded objstore dependency and support Azure Workload Identity Authentication. Added connection_string to support authenticating via SAS token. Marked msi_resource config as deprecating. Upgrade objstore and change Azure bucket client #5645
[CHANGE] Index Cache: Multi level cache backfilling operation becomes async. Added -blocks-storage.bucket-store.index-cache.multilevel.max-async-concurrency and -blocks-storage.bucket-store.index-cache.multilevel.max-async-buffer-size configs and metric cortex_store_multilevel_index_cache_backfill_dropped_items_total for number of dropped items. Make multilevel cache backfilling async #5661
[CHANGE] Ruler: Remove cortex_ruler_write_requests_total, cortex_ruler_write_requests_failed_total, cortex_ruler_queries_total, cortex_ruler_queries_failed_total, and cortex_ruler_query_seconds_total metrics for the tenant when the ruler deletes the manager for the tenant. Remove user specific evaluation metrics when rule manager is removed #5772
[CHANGE] Compactor/Bucket Store: Added -blocks-storage.bucket-store.block-discovery-strategy to configure different block listing strategy. Reverted the current recursive block listing mechanism and use the strategy Concurrent as in 1.15. Configurable block listing strategy #5828
[CHANGE] Querier: Mark querier.iterators and querier.batch-iterators flags as deprecated. Now querier always use batch iterators. Always enable Querier BatchIterators #5868
[FEATURE] Ruler: Add ruler.concurrent-evals-enabled flag to enable concurrent evaluation within a single rule group for independent rules. Maximum concurrency can be configured via ruler.max-concurrent-evals. Add concurrent evaluation for ruler #5766
[FEATURE] Storage Cache Clients: Add config set_async_circuit_breaker_config to utilize the circuit breaker pattern for dynamically thresholding asynchronous set operations. Implemented in both memcached and redis cache clients. support set async circuit breaker for memcached and redis client #5789
[FEATURE] Ruler: Add experimental experimental.ruler.api-deduplicate-rules flag to remove duplicate rule groups from the Prometheus compatible rules API endpoint. Add experimental ruler.ring.replication-factor and ruler.ring.zone-awareness-enabled flags to configure rule group replication, but only the first ruler in the replicaset evaluates the rule group, the rest will just hold a copy as backup. Add experimental experimental.ruler.api-enable-rules-backup flag to configure rulers to send the rule group backups stored in the replicaset to handle events when a ruler is down during an API request to list rules. Allowing rule backup for rules API HA #5782
[ENHANCEMENT] Logging: Added new options for logging HTTP request headers: -server.log-request-headers enables logging HTTP request headers, -server.log-request-headers-exclude-list allows users to specify headers which should not be logged. Upgrade Prometheus and Thanos version to latest main #5744
[ENHANCEMENT] Query: Added query_storage_wall_time to Query Frontend and Ruler query stats log for wall time spent on fetching data from storage. Query evaluation is not included. add query storage wall time to query stats #5799
[ENHANCEMENT] Query: Added additional max query length check at Query Frontend and Ruler. Added -querier.ignore-max-query-length flag to disable max query length check at Querier. Consider query select time in max query length check #5808
[ENHANCEMENT] Ruler: Improve GetRules response time by refactoring mutexes and introducing a temporary rules cache in ruler/manager.go. Improve GetRules performance #5805
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
This release contains 168 contributions from 29 contributors. We also have 16 new contributors. Thank you all for the contributions!
Some notable changes release are:
mem-ballast-size-bytes
flag has been marked as deprecated and not functional anymore-querier.ingester-streaming
flag has been marked as deprecated and ingester streaming is always enabled nowquerier.iterators
andquerier.batch-iterators
flags have been marked as deprecated and batch iterator is always enabled in Querier nowCortex
connection_string
to support authenticating via SAS token. Markedmsi_resource
config as deprecating. Upgrade objstore and change Azure bucket client #5645-blocks-storage.bucket-store.index-cache.multilevel.max-async-concurrency
and-blocks-storage.bucket-store.index-cache.multilevel.max-async-buffer-size
configs and metriccortex_store_multilevel_index_cache_backfill_dropped_items_total
for number of dropped items. Make multilevel cache backfilling async #5661distributor_samples_in_total
. Count the number of rate-limited samples in distributor_samples_in_total #5714cortex_ruler_write_requests_total
,cortex_ruler_write_requests_failed_total
,cortex_ruler_queries_total
,cortex_ruler_queries_failed_total
, andcortex_ruler_query_seconds_total
metrics for the tenant when the ruler deletes the manager for the tenant. Remove user specific evaluation metrics when rule manager is removed #5772mem-ballast-size-bytes
flag as deprecated. Mark mem ballast flag as deprecated #5816-querier.ingester-streaming
flag as deprecated. Now query ingester streaming is always enabled. Always turn on ingester query streaming and mark its flag as deprecated #5817-blocks-storage.bucket-store.block-discovery-strategy
to configure different block listing strategy. Reverted the current recursive block listing mechanism and use the strategyConcurrent
as in 1.15. Configurable block listing strategy #5828-blocks-storage.s3.send-content-md5
flag and set default checksum algorithm to MD5. Add S3 send_content_md5 config and default to use MD5 #5870querier.iterators
andquerier.batch-iterators
flags as deprecated. Now querier always use batch iterators. Always enable Querier BatchIterators #5868cortex_ingester_tsdb_data_replay_duration_seconds
. Add cortex_ingester_tsdb_data_replay_duration_seconds metric #5477kuberesolver
to resolve endpoints address withkubernetes://
prefix as Kubernetes service. otlpgrpc: turn on round_robin LB policy and kuberesolver for resolving k8s service endpoints #5731tracing.otel.round-robin
flag to useround_robin
gRPC client side LB policy for sending OTLP traces. otlpgrpc: turn on round_robin LB policy and kuberesolver for resolving k8s service endpoints #5731ruler.concurrent-evals-enabled
flag to enable concurrent evaluation within a single rule group for independent rules. Maximum concurrency can be configured viaruler.max-concurrent-evals
. Add concurrent evaluation for ruler #5766zone_results_quorum_metadata
. When querying ingesters using metadata APIs such as label names and values, only results from quorum number of zones will be included and merged. Option to include quorum zone results for DistributorQueryable metadata API #5779set_async_circuit_breaker_config
to utilize the circuit breaker pattern for dynamically thresholding asynchronous set operations. Implemented in both memcached and redis cache clients. support set async circuit breaker for memcached and redis client #5789experimental.ruler.api-deduplicate-rules
flag to remove duplicate rule groups from the Prometheus compatible rules API endpoint. Add experimentalruler.ring.replication-factor
andruler.ring.zone-awareness-enabled
flags to configure rule group replication, but only the first ruler in the replicaset evaluates the rule group, the rest will just hold a copy as backup. Add experimentalexperimental.ruler.api-enable-rules-backup
flag to configure rulers to send the rule group backups stored in the replicaset to handle events when a ruler is down during an API request to list rules. Allowing rule backup for rules API HA #5782-store-gateway.enabled-tenants
and-store-gateway.disabled-tenants
to explicitly enable or disable store-gateway for specific tenants. add/support enabled_tenants and disabled_tenants feature in storegateway #5638cortex_compactor_start_duration_seconds
. Add compactor start duration in seconds metric #5683max_backfill_items
to cap max items to backfill per async operation. Improve async processor handling enabled items, optimize code further #5686query stats
log. Log split queries at query frontend #5703-server.log-request-headers
enables logging HTTP request headers,-server.log-request-headers-exclude-list
allows users to specify headers which should not be logged. Upgrade Prometheus and Thanos version to latest main #5744querier.store-gateway-query-stats-enabled
to enable or disable store gateway query stats log. Add flag to disable store gateway query stats #5749cortex_ingester_max_inflight_query_requests
. Addingcortex_ingester_max_inflight_query_requests
metric #5798query_storage_wall_time
to Query Frontend and Ruler query stats log for wall time spent on fetching data from storage. Query evaluation is not included. add query storage wall time to query stats #5799-querier.ignore-max-query-length
flag to disable max query length check at Querier. Consider query select time in max query length check #5808ruler/manager.go
. Improve GetRules performance #5805-ingester.tokens-generator-strategy=minimize-spread
flag to enable the new minimize spread token generator strategy. Implementing Spread Minimizing Token Generator #5855Ownership Diff From Expected
column in the ring table to indicate the extent to which the ownership of a specific ingester differs from the expected ownership. Fixing how ring ownership is calculated on the ring status page #5889cache_size
config correctly. Fix passing of redis client cache size #5734New Contributors
Full Changelog: v1.16.1...v1.17.0
This discussion was created from the release Cortex 1.17.0.
Beta Was this translation helpful? Give feedback.
All reactions