From 526deeb39075cbdfb042dd2f62ccc97f6a31ca23 Mon Sep 17 00:00:00 2001 From: elasticmachine Date: Mon, 9 Oct 2023 14:56:19 +0000 Subject: [PATCH 1/4] docs: Close changelog for 7.17.14 --- CHANGELOG.asciidoc | 143 ++++++++++++++++++++++++++++++++++ CHANGELOG.next.asciidoc | 42 +--------- libbeat/docs/release.asciidoc | 1 + 3 files changed, 147 insertions(+), 39 deletions(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index 583c52b8357e..8950bd37dc01 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -3,6 +3,149 @@ :issue: https://github.com/elastic/beats/issues/ :pull: https://github.com/elastic/beats/pull/ +[[release-notes-7.17.14]] +=== Beats version 7.17.14 +https://github.com/elastic/beats/compare/v7.17.13\...v7.17.14[View commits] + +==== Breaking changes + +*Affecting all Beats* +- The Elasticsearch output now enables compression by default. This decreases network data usage by an average of 70-80%, in exchange for 20-25% increased CPU use and ~10% increased ingestion time. The previous default can be restored by setting the flag `compression_level: 0` under `output.elasticsearch`. {pull}36681[36681] + + +*Auditbeat* + +*Filebeat* + +*Heartbeat* + +*Metricbeat* + + +*Packetbeat* + +*Winlogbeat* + + +*Functionbeat* + +==== Bugfixes + +*Affecting all Beats* + +- Eliminate cloning of event in deepUpdate {pull}35945[35945] + +*Auditbeat* + + +*Filebeat* + +- [Gcs Input] - Added missing locks for safe concurrency {pull}34914[34914] +- Fix the ignore_inactive option being ignored in Filebeat's filestream input {pull}34770[34770] +- Fix TestMultiEventForEOFRetryHandlerInput unit test of CometD input {pull}34903[34903] +- Add input instance id to request trace filename for httpjson and cel inputs {pull}35024[35024] +- Fixes "Can only start an input when all related states are finished" error when running under Elastic-Agent {pull}35250[35250] {issue}33653[33653] +- [GCS Input] - Fixed an issue where bucket_timeout was being applied to the entire bucket poll interval and not individual bucket object read operations. Fixed a map write concurrency issue arising from data races when using a high number of workers. Fixed the flaky tests that were present in the GCS test suit. {pull}35605[35605] +- Fix error message formatting from filestream input. {pull}35658[35658] +- Fix error when trying to use `include_message` parser {issue}35440[35440] +- Fix handling of IPv6 unspecified addresses in TCP input. {issue}35064[35064] {pull}35637[35637] +- Fixed a minor code error in the GCS input scheduler where a config value was being used directly instead of the source struct. {pull}35729[35729] +- Improve error reporting and fix IPv6 handling of TCP and UDP metric collection. {pull}35772[35772] +- Fix CEL input JSON marshalling of nested objects. {issue}35763[35763] {pull}35774[35774] +- Fix metric collection in GCPPubSub input. {pull}35773[35773] +- Fix end point deregistration in http_endpoint input. {issue}35899[35899] {pull}35903[35903] +- Fix duplicate ID panic in filestream metrics. {issue}35964[35964] {pull}35972[35972] +- Improve error reporting and fix IPv6 handling of TCP and UDP metric collection. {pull}35996[35996] +- Fix handling of NUL-terminated log lines in Fortinet Firewall module. {issue}36026[36026] {pull}36027[36027] +- Make redact field configuration recommended in CEL input and log warning if missing. {pull}36008[36008] +- Fix handling of region name configuration in awss3 input {pull}36034[36034] +- Fixed concurrency and flakey tests issue in azure blob storage input. {issue}35983[35983] {pull}36124[36124] +- Fix panic when sqs input metrics getter is invoked {pull}36101[36101] {issue}36077[36077] +- Make CEL input's `now` global variable static for evaluation lifetime. {pull}36107[36107] +- Update mito CEL extension library to v1.5.0. {pull}36146[36146] +- Fix handling of TCP/UDP address resolution during metric initialization. {issue}35064[35064] {pull}36287[36287] +- Fix handling of Juniper SRX structured data when there is no leading junos element. {issue}36270[36270] {pull}36308[36308] +- Remove erroneous error log in GCPPubSub input. {pull}36296[36296] +- Fix Filebeat Cisco module with missing escape character {issue}36325[36325] {pull}36326[36326] +- Fix panic when redact option is not provided to CEL input. {issue}36387[36387] {pull}36388[36388] +- Remove 'onFilteredOut' and 'onDroppedOnPublish' callback logs {issue}36299[36299] {pull}36399[36399] +- Added a fix for Crowdstrike pipeline handling process arrays {pull}36496[36496] +- Revert error introduced in {pull}35734[35734] when symlinks can't be resolved in filestream. {pull}36557[36557] + +*Heartbeat* + + +*Metricbeat* + + +*Packetbeat* + +- Fix panic in HTTP protocol parsing when host header has empty host part. {issue}36497[36497] {issue}36518[36518] +- Fix default cache size calculation. {pull}36723[36723] + +*Winlogbeat* + + +*Functionbeat* + +*Elastic Logging Plugin* + + +==== Added + +*Affecting all Beats* + + + +*Auditbeat* + + +*Filebeat* + +- Re-use buffers to optimise memory allocation in fingerprint mode of filestream {pull}36736[36736] + +*Heartbeat* + + +*Metricbeat* + + +*Packetbeat* + + +*Functionbeat* + + +*Winlogbeat* + + + +*Elastic Log Driver* + + +==== Deprecated + +*Affecting all Beats* + + +*Filebeat* + + +*Heartbeat* + +*Metricbeat* + + +*Packetbeat* + +*Winlogbeat* + +*Functionbeat* + +==== Known Issue + + + [[release-notes-7.17.13]] === Beats version 7.17.13 https://github.com/elastic/beats/compare/v7.17.12\...v7.17.13[View commits] diff --git a/CHANGELOG.next.asciidoc b/CHANGELOG.next.asciidoc index 74d3e5042781..4362127e564e 100644 --- a/CHANGELOG.next.asciidoc +++ b/CHANGELOG.next.asciidoc @@ -9,7 +9,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d ==== Breaking changes *Affecting all Beats* -- The Elasticsearch output now enables compression by default. This decreases network data usage by an average of 70-80%, in exchange for 20-25% increased CPU use and ~10% increased ingestion time. The previous default can be restored by setting the flag `compression_level: 0` under `output.elasticsearch`. {pull}36681[36681] *Auditbeat* @@ -32,47 +31,12 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Affecting all Beats* -- Eliminate cloning of event in deepUpdate {pull}35945[35945] *Auditbeat* *Filebeat* -- [Gcs Input] - Added missing locks for safe concurrency {pull}34914[34914] -- Fix the ignore_inactive option being ignored in Filebeat's filestream input {pull}34770[34770] -- Fix TestMultiEventForEOFRetryHandlerInput unit test of CometD input {pull}34903[34903] -- Add input instance id to request trace filename for httpjson and cel inputs {pull}35024[35024] -- Fixes "Can only start an input when all related states are finished" error when running under Elastic-Agent {pull}35250[35250] {issue}33653[33653] -- [system] sync system/auth dataset with system integration 1.29.0. {pull}35581[35581] -- [GCS Input] - Fixed an issue where bucket_timeout was being applied to the entire bucket poll interval and not individual bucket object read operations. Fixed a map write concurrency issue arising from data races when using a high number of workers. Fixed the flaky tests that were present in the GCS test suit. {pull}35605[35605] -- Fix filestream false positive log error "filestream input with ID 'xyz' already exists" {issue}31767[31767] -- Fix error message formatting from filestream input. {pull}35658[35658] -- Fix error when trying to use `include_message` parser {issue}35440[35440] -- Fix handling of IPv6 unspecified addresses in TCP input. {issue}35064[35064] {pull}35637[35637] -- Fixed a minor code error in the GCS input scheduler where a config value was being used directly instead of the source struct. {pull}35729[35729] -- Improve error reporting and fix IPv6 handling of TCP and UDP metric collection. {pull}35772[35772] -- Fix CEL input JSON marshalling of nested objects. {issue}35763[35763] {pull}35774[35774] -- Fix metric collection in GCPPubSub input. {pull}35773[35773] -- Fix end point deregistration in http_endpoint input. {issue}35899[35899] {pull}35903[35903] -- Fix duplicate ID panic in filestream metrics. {issue}35964[35964] {pull}35972[35972] -- Improve error reporting and fix IPv6 handling of TCP and UDP metric collection. {pull}35996[35996] -- Fix handling of NUL-terminated log lines in Fortinet Firewall module. {issue}36026[36026] {pull}36027[36027] -- Make redact field configuration recommended in CEL input and log warning if missing. {pull}36008[36008] -- Fix handling of region name configuration in awss3 input {pull}36034[36034] -- Fixed concurrency and flakey tests issue in azure blob storage input. {issue}35983[35983] {pull}36124[36124] -- Fix panic when sqs input metrics getter is invoked {pull}36101[36101] {issue}36077[36077] -- Make CEL input's `now` global variable static for evaluation lifetime. {pull}36107[36107] -- Update mito CEL extension library to v1.5.0. {pull}36146[36146] -- Filter out duplicate paths resolved from matching globs. {issue}36253[36253] {pull}36256[36256] -- Fix handling of TCP/UDP address resolution during metric initialization. {issue}35064[35064] {pull}36287[36287] -- Fix handling of Juniper SRX structured data when there is no leading junos element. {issue}36270[36270] {pull}36308[36308] -- Remove erroneous error log in GCPPubSub input. {pull}36296[36296] -- Fix Filebeat Cisco module with missing escape character {issue}36325[36325] {pull}36326[36326] -- Fix panic when redact option is not provided to CEL input. {issue}36387[36387] {pull}36388[36388] -- Remove 'onFilteredOut' and 'onDroppedOnPublish' callback logs {issue}36299[36299] {pull}36399[36399] -- Added a fix for Crowdstrike pipeline handling process arrays {pull}36496[36496] -- Revert error introduced in {pull}35734[35734] when symlinks can't be resolved in filestream. {pull}36557[36557] *Heartbeat* @@ -82,8 +46,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Packetbeat* -- Fix panic in HTTP protocol parsing when host header has empty host part. {issue}36497[36497] {issue}36518[36518] -- Fix default cache size calculation. {pull}36723[36723] *Winlogbeat* @@ -104,7 +66,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Filebeat* -- Re-use buffers to optimise memory allocation in fingerprint mode of filestream {pull}36736[36736] *Heartbeat* @@ -145,3 +106,6 @@ https://github.com/elastic/beats/compare/v7.0.0-alpha2...master[Check the HEAD d *Functionbeat* ==== Known Issue + + + diff --git a/libbeat/docs/release.asciidoc b/libbeat/docs/release.asciidoc index 0b27de556466..e17d4494802d 100644 --- a/libbeat/docs/release.asciidoc +++ b/libbeat/docs/release.asciidoc @@ -8,6 +8,7 @@ This section summarizes the changes in each release. Also read <> for more detail about changes that affect upgrade. +* <> * <> * <> * <> From fe16a72ea19d56a25019eae11104c6c6da0e9b50 Mon Sep 17 00:00:00 2001 From: Pierre HILBERT Date: Mon, 9 Oct 2023 17:00:23 +0200 Subject: [PATCH 2/4] Update CHANGELOG.asciidoc --- CHANGELOG.asciidoc | 82 ---------------------------------------------- 1 file changed, 82 deletions(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index 8950bd37dc01..8d2609505a61 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -12,32 +12,12 @@ https://github.com/elastic/beats/compare/v7.17.13\...v7.17.14[View commits] *Affecting all Beats* - The Elasticsearch output now enables compression by default. This decreases network data usage by an average of 70-80%, in exchange for 20-25% increased CPU use and ~10% increased ingestion time. The previous default can be restored by setting the flag `compression_level: 0` under `output.elasticsearch`. {pull}36681[36681] - -*Auditbeat* - -*Filebeat* - -*Heartbeat* - -*Metricbeat* - - -*Packetbeat* - -*Winlogbeat* - - -*Functionbeat* - ==== Bugfixes *Affecting all Beats* - Eliminate cloning of event in deepUpdate {pull}35945[35945] -*Auditbeat* - - *Filebeat* - [Gcs Input] - Added missing locks for safe concurrency {pull}34914[34914] @@ -72,79 +52,17 @@ https://github.com/elastic/beats/compare/v7.17.13\...v7.17.14[View commits] - Added a fix for Crowdstrike pipeline handling process arrays {pull}36496[36496] - Revert error introduced in {pull}35734[35734] when symlinks can't be resolved in filestream. {pull}36557[36557] -*Heartbeat* - - -*Metricbeat* - - *Packetbeat* - Fix panic in HTTP protocol parsing when host header has empty host part. {issue}36497[36497] {issue}36518[36518] - Fix default cache size calculation. {pull}36723[36723] -*Winlogbeat* - - -*Functionbeat* - -*Elastic Logging Plugin* - - ==== Added -*Affecting all Beats* - - - -*Auditbeat* - - *Filebeat* - Re-use buffers to optimise memory allocation in fingerprint mode of filestream {pull}36736[36736] -*Heartbeat* - - -*Metricbeat* - - -*Packetbeat* - - -*Functionbeat* - - -*Winlogbeat* - - - -*Elastic Log Driver* - - -==== Deprecated - -*Affecting all Beats* - - -*Filebeat* - - -*Heartbeat* - -*Metricbeat* - - -*Packetbeat* - -*Winlogbeat* - -*Functionbeat* - -==== Known Issue - - [[release-notes-7.17.13]] === Beats version 7.17.13 From 5602e019e864bddcedb697323849096da4a66830 Mon Sep 17 00:00:00 2001 From: Brandon Morelli Date: Tue, 10 Oct 2023 06:16:21 -0700 Subject: [PATCH 3/4] Apply suggestions from code review Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> --- CHANGELOG.asciidoc | 10 +++++----- 1 file changed, 5 insertions(+), 5 deletions(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index 8d2609505a61..c4a02d0f6c12 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -21,11 +21,11 @@ https://github.com/elastic/beats/compare/v7.17.13\...v7.17.14[View commits] *Filebeat* - [Gcs Input] - Added missing locks for safe concurrency {pull}34914[34914] -- Fix the ignore_inactive option being ignored in Filebeat's filestream input {pull}34770[34770] +- Fix the `ignore_inactive` option being ignored in Filebeat's filestream input {pull}34770[34770] - Fix TestMultiEventForEOFRetryHandlerInput unit test of CometD input {pull}34903[34903] -- Add input instance id to request trace filename for httpjson and cel inputs {pull}35024[35024] +- Add input instance ID to request trace filename for httpjson and cel inputs {pull}35024[35024] - Fixes "Can only start an input when all related states are finished" error when running under Elastic-Agent {pull}35250[35250] {issue}33653[33653] -- [GCS Input] - Fixed an issue where bucket_timeout was being applied to the entire bucket poll interval and not individual bucket object read operations. Fixed a map write concurrency issue arising from data races when using a high number of workers. Fixed the flaky tests that were present in the GCS test suit. {pull}35605[35605] +- [GCS Input] - Fixed an issue where `bucket_timeout` was being applied to the entire bucket poll interval and not individual bucket object read operations. Fixed a map write concurrency issue arising from data races when using a high number of workers. Fixed the flaky tests that were present in the GCS test suit. {pull}35605[35605] - Fix error message formatting from filestream input. {pull}35658[35658] - Fix error when trying to use `include_message` parser {issue}35440[35440] - Fix handling of IPv6 unspecified addresses in TCP input. {issue}35064[35064] {pull}35637[35637] @@ -33,13 +33,13 @@ https://github.com/elastic/beats/compare/v7.17.13\...v7.17.14[View commits] - Improve error reporting and fix IPv6 handling of TCP and UDP metric collection. {pull}35772[35772] - Fix CEL input JSON marshalling of nested objects. {issue}35763[35763] {pull}35774[35774] - Fix metric collection in GCPPubSub input. {pull}35773[35773] -- Fix end point deregistration in http_endpoint input. {issue}35899[35899] {pull}35903[35903] +- Fix end point deregistration in `http_endpoint` input. {issue}35899[35899] {pull}35903[35903] - Fix duplicate ID panic in filestream metrics. {issue}35964[35964] {pull}35972[35972] - Improve error reporting and fix IPv6 handling of TCP and UDP metric collection. {pull}35996[35996] - Fix handling of NUL-terminated log lines in Fortinet Firewall module. {issue}36026[36026] {pull}36027[36027] - Make redact field configuration recommended in CEL input and log warning if missing. {pull}36008[36008] - Fix handling of region name configuration in awss3 input {pull}36034[36034] -- Fixed concurrency and flakey tests issue in azure blob storage input. {issue}35983[35983] {pull}36124[36124] +- Fixed concurrency and flakey tests issue in Azure Blob Storage input. {issue}35983[35983] {pull}36124[36124] - Fix panic when sqs input metrics getter is invoked {pull}36101[36101] {issue}36077[36077] - Make CEL input's `now` global variable static for evaluation lifetime. {pull}36107[36107] - Update mito CEL extension library to v1.5.0. {pull}36146[36146] From 47e3b78b186fd7dec95e8c2aec763507bdbcd715 Mon Sep 17 00:00:00 2001 From: Brandon Morelli Date: Tue, 10 Oct 2023 06:16:31 -0700 Subject: [PATCH 4/4] Update CHANGELOG.asciidoc Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> --- CHANGELOG.asciidoc | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/CHANGELOG.asciidoc b/CHANGELOG.asciidoc index c4a02d0f6c12..225b97d45bb9 100644 --- a/CHANGELOG.asciidoc +++ b/CHANGELOG.asciidoc @@ -44,7 +44,7 @@ https://github.com/elastic/beats/compare/v7.17.13\...v7.17.14[View commits] - Make CEL input's `now` global variable static for evaluation lifetime. {pull}36107[36107] - Update mito CEL extension library to v1.5.0. {pull}36146[36146] - Fix handling of TCP/UDP address resolution during metric initialization. {issue}35064[35064] {pull}36287[36287] -- Fix handling of Juniper SRX structured data when there is no leading junos element. {issue}36270[36270] {pull}36308[36308] +- Fix handling of Juniper SRX structured data when there is no leading Junos element. {issue}36270[36270] {pull}36308[36308] - Remove erroneous error log in GCPPubSub input. {pull}36296[36296] - Fix Filebeat Cisco module with missing escape character {issue}36325[36325] {pull}36326[36326] - Fix panic when redact option is not provided to CEL input. {issue}36387[36387] {pull}36388[36388]