Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

packages/apm: remove data streams in 8.15.0 #9949

Merged
merged 2 commits into from
May 27, 2024

Conversation

axw
Copy link
Member

@axw axw commented May 23, 2024

Proposed commit message

As of elastic/elasticsearch#108860 (due to be released in 8.15.0), the apm-data Elasticsearch plugin is enabled by default and will take care of installing index templates and ingest pipelines for APM; the integration package no longer needs to (nor should) install its own.

With this change, the integration package is optional for APM: it is still useful for running with Fleet, but otherwise users may rely on templates/pipelines being set up by Elasticsearch.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Author's Checklist

  • Test installing this version of the integration package and ingesting data with APM Server

How to test this PR locally

  1. Start Elasticsearch, Kibana, and APM Server (binary)
  2. Install the APM integration package
  3. Ingest data through APM Server, confirm it is indexed correctly/visualised correctly in Kibana

Related issues

elastic/apm-server#11529

@axw axw added the enhancement New feature or request label May 23, 2024
As of elastic/elasticsearch#108860
(due to be released in 8.15.0), the apm-data Elasticsearch
plugin is enabled by default and will take care of installing
index templates and ingest pipelines for APM; the integration
package no longer needs to (nor should) install its own.

With this change, the integration package is optional for APM:
it is still useful for running with Fleet, but otherwise users
may rely on templates/pipelines being set up by Elasticsearch.
@@ -2,7 +2,6 @@

Elastic APM is an application performance monitoring system built on the Elastic Stack. It allows you to monitor software services and applications in real-time, by collecting detailed performance information on response time for incoming requests, database queries, calls to caches, external HTTP requests, and more.

The APM integration installs templates and pipelines that validate and process APM data.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Removing this line obscures what is this integration purpose after these changes. May we replace it instead providing guidance on it's purpose?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Fair enough, I'll have a think about what to replace it with.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

thank you!

Comment on lines +5 to +6
The APM integration enables central management of APM Server with Fleet.
To learn more, see [Fleet-managed APM Server](https://ela.st/apm-fleet).
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@simitt FYI I've updated the docs here, and created a new shorted link

@axw axw requested a review from endorama May 24, 2024 02:48
@elasticmachine
Copy link

💚 Build Succeeded

History

Copy link

Quality Gate passed Quality Gate passed

Issues
0 New issues
0 Fixed issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarQube

@axw axw merged commit ed8e0c9 into elastic:main May 27, 2024
5 checks passed
@axw axw deleted the apm-package-rm-datastreams branch May 27, 2024 03:02
crespocarlos added a commit to elastic/kibana that referenced this pull request May 28, 2024
…184343)

closes [#184333](#184333)

## Summary

This PR updates the index template names that the diagnostics page
verifies the existence of.

After the changes made in the [APM
package](elastic/integrations#9949), to favor
APM indices and ingest pipelines configured by elasticsearch, the index
templates now have a `@template` suffix. eg:
`metrics-apm.service_destination.1m` is now
`metrics-apm.service_destination.1m@template`

<img width="709" alt="image"
src="https://github.com/elastic/kibana/assets/2767137/4608da37-679a-411c-85c4-409b2af62cec">

<img width="709" alt="image"
src="https://github.com/elastic/kibana/assets/2767137/837c8ae0-2c92-4763-811c-22fc619ba5f6">

**When no indices are found**
<img width="709" alt="image"
src="https://github.com/elastic/kibana/assets/2767137/33d7264a-dc90-49a0-a3f4-f169dcbda861">


### How to test

- Start a local ES and kibana instance
- navigate to
`/apm/diagnostics/index-templates?rangeFrom=now-15m&rangeTo=now`

---------

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
rshen91 pushed a commit to rshen91/kibana that referenced this pull request May 30, 2024
…lastic#184343)

closes [elastic#184333](elastic#184333)

## Summary

This PR updates the index template names that the diagnostics page
verifies the existence of.

After the changes made in the [APM
package](elastic/integrations#9949), to favor
APM indices and ingest pipelines configured by elasticsearch, the index
templates now have a `@template` suffix. eg:
`metrics-apm.service_destination.1m` is now
`metrics-apm.service_destination.1m@template`

<img width="709" alt="image"
src="https://github.com/elastic/kibana/assets/2767137/4608da37-679a-411c-85c4-409b2af62cec">

<img width="709" alt="image"
src="https://github.com/elastic/kibana/assets/2767137/837c8ae0-2c92-4763-811c-22fc619ba5f6">

**When no indices are found**
<img width="709" alt="image"
src="https://github.com/elastic/kibana/assets/2767137/33d7264a-dc90-49a0-a3f4-f169dcbda861">


### How to test

- Start a local ES and kibana instance
- navigate to
`/apm/diagnostics/index-templates?rangeFrom=now-15m&rangeTo=now`

---------

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
bmorelli25 pushed a commit to bmorelli25/integrations that referenced this pull request Jun 3, 2024
* packages/apm: remove data streams in 8.15.0

As of elastic/elasticsearch#108860
(due to be released in 8.15.0), the apm-data Elasticsearch
plugin is enabled by default and will take care of installing
index templates and ingest pipelines for APM; the integration
package no longer needs to (nor should) install its own.

With this change, the integration package is optional for APM:
it is still useful for running with Fleet, but otherwise users
may rely on templates/pipelines being set up by Elasticsearch.

* Update docs
@andrewkroh andrewkroh added the Integration:apm Elastic APM label Jul 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Integration:apm Elastic APM
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants