From 9c1947f31afcc418b796b9f96e70c241d1fc07ba Mon Sep 17 00:00:00 2001 From: Carson Ip Date: Wed, 20 Sep 2023 17:57:34 +0100 Subject: [PATCH] docs: Add tail-based sampling common problem (#11662) Document TBS high memory and high disk IO common problem. (cherry picked from commit 1da1f38da2f1ce3bb022d634d5d4f5477ea33f19) --- docs/common-problems.asciidoc | 11 +++++++++++ 1 file changed, 11 insertions(+) diff --git a/docs/common-problems.asciidoc b/docs/common-problems.asciidoc index 53885cf3522..d0b3e44e65b 100644 --- a/docs/common-problems.asciidoc +++ b/docs/common-problems.asciidoc @@ -8,6 +8,7 @@ This section describes common problems you might encounter when using a Fleet-ma * <> * <> * <> +* <> [float] [[no-data-indexed]] @@ -187,3 +188,13 @@ In the agent logs, you won't see a sign of failures as the APM server asynchrono ---- {\"type\":\"illegal_argument_exception\",\"reason\":\"Limit of total fields [1000] in [INDEX_NAME] has been exceeded\"} ---- + +[[tail-based-sampling-memory-disk-io]] +[float] +=== Tail-based sampling causing high system memory usage and high disk IO + +Tail-based sampling requires minimal memory to run, and there should not be a noticeable increase in RSS memory usage. +However, since tail-based sampling writes data to disk, +it is possible to see a significant increase in OS page cache memory usage due to disk IO. +If you see a drop in throughput and excessive disk activity after enabling tail-based sampling, +please ensure that there is enough memory headroom in the system for OS page cache to perform disk IO efficiently.