From dfa55fd651cebd18678a22e66d60811d08506d8e Mon Sep 17 00:00:00 2001 From: "mergify[bot]" <37929162+mergify[bot]@users.noreply.github.com> Date: Mon, 29 Jan 2024 08:52:39 -0500 Subject: [PATCH] Add known issue for AWS S3 performance regression in 8.12 (#865) (#867) * Add known issue for S3 performance regression. * Update docs/en/ingest-management/release-notes/release-notes-8.12.asciidoc Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> * Change wording slightly. --------- Co-authored-by: David Kilfoyle <41695641+kilfoyle@users.noreply.github.com> (cherry picked from commit 6a059ce919f4f0b2b073cf7c6ea64f6eadcb53df) Co-authored-by: Craig MacKenzie --- .../release-notes/release-notes-8.12.asciidoc | 20 +++++++++++++++++++ 1 file changed, 20 insertions(+) diff --git a/docs/en/ingest-management/release-notes/release-notes-8.12.asciidoc b/docs/en/ingest-management/release-notes/release-notes-8.12.asciidoc index b3eabc374..94b520d03 100644 --- a/docs/en/ingest-management/release-notes/release-notes-8.12.asciidoc +++ b/docs/en/ingest-management/release-notes/release-notes-8.12.asciidoc @@ -230,6 +230,26 @@ sudo systemctl start elastic-agent ==== +[[known-issue-37754]] +.Performance regression in AWS S3 inputs using SQS notification +[%collapsible] +==== + +*Details* + +In 8.12 the default memory queue flush interval was raised from 1 second to 10 seconds. In many configurations this improves performance because it allows the output to batch more events per round trip, which improves efficiency. However, the SQS input has an extra bottleneck that interacts badly with the new value. + +For more details see {beats-issue}37754[#37754]. + +*Impact* + + +If you are using the Elasticsearch output, and your configuration uses a performance preset, switch it to `preset: latency`. If you use no preset or use `preset: custom`, then set `queue.mem.flush.timeout: 1` in your output configuration. + +If you are not using the Elasticsearch output, set `queue.mem.flush.timeout: 1` in your output configuration. + +To configure the output parameters for a {fleet}-managed agent, see <>. For a standalone agent, see <>. + +==== [[known-issue-sec8366]] .{fleet} setup can fail when there are more than one thousand {agent} policies