From 174d89260b5194ef30184f6ddece8467d370ee8c Mon Sep 17 00:00:00 2001 From: yuanrui Date: Fri, 5 Jan 2024 19:02:07 +0800 Subject: [PATCH] changefeed: add and refine alerts --- tidb-cloud/monitor-built-in-alerting.md | 8 +++++--- 1 file changed, 5 insertions(+), 3 deletions(-) diff --git a/tidb-cloud/monitor-built-in-alerting.md b/tidb-cloud/monitor-built-in-alerting.md index 5944315f63d3c..d25108798c4f6 100644 --- a/tidb-cloud/monitor-built-in-alerting.md +++ b/tidb-cloud/monitor-built-in-alerting.md @@ -109,6 +109,8 @@ The following table provides the TiDB Cloud built-in alert conditions and the co ### Changefeed alerts -| Condition | Recommended Action | -|:--- |:--- | -| Changefeed processor checkpoint delay more than 600 seconds | Check if the downstream system and network configuration are functioning normally, and rule out the possibility of an indexed table. | +| Condition | Recommended Action | +|:--------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| +| Changefeed latency is more than 600 seconds | Please check status of the Changefeed in ListPage and DetailPage of TiDB Cloud Console, there may be some error messages can help you diagnose what is happening.
There are several reasons can trigger this alarm.
1. The overall traffic of upstream has increased, and the existing Changefeed specification is insufficient to handle it. If it is temporary traffic, it will automatically recover after a period of time. If it is continuous traffic, please scale up the Changefeed.
2. Downstream and network abnormal, if it is this problem, please correct it first.
3. Tables lack of indexes if downstream is RDS, which may cause low write performance and high latency, please add necessary indexes to upstream or downstream.
If the problem can not be fixed, please contact our support team directly for further assistance. | +| Changefeed status is failed | Please check status of the Changefeed in ListPage and DetailPage of TiDB Cloud Console, there may be some error messages can help you diagnose what is happening.
If the problem can not be fixed from your side, please contact our support team directly for further assistance. | +| Changefeed status is warning | Please check status of the Changefeed in ListPage and DetailPage of TiDB Cloud Console, there may be some error messages can help you diagnose what is happening.
If the problem can not be fixed from your side, please contact our support team directly for further assistance. |