Skip to content

Commit

Permalink
changefeed: add and refine alerts
Browse files Browse the repository at this point in the history
  • Loading branch information
@grovecai
grovecai committed Jan 5, 2024
1 parent 9de4492 commit 174d892
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions tidb-cloud/monitor-built-in-alerting.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -109,6 +109,8 @@ The following table provides the TiDB Cloud built-in alert conditions and the co

### Changefeed alerts

| Condition | Recommended Action |
|:--- |:--- |
| Changefeed processor checkpoint delay more than 600 seconds | Check if the downstream system and network configuration are functioning normally, and rule out the possibility of an indexed table. |
| Condition | Recommended Action |
|:--------------------------------------------|:------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Changefeed latency is more than 600 seconds | Please check status of the Changefeed in ListPage and DetailPage of TiDB Cloud Console, there may be some error messages can help you diagnose what is happening. <br> There are several reasons can trigger this alarm. <br> 1. The overall traffic of upstream has increased, and the existing Changefeed specification is insufficient to handle it. If it is temporary traffic, it will automatically recover after a period of time. If it is continuous traffic, please scale up the Changefeed. <br> 2. Downstream and network abnormal, if it is this problem, please correct it first. <br> 3. Tables lack of indexes if downstream is RDS, which may cause low write performance and high latency, please add necessary indexes to upstream or downstream. <br> If the problem can not be fixed, please contact our support team directly for further assistance. |
| Changefeed status is failed | Please check status of the Changefeed in ListPage and DetailPage of TiDB Cloud Console, there may be some error messages can help you diagnose what is happening. <br> If the problem can not be fixed from your side, please contact our support team directly for further assistance. |
| Changefeed status is warning | Please check status of the Changefeed in ListPage and DetailPage of TiDB Cloud Console, there may be some error messages can help you diagnose what is happening. <br> If the problem can not be fixed from your side, please contact our support team directly for further assistance. |

0 comments on commit 174d892

Please sign in to comment.