You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: tidb-cloud/changefeed-sink-to-apache-kafka.md
+3-3Lines changed: 3 additions & 3 deletions
Original file line number
Diff line number
Diff line change
@@ -52,7 +52,7 @@ Currently, TiDB Cloud supports Private Connect for generic Kafka only. It does n
52
52
- Endpoint Service Name
53
53
- Bootstrap Ports
54
54
55
-
- If your Apache Kafka service is hosted on Google Cloud, follow [Set Up Self Hosted Kafka Private Service Connect in Google Cloud](/tidb-cloud/setup-self-hosted-kafka-psc.md) to ensure that the network connection is properly configured. After setup, provide the following information in the TiDB Cloud console to create the changefeedd:
55
+
- If your Apache Kafka service is hosted on Google Cloud, follow [Set Up Self Hosted Kafka Private Service Connect in Google Cloud](/tidb-cloud/setup-self-hosted-kafka-psc.md) to ensure that the network connection is properly configured. After setup, provide the following information in the TiDB Cloud console to create the changefeed:
56
56
57
57
- ID in Kafka Advertised Listener Pattern
58
58
- Service Attachment
@@ -108,13 +108,13 @@ For example, if your Kafka cluster is in Confluent Cloud, you can see [Resources
108
108
1. Authorize the TiDB Cloud AWS account to create an endpoint for your endpoint service. The TiDB Cloud AWS account ID is provided in the tip on the web page.
109
109
2. Make sure you select the same **Number of AZs** and **Suggested Kafka Endpoint Service AZs**, and fill the same unique ID in **Kafka Advertised Listener Pattern** when you [set up self hosted Kafka Private Link service in AWS](/tidb-cloud/setup-self-hosted-kafka-pls.md) in the **Network** section.
110
110
3. Fill the **Endpoint Service Name** which is configured in [Setup Self Hosted Kafka Private Link Service in AWS](/tidb-cloud/setup-self-hosted-kafka-pls.md).
111
-
4. Fill the **Boostrap Ports**. It is recommended that you set at least one port for one AZ. You can use commas `,` to separate multiple ports.
111
+
4. Fill the **Bootstrap Ports**. It is recommended that you set at least one port for one AZ. You can use commas `,` to separate multiple ports.
112
112
113
113
- If you select **Private Service Connect**, do the following:
114
114
115
115
1. Ensure that you fill the same unique ID in **Kafka Advertised Listener Pattern** when you [Setup Self Hosted Kafka Private Service Connect in Google Cloud](/tidb-cloud/setup-self-hosted-kafka-psc.md) in **Network** section.
116
116
2. Fill the **Service Attachment** that you have configured in [Setup Self Hosted Kafka Private Service Connect in Google Cloud](/tidb-cloud/setup-self-hosted-kafka-psc.md)
117
-
3. Fill the **Boostrap Ports**. It is recommended that you provide more than one ports. You can use commas `,` to separate multiple ports.
117
+
3. Fill the **Bootstrap Ports**. It is recommended that you provide more than one port. You can use commas `,` to separate multiple ports.
118
118
119
119
2. Select an **Authentication** option according to your Kafka authentication configuration.
120
120
- If your Kafka does not require authentication, keep the default option **Disable**.
Copy file name to clipboardExpand all lines: tidb-cloud/setup-self-hosted-kafka-psc.md
+9-9Lines changed: 9 additions & 9 deletions
Original file line number
Diff line number
Diff line change
@@ -33,18 +33,18 @@ The document provides an example of connecting to a Kafka Private Link service d
33
33
- Manage Private Service Connect
34
34
- Connect to VM Nodes to configure Kafka nodes
35
35
36
-
2. Create a [TiDB Cloud Dedicated](/tidb-cloud/select-cluster-tier.md#tidb-cloud-dedicated) cluster in Google Cloud first. Ensure that Kafka deployment information is alligned with your TiDB cluster.
36
+
2. Create a [TiDB Cloud Dedicated](/tidb-cloud/select-cluster-tier.md#tidb-cloud-dedicated) cluster in Google Cloud first. Ensure that Kafka deployment information is aligned with your TiDB cluster.
37
37
38
38
1. In the [TiDB Cloud console](https://tidbcloud.com), navigate to the cluster overview page of the TiDB cluster, and then click **Changefeed** in the left navigation pane.
39
-
2. On the overview page, find the region of TiDB cluster. Ensure that your Kafka cluster will be deployed to the same region.
39
+
2. On the overview page, find the region of the TiDB cluster. Ensure that your Kafka cluster will be deployed to the same region.
40
40
3. Click **Create Changefeed**.
41
41
1. In **Target Type**, select **Kafka**.
42
42
2. In **Connectivity Method**, select **Private Service Connect**.
43
43
4. Note down the Google Cloud project in **Reminders before proceeding**. You will use it to authorize the auto-accept endpoint creation request from TiDB Cloud.
44
44
5. Note down the **Zones of TiDB Cluster**. You will deploy your TiDB cluster in these zones. It is recommended that you deploy Kafka in these zones to reduce cross-zone traffic.
45
45
6. Pick a unique **Kafka Advertised Listener Pattern** for your Kafka Private Service Connect service.
46
46
1. Input a unique random string. It can only include numbers or lowercase letters. You will use it to generate **Kafka Advertised Listener Pattern** later.
47
-
2. Click **Check usage and generate** to check if the random string is unique and generate **Kafka Advertised Listener Pattern** that will be used to assemble the EXTERNAL advertised listener for kafka brokers, or configure Kafka-proxy.
47
+
2. Click **Check usage and generate** to check if the random string is unique and generate **Kafka Advertised Listener Pattern** that will be used to assemble the EXTERNAL advertised listener for Kafka brokers, or configure Kafka-proxy.
48
48
49
49
Note down all the deployment information. You need to use it to configure your Kafka Private Service Connect service later.
50
50
@@ -75,7 +75,7 @@ Expose every Kafka broker to TiDB Cloud VPC with a unique port by using the PSC
75
75
76
76
You need to create two subnets for Kafka VPC, one for Kafka brokers, and the other for bastion node to make it easy to configure the Kafka cluster.
77
77
78
-
Go to the [Google Cloud console](https://cloud.google.com/cloud-console), and navigate to the [VPC networks](https://console.cloud.google.com/networking/networks/list) page to create the Kafka VPC with following attributes:
78
+
Go to the [Google Cloud console](https://cloud.google.com/cloud-console), and navigate to the [VPC networks](https://console.cloud.google.com/networking/networks/list) page to create the Kafka VPC with the following attributes:
79
79
80
80
-**Name**: `kafka-vpc`
81
81
- Subnets
@@ -149,7 +149,7 @@ Go to the [VM instances](https://console.cloud.google.com/compute/instances) pag
149
149
150
150
```shell
151
151
# Run this command to authorize gcloud to access the Cloud Platform with Google user credentials
152
-
#Please following the instruction in output to finish the login
152
+
#Follow the instruction in output to finish the login
153
153
gcloud auth login
154
154
155
155
# Copy binaries to broker nodes
@@ -170,12 +170,12 @@ Go to the [VM instances](https://console.cloud.google.com/compute/instances) pag
170
170
2. Configure two **broker** listeners. INTERNAL for internal access; EXTERNAL for external access from TiDB Cloud.
171
171
172
172
2. For `advertised.listeners`, do the following:
173
-
1. Configure an INTERNAL advertised listener for every broker with internal ip of broker node, advertise internal Kafka clients use this address to visit the broker.
173
+
1. Configure an INTERNAL advertised listener for every broker with internal IP of broker node, advertise internal Kafka clients use this address to visit the broker.
174
174
2. Configure an EXTERNAL advertised listener based on **Kafka Advertised Listener Pattern** you get from TiDB Cloud for every broker node to help TiDB Cloud differentiate between different brokers. Different EXTERNAL advertised listeners help Kafka clients from TiDB Cloud side route requests to the right broker.
175
175
- `<port>` differentiates brokers from Kafka Private Service Connect access point. Plan a port range for EXTERNAL advertised listeners of all brokers. These ports do not have to be actual ports listened on brokers. They are ports listened on the load balancer for Private Service Connect that will forward requests to different brokers.
176
176
- It is recommended to configure different broker IDs for different brokers to make it easy for troubleshooting.
177
177
178
-
3. The planing values:
178
+
3. The planning values:
179
179
- CONTROLLER port: `29092`
180
180
- INTERNAL port: `9092`
181
181
- EXTERNAL: `39092`
@@ -654,7 +654,7 @@ Assume that you already have a Kafka cluster running in the same region as the T
654
654
- **Name**: `proxy-psc-subnet`
655
655
- **VPC Network**: your network
656
656
- **Region**: `us-west1`
657
-
- **IPv4 range**: set the CIDR based on your network planing
657
+
- **IPv4 range**: set the CIDR based on your network planning
658
658
- **Accepted projects**: the Google Cloud project of TiDB Cloud you get in [Prerequisites](#prerequisites), for example `tidbcloud-prod-000`.
659
659
660
660
3. Navigate to the detail page of the **kafka-proxy-psc**. Note down the `Service attachment`, forexample `projects/tidbcloud-dp-stg-000/regions/us-west1/serviceAttachments/kafka-proxy-psc`, which will be usedin TiDB Cloud to connect to this PSC.
@@ -675,7 +675,7 @@ Assume that you already have a Kafka cluster running in the same region as the T
675
675
676
676
2. After you proceed to the **Configure the changefeed target**>**Connectivity Method**>**Private Service Connect**, fill in the following fields with corresponding values and others fields as needed.
677
677
678
-
- **Kafka Advertised Listener Pattern**: `abc`. The same as the unique random string you use to generate **Kafka Advertised Listener Pattern**in [Prerequistes](#prerequisites).
678
+
- **Kafka Advertised Listener Pattern**: `abc`. The same as the unique random string you use to generate **Kafka Advertised Listener Pattern**in [Prerequisites](#prerequisites).
679
679
- **Service Attachment**: the kafka-proxy service attachment of PSC, for example `projects/tidbcloud-dp-stg-000/regions/us-west1/serviceAttachments/kafka-proxy-psc`.
0 commit comments