Skip to content

Commit

Permalink
migration: refine titles about migrating small datasets and large dat…
Browse files Browse the repository at this point in the history
…asets from MySQL to TiDB (pingcap#15469)
  • Loading branch information
hfxsd authored Nov 28, 2023
1 parent 321c013 commit 951b865
Show file tree
Hide file tree
Showing 9 changed files with 20 additions and 24 deletions.
4 changes: 2 additions & 2 deletions TOC.md
Original file line number Diff line number Diff line change
Expand Up @@ -133,8 +133,8 @@
- [Import Best Practices](/tidb-lightning/data-import-best-practices.md)
- Migration Scenarios
- [Migrate from Aurora](/migrate-aurora-to-tidb.md)
- [Migrate MySQL of Small Datasets](/migrate-small-mysql-to-tidb.md)
- [Migrate MySQL of Large Datasets](/migrate-large-mysql-to-tidb.md)
- [Migrate Small Datasets from MySQL](/migrate-small-mysql-to-tidb.md)
- [Migrate Large Datasets from MySQL](/migrate-large-mysql-to-tidb.md)
- [Migrate and Merge MySQL Shards of Small Datasets](/migrate-small-mysql-shards-to-tidb.md)
- [Migrate and Merge MySQL Shards of Large Datasets](/migrate-large-mysql-shards-to-tidb.md)
- [Migrate from CSV Files](/migrate-from-csv-files-to-tidb.md)
Expand Down
4 changes: 2 additions & 2 deletions filter-binlog-event.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@ summary: Learn how to filter binlog events when migrating data.

This document describes how to filter binlog events when you use DM to perform continuous incremental data replication. For the detailed replication instructions, refer to the following documents by scenarios:

- [Migrate MySQL of Small Datasets to TiDB](/migrate-small-mysql-to-tidb.md)
- [Migrate MySQL of Large Datasets to TiDB](/migrate-large-mysql-to-tidb.md)
- [Migrate Small Datasets from MySQL to TiDB](/migrate-small-mysql-to-tidb.md)
- [Migrate Large Datasets from MySQL to TiDB](/migrate-large-mysql-to-tidb.md)
- [Migrate and Merge MySQL Shards of Small Datasets to TiDB](/migrate-small-mysql-shards-to-tidb.md)
- [Migrate and Merge MySQL Shards of Large Datasets to TiDB](/migrate-large-mysql-shards-to-tidb.md)

Expand Down
4 changes: 2 additions & 2 deletions filter-dml-event.md
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@ summary: Learn how to filter DML events using SQL expressions.

This document introduces how to filter binlog events using SQL expressions when you use DM to perform continuous incremental data replication. For the detailed replication instruction, refer to the following documents:

- [Migrate MySQL of Small Datasets to TiDB](/migrate-small-mysql-to-tidb.md)
- [Migrate MySQL of Large Datasets to TiDB](/migrate-large-mysql-to-tidb.md)
- [Migrate Small Datasets from MySQL to TiDB](/migrate-small-mysql-to-tidb.md)
- [Migrate Large Datasets from MySQL to TiDB](/migrate-large-mysql-to-tidb.md)
- [Migrate and Merge MySQL Shards of Small Datasets to TiDB](/migrate-small-mysql-shards-to-tidb.md)
- [Migrate and Merge MySQL Shards of Large Datasets to TiDB](/migrate-large-mysql-shards-to-tidb.md)

Expand Down
6 changes: 3 additions & 3 deletions migrate-large-mysql-to-tidb.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,9 @@
---
title: Migrate MySQL of Large Datasets to TiDB
summary: Learn how to migrate MySQL of large datasets to TiDB.
title: Migrate Large Datasets from MySQL to TiDB
summary: Learn how to migrate large datasets from MySQL to TiDB.
---

# Migrate MySQL of Large Datasets to TiDB
# Migrate Large Datasets from MySQL to TiDB

When the data volume to be migrated is small, you can easily [use DM to migrate data](/migrate-small-mysql-to-tidb.md), both for full migration and incremental replication. However, because DM imports data at a slow speed (30~50 GiB/h), when the data volume is large, the migration might take a long time. "Large datasets" in this document usually mean data around one TiB or more.

Expand Down
8 changes: 4 additions & 4 deletions migrate-small-mysql-to-tidb.md
Original file line number Diff line number Diff line change
@@ -1,12 +1,12 @@
---
title: Migrate MySQL of Small Datasets to TiDB
summary: Learn how to migrate MySQL of small datasets to TiDB.
title: Migrate Small Datasets from MySQL to TiDB
summary: Learn how to migrate small datasets from MySQL to TiDB.
aliases: ['/tidb/dev/usage-scenario-incremental-migration/']
---

# Migrate MySQL of Small Datasets to TiDB
# Migrate Small Datasets from MySQL to TiDB

This document describes how to use TiDB Data Migration (DM) to migrate MySQL of small datasets to TiDB in the full migration mode and incremental replication mode. "Small datasets" in this document mean data size less than 1 TiB.
This document describes how to use TiDB Data Migration (DM) to migrate small datasets from MySQL to TiDB in the full migration mode and incremental replication mode. "Small datasets" in this document mean data size less than 1 TiB.

The migration speed varies from 30 GB/h to 50 GB/h, depending on multiple factors such as the number of indexes in the table schema, hardware, and network environment. <!--The migration process using DM is shown in the figure below.-->

Expand Down
4 changes: 2 additions & 2 deletions migrate-with-more-columns-downstream.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,8 +8,8 @@ aliases: ['/tidb/dev/usage-scenario-downstream-more-columns/']

This document provides the additional steps to be taken when you migrate data to a downstream TiDB table with more columns than the corresponding upstream table. For regular migration steps, see the following migration scenarios:

- [Migrate MySQL of Small Datasets to TiDB](/migrate-small-mysql-to-tidb.md)
- [Migrate MySQL of Large Datasets to TiDB](/migrate-large-mysql-to-tidb.md)
- [Migrate Small Datasets from MySQL to TiDB](/migrate-small-mysql-to-tidb.md)
- [Migrate Large Datasets from MySQL to TiDB](/migrate-large-mysql-to-tidb.md)
- [Migrate and Merge MySQL Shards of Small Datasets to TiDB](/migrate-small-mysql-shards-to-tidb.md)
- [Migrate and Merge MySQL Shards of Large Datasets to TiDB](/migrate-large-mysql-shards-to-tidb.md)

Expand Down
4 changes: 2 additions & 2 deletions migrate-with-pt-ghost.md
Original file line number Diff line number Diff line change
Expand Up @@ -11,8 +11,8 @@ When using DM to migrate data from MySQL to TiDB, you can enbale `online-ddl` to

For the detailed replication instructions, refer to the following documents by scenarios:

- [Migrate MySQL of Small Datasets to TiDB](/migrate-small-mysql-to-tidb.md)
- [Migrate MySQL of Large Datasets to TiDB](/migrate-large-mysql-to-tidb.md)
- [Migrate Small Datasets from MySQL to TiDB](/migrate-small-mysql-to-tidb.md)
- [Migrate Large Datasets from MySQL to TiDB](/migrate-large-mysql-to-tidb.md)
- [Migrate and Merge MySQL Shards of Small Datasets to TiDB](/migrate-small-mysql-shards-to-tidb.md)
- [Migrate and Merge MySQL Shards of Large Datasets to TiDB](/migrate-large-mysql-shards-to-tidb.md)

Expand Down
8 changes: 2 additions & 6 deletions migration-overview.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,13 +30,9 @@ When you migrate data from Aurora to a TiDB cluster deployed on AWS, your data m

## Migrate data from MySQL to TiDB

If cloud storage (S3) service is not used, the network connectivity is good, and the network latency is low, you can use the following method to migrate data from MySQL to TiDB.
If cloud storage (S3) service is not used, the network connectivity is good, and the network latency is low, you can follow instructions in [Migrate Small Datasets from MySQL to TiDB](/migrate-small-mysql-to-tidb.md) to migrate data from MySQL to TiDB.

- [Migrate MySQL of Small Datasets to TiDB](/migrate-small-mysql-to-tidb.md)

If you have a high demand on migration speed, or if the data size is large (for example, larger than 1 TiB), and you do not allow other applications to write to TiDB during the migration period, you can use TiDB Lightning to quickly import data. Then, you can use DM to replicate incremental data (binlog) based on your application needs.

- [Migrate MySQL of Large Datasets to TiDB](/migrate-large-mysql-to-tidb.md)
If you have a high demand on migration speed, or if the data size is large (for example, larger than 1 TiB), and you do not allow other applications to write to TiDB during the migration period, you can use TiDB Lightning to quickly import data. Then, you can use DM to replicate incremental data (binlog) based on your application needs. See [Migrate Large Datasets from MySQL to TiDB](/migrate-large-mysql-to-tidb.md).

## Migrate and merge MySQL shards into TiDB

Expand Down
2 changes: 1 addition & 1 deletion two-data-centers-in-one-city-deployment.md
Original file line number Diff line number Diff line change
Expand Up @@ -22,7 +22,7 @@ This section takes the example of a region where two availability zones AZ1 and

The architecture of the cluster deployment is as follows:

- The cluster has four replicas: two Voter replicas in AZ1, one Voter replica, and one Learner replica in AZ2. For the TiKV component, each rack has a proper label.
- The cluster has six replicas: three Voter replicas in AZ1, and two Voter replicas along with one Learner replica in AZ2. For the TiKV component, each rack has a proper label.
- The Raft protocol is adopted to ensure consistency and high availability of data, which is transparent to users.

![2-AZ-in-1-region architecture](/media/two-dc-replication-1.png)
Expand Down

0 comments on commit 951b865

Please sign in to comment.