Skip to content

Commit

Permalink
update tidb roadmap (#15194)
Browse files Browse the repository at this point in the history
  • Loading branch information
@samhld
samhld authored Nov 8, 2023
1 parent 00db862 commit 0b9064a
Showing 1 changed file with 34 additions and 79 deletions.
113 changes: 34 additions & 79 deletions tidb-roadmap.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -28,29 +28,22 @@ In the course of development, this roadmap is subject to change based on user ne
<td>
<ul>
<li>
<b>GA of Partitioned Raft KV storage engine</b><br /><i
>PB-scale clusters, increased write velocity, faster scaling operations, and improved compaction stability</i
>
<b>Distributed execution framework</b><br /><i>
In v7.2.0, TiDB introduced the distributed execution framework for background tasks (such as DDL and analyze). This is the foundation for parallelizing these tasks across compute nodes. v7.4.0 introduces global sorting in distributed re-organization tasks (such as DDL and import), which greatly mitigates extra resource consumption in storage. Optionally, external shared storage can be leveraged for simplicity and cost savings.</i>
</li>
<br />
<li>
<b>Augmented replica read</b><br /><i>
Reduced cross-AZ data transfer costs in TiKV
</i>
</li>
<br />
</ul>
</td>
<td>
<ul>
<li>
<b>Performance optimization framework for all applicable background tasks, like DDL, TTL, and cluster analysis</b><br />
<i>This distributes the workload of these operations throughout the cluster, leading to accelerated performance and reduced resource utilization on individual nodes. This framework already applies to the <code>ADD INDEX</code> operation</i>
<b>Enhancements to performance and generalizability of plan cache</b><br />
</li>
<br />
<li>
<b>GA of disaggregated storage and compute architecture and S3 shared storage in TiFlash</b><br />
<i>Enable more cost-effective and elastic HTAP</i>
<b>Dynamic node scaling via distributed execution framework</b><br />
<i>Automatically adjust node allocation to meet resource costs of background tasks, while maintaining stability and performance expectations</i>
</li>
<br />
<br />
Expand All @@ -62,6 +55,10 @@ In the course of development, this roadmap is subject to change based on user ne
<b>Unlimited transaction size</b>
</li>
<br />
<li>
<b>Federated query</b>
<br /><i>TiDB query planner support for multiple storage engines in HTAP use cases.</i>
</li>
<br />
</ul>
</td>
Expand All @@ -79,61 +76,28 @@ In the course of development, this roadmap is subject to change based on user ne
Control over how background tasks, such as imports, DDL, TTL, auto-analyze, and compactions, can affect foreground traffic
</i>
</li>
</ul>
</td>
<td>
<ul>
<li>
<b>Multi-tenancy</b>
<br /><i>Resource isolation on top of resource control</i>
</li>
<br />
</ul>
</td>
<td>
<ul>
<li>
<b>Enhanced TiDB memory management</b>
<b>Runaway query control</b><br /><i>
An operator-controlled way to greatly enhance performance stability for workloads with unexpectedly expensive queries
</i>
</li>
</ul>
</td>
</tr>
<tr>
<td>
<b>SQL</b>
<br /><i>Enhance functionality and compatibility</i>
</td>
<td>
<ul>
<li>
<b>MySQL 8.0 compatibility</b>
<b>Disaggregation of Placement Driver (PD)</b>
<br /><i>Enhance cluster scalability and resilience</i>
</li>
<br />
<li>
<b>Unified SQL interface for import, Backup & Restore, and PITR</b>
</li>
</ul>
</td>
<td>
<ul>
<li>
<b>Cascades framework for optimizer</b>
<br /><i>Improved framework for query optimization, and make the optimizer more extensible and future-proof</i>
</li>
</ul>
</td>
<td>
<ul>
<li>
<b>Federated query</b>
</li>
<br />
<li>
<b>Full text search & GIS support</b>
</li>
<br />
<li>
<b>User-defined functions</b>
<b>Multi-tenancy</b>
<br /><i>Resource isolation on top of resource control</i>
</li>
<br />
</ul>
Expand All @@ -147,49 +111,42 @@ In the course of development, this roadmap is subject to change based on user ne
<td>
<ul>
<li>
<b>Distributed TiCDC single table replication</b>
<br /><i>
Dramatically improve TiDB-TiDB replication throughput
</i>
<b>TiCDC integrations with data warehouse or data lake systems</b>
<br />
</li>
<br />
<li>
<b
>Automatic pause/resume DDL during upgrade</b
>
<br /><i>Ensure a smooth upgrade experience</i>
<b>TiDB node labels</b>
<br /><i>Assign existing or newly added TiDB nodes for DDL operations to isolate DDL tasks from the compute resources used by online traffic
</i>
</li>
<br />
<li>
<b>TiCDC native integrations with big data systems</b>
<br /><i
>Such as Snowflake and Iceburg</i
>
</li>
</ul>
</td>
<td>
<ul>
<li>
<b>Multiple upstreams for TiCDC</b>
<br /><i>Support N:1 TiDB to TiCDC</i>
<b>SQL plan management</b>
<br /><i>Mechanism for controlling SQL plan regression</i>
</li>
<br />
<li>
<b>Index Advisor</b>
<br /><i>Offer index recommendations to users based on workload, statistics, and execution plans</i>
</li>
</ul>
</td>
<td>
<ul>
<li>
<b>AI-indexing</b>
<b>Materialized views</b>
<br /><i>Store pre-computed results as a persistent data view to boost query performance</i>
</li>
<br />
<li>
<b>Heterogeneous database migration support</b>
</li>
<br />
<li>
<b>Re-invented AI-SQL performance advisor</b>
</li>
</ul>
</td>
</tr>
Expand All @@ -210,10 +167,6 @@ In the course of development, this roadmap is subject to change based on user ne
<br /><i>Grant and restrict access to specific columns</i>
</li>
<br />
<li>
<b>Database-level encryption</b>
<br /><i>At-rest encryption configured at database level</i>
</li>
</ul>
</td>
<td>
Expand All @@ -227,6 +180,11 @@ In the course of development, this roadmap is subject to change based on user ne
<b>Unified TLS CA/Key rotation policy</b>
<br /><i>Unified certificate management mechanism for all TiDB components</i>
</li>
<br></br>
<li>
<b>AWS FIPS support</b>
<br /><i>Enable FedRAMP compliance</i>
</li>
</ul>
</td>
<td>
Expand All @@ -244,9 +202,6 @@ In the course of development, this roadmap is subject to change based on user ne
<b>Enhanced data masking</b>
</li>
<br />
<li>
<b>Enhanced data lifecycle management</b>
</li>
</ul>
</td>
</tr>
Expand Down

0 comments on commit 0b9064a

Please sign in to comment.