- Docs Home
- About TiDB
- Quick Start
- Develop
- Overview
- Quick Start
- Build a TiDB Cluster in TiDB Cloud (Developer Tier)
- CRUD SQL in TiDB
- Build a Simple CRUD App with TiDB
- Example Applications
- Connect to TiDB
- Design Database Schema
- Write Data
- Read Data
- Transaction
- Optimize
- Troubleshoot
- Reference
- Cloud Native Development Environment
- Third-party Support
- Deploy
- Software and Hardware Requirements
- Environment Configuration Checklist
- Plan Cluster Topology
- Install and Start
- Verify Cluster Status
- Test Cluster Performance
- Migrate
- Overview
- Migration Tools
- Migration Scenarios
- Migrate from Aurora
- Migrate MySQL of Small Datasets
- Migrate MySQL of Large Datasets
- Migrate and Merge MySQL Shards of Small Datasets
- Migrate and Merge MySQL Shards of Large Datasets
- Migrate from CSV Files
- Migrate from SQL Files
- Migrate from One TiDB Cluster to Another TiDB Cluster
- Migrate from TiDB to MySQL-compatible Databases
- Advanced Migration
- Integrate
- Maintain
- Monitor and Alert
- Troubleshoot
- TiDB Troubleshooting Map
- Identify Slow Queries
- Analyze Slow Queries
- SQL Diagnostics
- Identify Expensive Queries Using Top SQL
- Identify Expensive Queries Using Logs
- Statement Summary Tables
- Troubleshoot Hotspot Issues
- Troubleshoot Increased Read and Write Latency
- Save and Restore the On-Site Information of a Cluster
- Troubleshoot Cluster Setup
- Troubleshoot High Disk I/O Usage
- Troubleshoot Lock Conflicts
- Troubleshoot TiFlash
- Troubleshoot Write Conflicts in Optimistic Transactions
- Troubleshoot Inconsistency Between Data and Indexes
- Performance Tuning
- Tuning Guide
- Configuration Tuning
- System Tuning
- Software Tuning
- SQL Tuning
- Overview
- Understanding the Query Execution Plan
- SQL Optimization Process
- Overview
- Logic Optimization
- Physical Optimization
- Prepare Execution Plan Cache
- Control Execution Plans
- Tutorials
- TiDB Tools
- Overview
- Use Cases
- Download
- TiUP
- Documentation Map
- Overview
- Terminology and Concepts
- Manage TiUP Components
- FAQ
- Troubleshooting Guide
- Command Reference
- Overview
- TiUP Commands
- TiUP Cluster Commands
- Overview
- tiup cluster audit
- tiup cluster check
- tiup cluster clean
- tiup cluster deploy
- tiup cluster destroy
- tiup cluster disable
- tiup cluster display
- tiup cluster edit-config
- tiup cluster enable
- tiup cluster help
- tiup cluster import
- tiup cluster list
- tiup cluster patch
- tiup cluster prune
- tiup cluster reload
- tiup cluster rename
- tiup cluster replay
- tiup cluster restart
- tiup cluster scale-in
- tiup cluster scale-out
- tiup cluster start
- tiup cluster stop
- tiup cluster template
- tiup cluster upgrade
- TiUP DM Commands
- Overview
- tiup dm audit
- tiup dm deploy
- tiup dm destroy
- tiup dm disable
- tiup dm display
- tiup dm edit-config
- tiup dm enable
- tiup dm help
- tiup dm import
- tiup dm list
- tiup dm patch
- tiup dm prune
- tiup dm reload
- tiup dm replay
- tiup dm restart
- tiup dm scale-in
- tiup dm scale-out
- tiup dm start
- tiup dm stop
- tiup dm template
- tiup dm upgrade
- TiDB Cluster Topology Reference
- DM Cluster Topology Reference
- Mirror Reference Guide
- TiUP Components
- PingCAP Clinic Diagnostic Service
- TiDB Operator
- Dumpling
- TiDB Lightning
- TiDB Data Migration
- About TiDB Data Migration
- Architecture
- Quick Start
- Deploy a DM cluster
- Tutorials
- Advanced Tutorials
- Maintain
- Cluster Upgrade
- Tools
- Performance Tuning
- Manage Data Sources
- Manage Tasks
- Export and Import Data Sources and Task Configurations of Clusters
- Handle Alerts
- Daily Check
- Reference
- Architecture
- Command Line
- Configuration Files
- OpenAPI
- Compatibility Catalog
- Secure
- Monitoring and Alerts
- Error Codes
- Glossary
- Example
- Troubleshoot
- Release Notes
- Backup & Restore (BR)
- TiDB Binlog
- TiCDC
- Dumpling
- sync-diff-inspector
- TiSpark
- Reference
- Cluster Architecture
- Key Monitoring Metrics
- Secure
- Privileges
- SQL
- SQL Language Structure and Syntax
- SQL Statements
ADD COLUMN
ADD INDEX
ADMIN
ADMIN CANCEL DDL
ADMIN CHECKSUM TABLE
ADMIN CHECK [TABLE|INDEX]
ADMIN SHOW DDL [JOBS|QUERIES]
ADMIN SHOW TELEMETRY
ALTER DATABASE
ALTER INDEX
ALTER INSTANCE
ALTER PLACEMENT POLICY
ALTER TABLE
ALTER TABLE COMPACT
ALTER USER
ANALYZE TABLE
BACKUP
BATCH
BEGIN
CHANGE COLUMN
COMMIT
CHANGE DRAINER
CHANGE PUMP
CREATE [GLOBAL|SESSION] BINDING
CREATE DATABASE
CREATE INDEX
CREATE PLACEMENT POLICY
CREATE ROLE
CREATE SEQUENCE
CREATE TABLE LIKE
CREATE TABLE
CREATE USER
CREATE VIEW
DEALLOCATE
DELETE
DESC
DESCRIBE
DO
DROP [GLOBAL|SESSION] BINDING
DROP COLUMN
DROP DATABASE
DROP INDEX
DROP PLACEMENT POLICY
DROP ROLE
DROP SEQUENCE
DROP STATS
DROP TABLE
DROP USER
DROP VIEW
EXECUTE
EXPLAIN ANALYZE
EXPLAIN
FLASHBACK TABLE
FLUSH PRIVILEGES
FLUSH STATUS
FLUSH TABLES
GRANT <privileges>
GRANT <role>
INSERT
KILL [TIDB]
LOAD DATA
LOAD STATS
MODIFY COLUMN
PREPARE
RECOVER TABLE
RENAME INDEX
RENAME TABLE
REPLACE
RESTORE
REVOKE <privileges>
REVOKE <role>
ROLLBACK
SELECT
SET DEFAULT ROLE
SET [NAMES|CHARACTER SET]
SET PASSWORD
SET ROLE
SET TRANSACTION
SET [GLOBAL|SESSION] <variable>
SHOW ANALYZE STATUS
SHOW [BACKUPS|RESTORES]
SHOW [GLOBAL|SESSION] BINDINGS
SHOW BUILTINS
SHOW CHARACTER SET
SHOW COLLATION
SHOW [FULL] COLUMNS FROM
SHOW CONFIG
SHOW CREATE PLACEMENT POLICY
SHOW CREATE SEQUENCE
SHOW CREATE TABLE
SHOW CREATE USER
SHOW DATABASES
SHOW DRAINER STATUS
SHOW ENGINES
SHOW ERRORS
SHOW [FULL] FIELDS FROM
SHOW GRANTS
SHOW INDEX [FROM|IN]
SHOW INDEXES [FROM|IN]
SHOW KEYS [FROM|IN]
SHOW MASTER STATUS
SHOW PLACEMENT
SHOW PLACEMENT FOR
SHOW PLACEMENT LABELS
SHOW PLUGINS
SHOW PRIVILEGES
SHOW [FULL] PROCESSSLIST
SHOW PROFILES
SHOW PUMP STATUS
SHOW SCHEMAS
SHOW STATS_HEALTHY
SHOW STATS_HISTOGRAMS
SHOW STATS_META
SHOW STATUS
SHOW TABLE NEXT_ROW_ID
SHOW TABLE REGIONS
SHOW TABLE STATUS
SHOW [FULL] TABLES
SHOW [GLOBAL|SESSION] VARIABLES
SHOW WARNINGS
SHUTDOWN
SPLIT REGION
START TRANSACTION
TABLE
TRACE
TRUNCATE
UPDATE
USE
WITH
- Data Types
- Functions and Operators
- Overview
- Type Conversion in Expression Evaluation
- Operators
- Control Flow Functions
- String Functions
- Numeric Functions and Operators
- Date and Time Functions
- Bit Functions and Operators
- Cast Functions and Operators
- Encryption and Compression Functions
- Locking Functions
- Information Functions
- JSON Functions
- Aggregate (GROUP BY) Functions
- Window Functions
- Miscellaneous Functions
- Precision Math
- Set Operations
- List of Expressions for Pushdown
- TiDB Specific Functions
- Clustered Indexes
- Constraints
- Generated Columns
- SQL Mode
- Table Attributes
- Transactions
- Garbage Collection (GC)
- Views
- Partitioning
- Temporary Tables
- Cached Tables
- Character Set and Collation
- Placement Rules in SQL
- System Tables
mysql
- INFORMATION_SCHEMA
- Overview
ANALYZE_STATUS
CLIENT_ERRORS_SUMMARY_BY_HOST
CLIENT_ERRORS_SUMMARY_BY_USER
CLIENT_ERRORS_SUMMARY_GLOBAL
CHARACTER_SETS
CLUSTER_CONFIG
CLUSTER_HARDWARE
CLUSTER_INFO
CLUSTER_LOAD
CLUSTER_LOG
CLUSTER_SYSTEMINFO
COLLATIONS
COLLATION_CHARACTER_SET_APPLICABILITY
COLUMNS
DATA_LOCK_WAITS
DDL_JOBS
DEADLOCKS
ENGINES
INSPECTION_RESULT
INSPECTION_RULES
INSPECTION_SUMMARY
KEY_COLUMN_USAGE
METRICS_SUMMARY
METRICS_TABLES
PARTITIONS
PLACEMENT_POLICIES
PROCESSLIST
REFERENTIAL_CONSTRAINTS
SCHEMATA
SEQUENCES
SESSION_VARIABLES
SLOW_QUERY
STATISTICS
TABLES
TABLE_CONSTRAINTS
TABLE_STORAGE_STATS
TIDB_HOT_REGIONS
TIDB_HOT_REGIONS_HISTORY
TIDB_INDEXES
TIDB_SERVERS_INFO
TIDB_TRX
TIFLASH_REPLICA
TIKV_REGION_PEERS
TIKV_REGION_STATUS
TIKV_STORE_STATUS
USER_PRIVILEGES
VIEWS
METRICS_SCHEMA
- UI
- TiDB Dashboard
- Overview
- Maintain
- Access
- Overview Page
- Cluster Info Page
- Top SQL Page
- Key Visualizer Page
- Metrics Relation Graph
- SQL Statements Analysis
- Slow Queries Page
- Cluster Diagnostics
- Search Logs Page
- Instance Profiling
- Session Management and Configuration
- FAQ
- CLI
- Command Line Flags
- Configuration File Parameters
- System Variables
- Storage Engines
- Telemetry
- Errors Codes
- Table Filter
- Schedule Replicas by Topology Labels
- FAQs
- Release Notes
- All Releases
- Release Timeline
- TiDB Versioning
- v6.1
- v6.0
- v5.4
- v5.3
- v5.2
- v5.1
- v5.0
- v4.0
- v3.1
- v3.0
- v2.1
- v2.0
- v1.0
- Glossary
TiDB 2.1 GA Release Notes
On November 30, 2018, TiDB 2.1 GA is released. See the following updates in this release. Compared with TiDB 2.0, this release has great improvements in stability, performance, compatibility, and usability.
TiDB
SQL Optimizer
Optimize the selection range of
Index Join
to improve the execution performanceOptimize the selection of outer table for
Index Join
and use the table with smaller estimated value of Row Count the as the outer tableOptimize Join Hint
TIDB_SMJ
so that Merge Join can be used even without proper index availableOptimize Join Hint
TIDB_INLJ
to specify the Inner table to JoinOptimize correlated subquery, push down Filter, and extend the index selection range, to improve the efficiency of some queries by orders of magnitude
Support using Index Hint and Join Hint in the
UPDATE
andDELETE
statementSupport pushing down more functions:
ABS
/CEIL
/FLOOR
/IS TRUE
/IS FALSE
Optimize the constant folding algorithm for the
IF
andIFNULL
built-in functionsOptimize the output of the
EXPLAIN
statement and use hierarchy structure to show the relationship between operators
SQL executor
Refactor all the aggregation functions and improve execution efficiency of the
Stream
andHash
aggregation operatorsImplement the parallel
Hash Aggregate
operators and improve the computing performance by 350% in some scenariosImplement the parallel
Project
operators and improve the performance by 74% in some scenariosRead the data of the Inner table and Outer table of
Hash Join
concurrently to improve the execution performanceOptimize the execution speed of the
REPLACE INTO
statement and increase the performance nearly by 10 timesOptimize the memory usage of the time data type and decrease the memory usage of the time data type by fifty percent
Optimize the point select performance and improve the point select efficiency result of Sysbench by 60%
Improve the performance of TiDB on inserting or updating wide tables by 20 times
Support configuring the memory upper limit of a single statement in the configuration file
Optimize the execution of Hash Join, if the Join type is Inner Join or Semi Join and the inner table is empty, return the result without reading data from the outer table
Support using the
EXPLAIN ANALYZE
statement to check the runtime statistics including the execution time and the number of returned rows of each operator
Statistics
Support enabling auto ANALYZE statistics only during certain period of the day
Support updating the table statistics automatically according to the feedback of the queries
Support configuring the number of buckets in the histogram using the
ANALYZE TABLE WITH BUCKETS
statementOptimize the Row Count estimation algorithm using histogram for mixed queries of equality query and range queries
Expressions
Support following built-in function:
json_contains
json_contains_path
encode/decode
Server
Support queuing the locally conflicted transactions within tidb-server instance to optimize the performance of conflicted transactions
Support Server Side Cursor
Add the HTTP API
Scatter the distribution of table Regions in the TiKV cluster
Control whether to open the
general log
Support modifying the log level online
Check the TiDB cluster information
Add the
auto_analyze_ratio
system variables to contorl the ratio of AnalyzeAdd the
tidb_retry_limit
system variable to control the automatic retry times of transactionsSupport using
admin show slow
statement to obtain the slow queriesAdd the
tidb_slow_log_threshold
environment variable to set the threshold of slow log automatically
DDL
Support the parallel execution of the Add index statement and other statements to avoid the time consuming Add index operation blocking other operations
Optimize the execution speed of
ADD INDEX
and improve it greatly in some scenariosSupport the
select tidb_is_ddl_owner()
statement to facilitate deciding whether TiDB isDDL Owner
Support the
ALTER TABLE FORCE
syntaxSupport the
ALTER TABLE RENAME KEY TO
syntaxAdd the table name and database name in the output information of
admin show ddl jobs
Compatibility
Support more MySQL syntaxes
Make the
BIT
aggregate function support theALL
parameterSupport the
SHOW PRIVILEGES
statementSupport the
CHARACTER SET
syntax in theLOAD DATA
statementSupport the
IDENTIFIED WITH
syntax in theCREATE USER
statementSupport the
LOAD DATA IGNORE LINES
statementThe
Show ProcessList
statement returns more accurate information
Placement Driver (PD)
Optimize availability
Introduce the version control mechanism and support rolling update of the cluster compatibly
Enable
Raft PreVote
among PD nodes to avoid leader reelection when network recovers after network isolationEnable
raft learner
by default to lower the risk of unavailable data caused by machine failure during schedulingTSO allocation is no longer affected by the system clock going backwards
Support the
Region merge
feature to reduce the overhead brought by metadata
Optimize the scheduler
Optimize the processing of Down Store to speed up making up replicas
Optimize the hotspot scheduler to improve its adaptability when traffic statistics information jitters
Optimize the start of Coordinator to reduce the unnecessary scheduling caused by restarting PD
Optimize the issue that Balance Scheduler schedules small Regions frequently
Optimize Region merge to consider the number of rows within the Region
Improve PD simulator to simulate the scheduling scenarios
API and operation tools
Add the
GetPrevRegion
interface to support theTiDB reverse scan
featureAdd the
BatchSplitRegion
interface to speed up TiKV Region splittingAdd the
GCSafePoint
interface to support distributed GC in TiDBAdd the
GetAllStores
interface, to support distributed GC in TiDB
pd-ctl supports:
- pd-recover doesn't need to provide the
max-replica
parameter
Metrics
Add related metrics for
Filter
Add metrics about etcd Raft state machine
Performance
Optimize the performance of Region heartbeat to reduce the memory overhead brought by heartbeats
Optimize the Region tree performance
Optimize the performance of computing hotspot statistics
TiKV
Coprocessor
Add more built-in functions
Add Coprocessor
ReadPool
to improve the concurrency in processing the requestsFix the time function parsing issue and the time zone related issues
Optimize the memory usage for pushdown aggregation computing
Transaction
Optimize the read logic and memory usage of MVCC to improve the performance of the scan operation and the performance of full table scan is 1 time better than that in TiDB 2.0
Fold the continuous Rollback records to ensure the read performance
Add the
UnsafeDestroyRange
API to support to collecting space for the dropping table/indexSeparate the GC module to reduce the impact on write
Add the
upper bound
support in thekv_scan
command
Raftstore
Improve the snapshot writing process to avoid RocksDB stall
Add the
LocalReader
thread to process read requests and reduce the delay for read requestsSupport
BatchSplit
to avoid large Region brought by large amounts of writeSupport
Region Split
according to statistics to reduce the I/O overheadSupport
Region Split
according to the number of keys to improve the concurrency of index scanImprove the Raft message process to avoid unnecessary delay brought by
Region Split
Enable the
PreVote
feature by default to reduce the impact of network isolation on services
Storage Engine
Fix the
CompactFiles
bug in RocksDB and reduce the impact on importing data using LightningUpgrade RocksDB to v5.15 to fix the possible issue of snapshot file corruption
Improve
IngestExternalFile
to avoid the issue that flush could block write
tikv-ctl
The
compact
command supports specifying whether to compact data in the bottommost level
Tools
Fast full import of large amounts of data: TiDB Lightning
Support new TiDB Binlog
Upgrade caveat
- TiDB 2.1 does not support downgrading to v2.0.x or earlier due to the adoption of the new storage engine
Parallel DDL is enabled in TiDB 2.1, so the clusters with TiDB version earlier than 2.0.1 cannot upgrade to 2.1 using rolling update. You can choose either of the following two options:
- Stop the cluster and upgrade to 2.1 directly
- Roll update to 2.0.1 or later 2.0.x versions, and then roll update to the 2.1 version
- If you upgrade from TiDB 2.0.6 or earlier to TiDB 2.1, check if there is any ongoing DDL operation, especially the time consuming
Add Index
operation, because the DDL operations slow down the upgrading process. If there is ongoing DDL operation, wait for the DDL operation finishes and then roll update.