- Docs Home
- About TiDB
- Quick Start
- Develop
- Overview
- Quick Start
- Build a TiDB Cluster in TiDB Cloud (Developer Tier)
- CRUD SQL in TiDB
- Build a Simple CRUD App with TiDB
- Example Applications
- Connect to TiDB
- Design Database Schema
- Write Data
- Read Data
- Transaction
- Optimize
- Troubleshoot
- Reference
- Cloud Native Development Environment
- Third-party Support
- Deploy
- Software and Hardware Requirements
- Environment Configuration Checklist
- Plan Cluster Topology
- Install and Start
- Verify Cluster Status
- Test Cluster Performance
- Migrate
- Overview
- Migration Tools
- Migration Scenarios
- Migrate from Aurora
- Migrate MySQL of Small Datasets
- Migrate MySQL of Large Datasets
- Migrate and Merge MySQL Shards of Small Datasets
- Migrate and Merge MySQL Shards of Large Datasets
- Migrate from CSV Files
- Migrate from SQL Files
- Migrate from One TiDB Cluster to Another TiDB Cluster
- Migrate from TiDB to MySQL-compatible Databases
- Advanced Migration
- Integrate
- Overview
- Integration Scenarios
- Maintain
- Monitor and Alert
- Troubleshoot
- TiDB Troubleshooting Map
- Identify Slow Queries
- Analyze Slow Queries
- SQL Diagnostics
- Identify Expensive Queries Using Top SQL
- Identify Expensive Queries Using Logs
- Statement Summary Tables
- Troubleshoot Hotspot Issues
- Troubleshoot Increased Read and Write Latency
- Save and Restore the On-Site Information of a Cluster
- Troubleshoot Cluster Setup
- Troubleshoot High Disk I/O Usage
- Troubleshoot Lock Conflicts
- Troubleshoot TiFlash
- Troubleshoot Write Conflicts in Optimistic Transactions
- Troubleshoot Inconsistency Between Data and Indexes
- Performance Tuning
- Tuning Guide
- Configuration Tuning
- System Tuning
- Software Tuning
- SQL Tuning
- Overview
- Understanding the Query Execution Plan
- SQL Optimization Process
- Overview
- Logic Optimization
- Physical Optimization
- Prepare Execution Plan Cache
- Control Execution Plans
- Tutorials
- TiDB Tools
- Overview
- Use Cases
- Download
- TiUP
- Documentation Map
- Overview
- Terminology and Concepts
- Manage TiUP Components
- FAQ
- Troubleshooting Guide
- Command Reference
- Overview
- TiUP Commands
- TiUP Cluster Commands
- Overview
- tiup cluster audit
- tiup cluster check
- tiup cluster clean
- tiup cluster deploy
- tiup cluster destroy
- tiup cluster disable
- tiup cluster display
- tiup cluster edit-config
- tiup cluster enable
- tiup cluster help
- tiup cluster import
- tiup cluster list
- tiup cluster patch
- tiup cluster prune
- tiup cluster reload
- tiup cluster rename
- tiup cluster replay
- tiup cluster restart
- tiup cluster scale-in
- tiup cluster scale-out
- tiup cluster start
- tiup cluster stop
- tiup cluster template
- tiup cluster upgrade
- TiUP DM Commands
- Overview
- tiup dm audit
- tiup dm deploy
- tiup dm destroy
- tiup dm disable
- tiup dm display
- tiup dm edit-config
- tiup dm enable
- tiup dm help
- tiup dm import
- tiup dm list
- tiup dm patch
- tiup dm prune
- tiup dm reload
- tiup dm replay
- tiup dm restart
- tiup dm scale-in
- tiup dm scale-out
- tiup dm start
- tiup dm stop
- tiup dm template
- tiup dm upgrade
- TiDB Cluster Topology Reference
- DM Cluster Topology Reference
- Mirror Reference Guide
- TiUP Components
- PingCAP Clinic Diagnostic Service
- TiDB Operator
- Dumpling
- TiDB Lightning
- TiDB Data Migration
- About TiDB Data Migration
- Architecture
- Quick Start
- Deploy a DM cluster
- Tutorials
- Advanced Tutorials
- Maintain
- Cluster Upgrade
- Tools
- Performance Tuning
- Manage Data Sources
- Manage Tasks
- Export and Import Data Sources and Task Configurations of Clusters
- Handle Alerts
- Daily Check
- Reference
- Architecture
- Command Line
- Configuration Files
- OpenAPI
- Compatibility Catalog
- Secure
- Monitoring and Alerts
- Error Codes
- Glossary
- Example
- Troubleshoot
- Release Notes
- Backup & Restore (BR)
- Point-in-Time Recovery
- TiDB Binlog
- TiCDC
- Dumpling
- sync-diff-inspector
- TiSpark
- Reference
- Cluster Architecture
- Key Monitoring Metrics
- Secure
- Privileges
- SQL
- SQL Language Structure and Syntax
- SQL Statements
ADD COLUMNADD INDEXADMINADMIN CANCEL DDLADMIN CHECKSUM TABLEADMIN CHECK [TABLE|INDEX]ADMIN SHOW DDL [JOBS|QUERIES]ADMIN SHOW TELEMETRYALTER DATABASEALTER INDEXALTER INSTANCEALTER PLACEMENT POLICYALTER TABLEALTER TABLE COMPACTALTER TABLE SET TIFLASH MODEALTER USERANALYZE TABLEBACKUPBATCHBEGINCHANGE COLUMNCOMMITCHANGE DRAINERCHANGE PUMPCREATE [GLOBAL|SESSION] BINDINGCREATE DATABASECREATE INDEXCREATE PLACEMENT POLICYCREATE ROLECREATE SEQUENCECREATE TABLE LIKECREATE TABLECREATE USERCREATE VIEWDEALLOCATEDELETEDESCDESCRIBEDODROP [GLOBAL|SESSION] BINDINGDROP COLUMNDROP DATABASEDROP INDEXDROP PLACEMENT POLICYDROP ROLEDROP SEQUENCEDROP STATSDROP TABLEDROP USERDROP VIEWEXECUTEEXPLAIN ANALYZEEXPLAINFLASHBACK TABLEFLUSH PRIVILEGESFLUSH STATUSFLUSH TABLESGRANT <privileges>GRANT <role>INSERTKILL [TIDB]LOAD DATALOAD STATSMODIFY COLUMNPREPARERECOVER TABLERENAME INDEXRENAME TABLEREPLACERESTOREREVOKE <privileges>REVOKE <role>ROLLBACKSAVEPOINTSELECTSET DEFAULT ROLESET [NAMES|CHARACTER SET]SET PASSWORDSET ROLESET TRANSACTIONSET [GLOBAL|SESSION] <variable>SHOW ANALYZE STATUSSHOW [BACKUPS|RESTORES]SHOW [GLOBAL|SESSION] BINDINGSSHOW BUILTINSSHOW CHARACTER SETSHOW COLLATIONSHOW [FULL] COLUMNS FROMSHOW CONFIGSHOW CREATE PLACEMENT POLICYSHOW CREATE SEQUENCESHOW CREATE TABLESHOW CREATE USERSHOW DATABASESSHOW DRAINER STATUSSHOW ENGINESSHOW ERRORSSHOW [FULL] FIELDS FROMSHOW GRANTSSHOW INDEX [FROM|IN]SHOW INDEXES [FROM|IN]SHOW KEYS [FROM|IN]SHOW MASTER STATUSSHOW PLACEMENTSHOW PLACEMENT FORSHOW PLACEMENT LABELSSHOW PLUGINSSHOW PRIVILEGESSHOW [FULL] PROCESSSLISTSHOW PROFILESSHOW PUMP STATUSSHOW SCHEMASSHOW STATS_HEALTHYSHOW STATS_HISTOGRAMSSHOW STATS_METASHOW STATUSSHOW TABLE NEXT_ROW_IDSHOW TABLE REGIONSSHOW TABLE STATUSSHOW [FULL] TABLESSHOW [GLOBAL|SESSION] VARIABLESSHOW WARNINGSSHUTDOWNSPLIT REGIONSTART TRANSACTIONTABLETRACETRUNCATEUPDATEUSEWITH
- Data Types
- Functions and Operators
- Overview
- Type Conversion in Expression Evaluation
- Operators
- Control Flow Functions
- String Functions
- Numeric Functions and Operators
- Date and Time Functions
- Bit Functions and Operators
- Cast Functions and Operators
- Encryption and Compression Functions
- Locking Functions
- Information Functions
- JSON Functions
- Aggregate (GROUP BY) Functions
- Window Functions
- Miscellaneous Functions
- Precision Math
- Set Operations
- List of Expressions for Pushdown
- TiDB Specific Functions
- Clustered Indexes
- Constraints
- Generated Columns
- SQL Mode
- Table Attributes
- Transactions
- Garbage Collection (GC)
- Views
- Partitioning
- Temporary Tables
- Cached Tables
- Character Set and Collation
- Placement Rules in SQL
- System Tables
mysql- INFORMATION_SCHEMA
- Overview
ANALYZE_STATUSCLIENT_ERRORS_SUMMARY_BY_HOSTCLIENT_ERRORS_SUMMARY_BY_USERCLIENT_ERRORS_SUMMARY_GLOBALCHARACTER_SETSCLUSTER_CONFIGCLUSTER_HARDWARECLUSTER_INFOCLUSTER_LOADCLUSTER_LOGCLUSTER_SYSTEMINFOCOLLATIONSCOLLATION_CHARACTER_SET_APPLICABILITYCOLUMNSDATA_LOCK_WAITSDDL_JOBSDEADLOCKSENGINESINSPECTION_RESULTINSPECTION_RULESINSPECTION_SUMMARYKEY_COLUMN_USAGEMETRICS_SUMMARYMETRICS_TABLESPARTITIONSPLACEMENT_POLICIESPROCESSLISTREFERENTIAL_CONSTRAINTSSCHEMATASEQUENCESSESSION_VARIABLESSLOW_QUERYSTATISTICSTABLESTABLE_CONSTRAINTSTABLE_STORAGE_STATSTIDB_HOT_REGIONSTIDB_HOT_REGIONS_HISTORYTIDB_INDEXESTIDB_SERVERS_INFOTIDB_TRXTIFLASH_REPLICATIKV_REGION_PEERSTIKV_REGION_STATUSTIKV_STORE_STATUSUSER_PRIVILEGESVARIABLES_INFOVIEWS
METRICS_SCHEMA
- UI
- TiDB Dashboard
- Overview
- Maintain
- Access
- Overview Page
- Cluster Info Page
- Top SQL Page
- Key Visualizer Page
- Metrics Relation Graph
- SQL Statements Analysis
- Slow Queries Page
- Cluster Diagnostics
- Monitoring Page
- Search Logs Page
- Instance Profiling
- Session Management and Configuration
- FAQ
- CLI
- Command Line Flags
- Configuration File Parameters
- System Variables
- Storage Engines
- Telemetry
- Errors Codes
- Table Filter
- Schedule Replicas by Topology Labels
- FAQs
- Release Notes
- All Releases
- Release Timeline
- TiDB Versioning
- TiDB Installation Packages
- v6.2
- v6.1
- v6.0
- v5.4
- v5.3
- v5.2
- v5.1
- v5.0
- v4.0
- v3.1
- v3.0
- v2.1
- v2.0
- v1.0
- Glossary
PingCAP Clinic Diagnostic Data
This document provides the types of diagnostic data that can be collected by PingCAP Clinic Diagnostic Service (PingCAP Clinic) from the TiDB and DM clusters deployed using TiUP. Also, the document lists the parameters for data collection corresponding to each data type. When running a command to collect data using Diag client (Diag), you can add the required parameters to the command according to the types of the data to be collected.
The diagnostic data collected by PingCAP Clinic is only used for troubleshooting cluster problems.
A diagnostic service deployed in the cloud, Clinic Server provides two independent services depending on the data storage location:
- Clinic Server in the US: If you upload the collected data to Clinic Server in the US, the data will be stored in the Amazon S3 service deployed by PingCAP in AWS US regions. PingCAP uses strict data access policies and only authorized technical support can access the data.
- Clinic Server in the Chinese mainland: If you upload the collected data to Clinic Server in the Chinese mainland, the data will be stored in the Amazon S3 service deployed by PingCAP in China (Beijing) regions. PingCAP uses strict data access policies and only authorized technical support can access the data.
TiDB clusters
This section lists the types of diagnostic data that can be collected by Diag from the TiDB clusters deployed using TiUP.
TiDB cluster information
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Basic information of the cluster, including the cluster ID | cluster.json | The data is collected per run by default. |
| Detailed information of the cluster | meta.yaml | The data is collected per run by default. |
TiDB diagnostic data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Log | tidb.log | --include=log |
| Error log | tidb_stderr.log | --include=log |
| Slow log | tidb_slow_query.log | --include=log |
| Configuration file | tidb.toml | --include=config |
| Real-time configuration | config.json | --include=config |
TiKV diagnostic data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Log | tikv.log | --include=log |
| Error log | tikv_stderr.log | --include=log |
| Configuration file | tikv.toml | --include=config |
| Real-time configuration | config.json | --include=config |
PD diagnostic data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Log | pd.log | --include=log |
| Error log | pd_stderr.log | --include=log |
| Configuration file | pd.toml | --include=config |
| Real-time configuration | config.json | --include=config |
Outputs of the command tiup ctl pd -u http://${pd IP}:${PORT} store | store.json | --include=config |
Outputs of the command tiup ctl pd -u http://${pd IP}:${PORT} config placement-rules show | placement-rule.json | --include=config |
TiFlash diagnostic data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Log | tiflash.log | --include=log |
| Error log | tiflash_stderr.log | --include=log |
| Configuration file | tiflash-learner.toml, tiflash-preprocessed.toml, tiflash.toml | --include=config |
| Real-time configuration | config.json | --include=config |
TiCDC diagnostic data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Log | ticdc.log | --include=log |
| Error log | ticdc_stderr.log | --include=log |
| Configuration file | ticdc.toml | --include=config |
| Debug data | info.txt, status.txt, changefeeds.txt, captures.txt, processors.txt | --include=debug (Diag does not collect this data type by default) |
Prometheus monitoring data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| All metrics data | {metric_name}.json | --include=monitor |
| All alerts data | alerts.json | --include=monitor |
TiDB system variables
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| TiDB system variables | mysql.tidb.csv | --include=db_vars (Diag does not collect this data type by default; if you need to collect this data type, database credential is required) |
global_variables.csv | --include=db_vars (Diag does not collect this data type by default) |
System information of the cluster node
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Kernel log | dmesg.log | --include=system |
| Basic information of the system and hardware | insight.json | --include=system |
Contents in the /etc/security/limits.conf | limits.conf | --include=system |
| List of kernel parameters | sysctl.conf | --include=system |
Socket system information, which is the output of the ss command | ss.txt | --include=system |
DM clusters
This section lists the types of diagnostic data that can be collected by Diag from the DM clusters deployed using TiUP.
DM cluster information
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Basic information of the cluster, including the cluster ID | cluster.json | The data is collected per run by default. |
| Detailed information of the cluster | meta.yaml | The data is collected per run by default. |
dm-master diagnostic data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Log | m-master.log | --include=log |
| Error log | dm-master_stderr.log | --include=log |
| Configuration file | dm-master.toml | --include=config |
dm-worker diagnostic data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Log | dm-worker.log | --include=log |
| Error log | dm-worker_stderr.log | --include=log |
| Configuration file | dm-work.toml | --include=config |
Prometheus monitoring data
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| All metrics data | {metric_name}.json | --include=monitor |
| All alerts data | alerts.json | --include=monitor |
System information of the cluster node
| Data type | Exported file | Parameter for data collection by PingCAP Clinic |
|---|---|---|
| Kernel log | dmesg.log | --include=system |
| Basic information of the system and hardware | insight.json | --include=system |
Contents in the /etc/security/limits.conf system | limits.conf | --include=system |
| List of kernel parameters | sysctl.conf | --include=system |
Socket system information, which is the output of the ss command | ss.txt | --include=system |