Partial import during adding index may block GC

Bug Report

Please answer these questions before submitting your issue. Thanks!

1. Minimal reproduce step (Required)

Add index for a large table, partial import takes a long time:

[INFO] [backend.go:229] ["do a partial import data into the storage"] [category=ddl-ingest]

2. What did you expect to see? (Required)

No warning.

3. What did you see instead (Required)

There are lots of warnings in log:

[txn.go:99] ["An internal transaction running by internal session lasts long time"] [time=12h15m11.5s]

4. What is your TiDB version? (Required)

a268223

Root cause:

goroutine 42694858340 [select, 753 minutes]:
github.com/pingcap/tidb/pkg/resourcemanager/pool/workerpool.(*WorkerPool[...]).AddTask(...)
        /home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/resourcemanager/pool/workerpool/workerpool.go:161
github.com/pingcap/tidb/pkg/ddl.scanRecords.func1(0xc0e552a900?)
        /home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/ddl/index_cop.go:174 +0x385
github.com/pingcap/tidb/pkg/ddl.wrapInBeginRollback(0xc0d929ddd0, 0xc0d929dc90)
        /home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/ddl/index_cop.go:195 +0xc4
github.com/pingcap/tidb/pkg/ddl.scanRecords(0xc0d4073200, 0xc0c367e770, 0x13?)
        /home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/ddl/index_cop.go:142 +0x210
github.com/pingcap/tidb/pkg/ddl.(*copReqSender).run(0xc0e760a0e0)
        /home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/ddl/index_cop.go:130 +0x4fe
created by github.com/pingcap/tidb/pkg/ddl.(*copReqSenderPool).adjustSize in goroutine 42694835722
        /home/jenkins/agent/workspace/build-common/go/src/github.com/pingcap/tidb/pkg/ddl/index_cop.go:229 +0x31

For partial import, the import workers block writers, and the writers block readers.

ddl: send result chunks to writers after scan task complete (pingcap#…

ddl: send result chunks to writers after scan task complete (#62014) (#…

Navigation Menu

Repository navigation

Partial import during adding index may block GC #62008

Bug Report

1. Minimal reproduce step (Required)

2. What did you expect to see? (Required)

3. What did you see instead (Required)

4. What is your TiDB version? (Required)

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Partial import during adding index may block GC #62008

Description

Bug Report

1. Minimal reproduce step (Required)

2. What did you expect to see? (Required)

3. What did you see instead (Required)

4. What is your TiDB version? (Required)

Activity

tangenta commented on Jun 25, 2025

Metadata

Metadata

Assignees

Labels

Type

Projects

Milestone

Relationships

Development

Issue actions