Bug Report

What version of TiKV are you using?

TiKV
Release Version: 9.0.0-alpha
Edition: Community
Git Commit Hash: 7bc7720
Git Commit Branch: HEAD
UTC Build Time: 2025-02-06 11:58:01

What operating system and CPU are you using?

8c/16g

Steps to reproduce

1、run workload
2、down Primary
3、switch to backup cluster
4、tiup ctl:nightly pd -u http://pd3-peer.e2e-dr-auto-sync-with-tiflash-tps-7817677-1-75:2379 unsafe remove-failed-stores --auto-detect --timeout 300
5、tiup ctl:nightly pd -u http://pd3-peer.e2e-dr-auto-sync-with-tiflash-tps-7817677-1-75:2379 unsafe remove-failed-stores show

What did you expect?

online recover can succeed

What did happened?

online recover failed
[
{
"info": "Unsafe recovery enters collect report stage",
"time": "2025-02-07 22:42:39.431",
"details": [
"auto detect mode with no specified Failed stores"
]
},
{
"info": "Unsafe recovery enters force leader stage",
"time": "2025-02-07 22:43:24.251",
"actions": {
"store 5": [
"force leader on regions: "
],
"store 506": [
"force leader on regions: "
],
"store 6": [
"force leader on regions: "
],
"store 8": [
"force leader on regions: 1529, 2460, 2740, 857, 1795"
]
}
},
{
"info": "Unsafe recovery enters exit force leader stage",
"time": "2025-02-07 22:52:40.753",
"details": [
"triggered by error: Exceeds timeout 2025-02-07 22:52:39.431708175 +0800 CST m=+2413.457549852"
]
},
{
"info": "Unsafe recovery Failed: Exceeds timeout 2025-02-07 22:52:39.431708175 +0800 CST m=+2413.457549852",
"time": "2025-02-07 22:53:25.984",
"details": [
"affected table ids: 125, 127",
"no newly created empty regions"
]
}
]