After https://github.com/tikv/client-go/pull/765/files#diff-0c36d07fbd1fc71c850ff57d323fe12bdf7f2c053ef71b7fec5bb44358f1070dR598, the retry time limit is removed when stale read is used and leaderOnly flag is set.
As mentioned in pingcap/tidb#45297, if region errors are encountered and the leader peer is not available, the retry may continue to happen and cause many unnecessary retries.