[still under investigation] loading phase degradation and timeouts in Bazel 7.1.1 #22003
Description
Description of the bug:
At Uber, we had to revert from Bazel 7.1.1 to 7.0.2 because of a high number of instances of timeouts during the loading phase (cc @linzhp).
These timeouts did not always re-produce but seemed to mostly happen in CI environments.
While we continue to investigate this issue, I thought it would be helpful to open a GitHub issue to get any potential ideas.
I noticed the following commits which might be related:
If this issue is not helpful, and there are no other experiencing these degradations, we can close it.
Which category does this issue belong to?
Core, Performance
What's the simplest, easiest way to reproduce this bug? Please provide a minimal example if possible.
No systematic way to reproduce is possible, but we were noticing this occurring while running bazel query //... as well as other bazel commands like bazel build some targets
Which operating system are you running Bazel on?
Linux AMD 64
What is the output of bazel info release?
7.1.1
If bazel info release returns development version or (@non-git), tell us how you built Bazel.
No response
What's the output of git remote get-url origin; git rev-parse HEAD ?
Internal repo
Is this a regression? If yes, please try to identify the Bazel commit where the bug was introduced.
No response
Have you found anything relevant by searching the web?
No response
Any other information, logs, or outputs that you want to share?
No response