-
Notifications
You must be signed in to change notification settings - Fork 4.4k
remoteActionBuildingSemaphore slows down highly parallel remote builds #20478
Copy link
Copy link
Open
Labels
P2We'll consider working on this in future. (Assignee optional)We'll consider working on this in future. (Assignee optional)help wantedSomeone outside the Bazel team could own thisSomeone outside the Bazel team could own thisteam-Remote-ExecIssues and PRs for the Execution (Remote) teamIssues and PRs for the Execution (Remote) teamtype: bug
Description
Description of the bug:
Highly parallel RBE builds are slower than they need to be because of remoteActionBuildingSemaphore.
Which category does this issue belong to?
Remote Execution
What's the simplest, easiest way to reproduce this bug? Please provide a minimal example if possible.
Have a build that can do 300+ actions at once, use --jobs=300, and a host machine with 24 or fewer threads. Build clean once with Bazel 7.0.0. Build clean once with remoteActionBuildingSemaphore usage commented out. Compare and see that the second build is faster.
Which operating system are you running Bazel on?
Ubuntu 22.04
What is the output of bazel info release?
development version
If bazel info release returns development version or (@non-git), tell us how you built Bazel.
Built the release-7.0.0 branch and modified it per above.
What's the output of git remote get-url origin; git rev-parse master; git rev-parse HEAD ?
No response
Is this a regression? If yes, please try to identify the Bazel commit where the bug was introduced.
No response
Have you found anything relevant by searching the web?
#17120 / 4069a87 added the semaphore
Any other information, logs, or outputs that you want to share?
No response
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
P2We'll consider working on this in future. (Assignee optional)We'll consider working on this in future. (Assignee optional)help wantedSomeone outside the Bazel team could own thisSomeone outside the Bazel team could own thisteam-Remote-ExecIssues and PRs for the Execution (Remote) teamIssues and PRs for the Execution (Remote) teamtype: bug