Skip to content

Conversation

@delan
Copy link
Member

@delan delan commented Nov 24, 2025

this patch enables CI jobs to queue for self-hosted runners by bumping our actions to servo/ci-runners#69, and bumping our runner-select and runner-timeout jobs to ubuntu-24.04 (for better retry support in curl).

this should further speed up our builds by allowing more jobs to run on self-hosted runners: if a job would take 5x as long on github-hosted runners, then we can wait up to 80% of that time for a self-hosted runner and still win.

for now, though, jobs will queue for self-hosted runners for up to one hour (note that you won’t have to wait if the servers are down). if your request for a self-hosted runner can’t be satisfied immediately, it will look like this:

POST https://ci0.servo.org/queue/enqueue?unique_id=92a9e758-f8e2-4301-b4a4-304178a656ae&qualified_repo=servo/servo&run_id=19624089967

POST https://ci0.servo.org/queue/take/92a9e758-f8e2-4301-b4a4-304178a656ae
curl: (22) The requested URL returned error: 503
curl: (22) The requested URL returned error: 503
curl: (22) The requested URL returned error: 503
... [repeating for up to one hour]

to check where you are in the queue, go to https://ci0.servo.org/queue/ (it’s currently very rudimentary):

image

Testing:

  • mach try windows: 1, 2, 3, 4, 5, 6
  • mach try windows linux lint: 1, 2, 3, 4, 5, 6

Signed-off-by: Delan Azabani <dazabani@igalia.com>
Signed-off-by: Delan Azabani <dazabani@igalia.com>
@delan delan marked this pull request as ready for review November 24, 2025 05:40
@delan delan requested a review from sagudev as a code owner November 24, 2025 05:40
@servo-highfive servo-highfive added the S-awaiting-review There is new code that needs to be reviewed. label Nov 24, 2025
Copy link
Member

@sagudev sagudev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks alright, although I am concerned with how much github runners we will still use, but we will see how this works in practice.

I think we should start experimenting with removing runner timeout workflow ...

@servo-highfive servo-highfive removed the S-awaiting-review There is new code that needs to be reviewed. label Nov 24, 2025
@delan delan added this pull request to the merge queue Nov 25, 2025
@servo-highfive servo-highfive added the S-awaiting-merge The PR is in the process of compiling and running tests on the automated CI. label Nov 25, 2025
Merged via the queue into main with commit 82ef052 Nov 25, 2025
33 checks passed
@delan delan deleted the queueing branch November 25, 2025 05:06
@servo-highfive servo-highfive removed the S-awaiting-merge The PR is in the process of compiling and running tests on the automated CI. label Nov 25, 2025
delan added a commit to servo/ci-runners that referenced this pull request Dec 2, 2025
unfortunately neither the new global queueing feature
(servo/servo#40852), nor dropping the runner-timeout jobs
(servo/servo#40876), have improved self-hosted runner utilisation (a
metric of server workload).

that said, the self-hosted runner hit rate is 93%, so not too many jobs
are missing out on self-hosted runners.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants