Skip to content

Add to queued job metrics for jobs queue against multiple pools#4723

Merged
JamesMurkin merged 3 commits intomasterfrom
deduped_queue_metrics
Feb 27, 2026
Merged

Add to queued job metrics for jobs queue against multiple pools#4723
JamesMurkin merged 3 commits intomasterfrom
deduped_queue_metrics

Conversation

@JamesMurkin
Copy link
Contributor

Currently if a job is queued against multiple pools - the metrics make it look like there is multiple jobs queued (1 per pool)

This makes it hard to work out exactly what the demand on the system as a whole is (even if it is clear per pool)

Added accounting_role which is either primary or secondary to allow deduping

  • Each queued job will only have one set of metrics that have accounting_role=primary
  • Which pool is primary is configured via new config QueuedJobPrimaryPoolOrder

Currently if a job is queued against multiple pools - the metrics make it look like there is multiple jobs queued (1 per pool)

This makes it hard to work out exactly what the demand on the system as a whole is (even if it is clear per pool)

Added `accounting_role` which is either `primary` or `secondary` to allow deduping
 - Each queued job will only have one set of metrics that have accounting_role=primary
 - Which pool is primary is configured via new config `QueuedJobPrimaryPoolOrder`

Signed-off-by: JamesMurkin <jamesmurkin@hotmail.com>
@JamesMurkin JamesMurkin marked this pull request as ready for review February 26, 2026 14:16
@JamesMurkin JamesMurkin enabled auto-merge (squash) February 27, 2026 13:05
@JamesMurkin JamesMurkin merged commit 84757a8 into master Feb 27, 2026
15 checks passed
@JamesMurkin JamesMurkin deleted the deduped_queue_metrics branch February 27, 2026 13:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants