Skip to content

backupccl,roachpb: introduce Aggregator to listen for StructuredEvents#81270

Closed
adityamaru wants to merge 1 commit intocockroachdb:masterfrom
adityamaru:bulk-aggregator
Closed

backupccl,roachpb: introduce Aggregator to listen for StructuredEvents#81270
adityamaru wants to merge 1 commit intocockroachdb:masterfrom
adityamaru:bulk-aggregator

Conversation

@adityamaru
Copy link
Copy Markdown
Contributor

This change introduces an Aggregator that can be registered as an EventListener
and LazyTag on a tracing span. The Aggregator will be notified on every
StructuredEvent emitted in the span's recording, and will subsume the event
into a running aggregate stored in memory.
This running aggregate will be rendered on the span's recording as a LazyTag
that can be consumed via the tracez page on the debug console.

Currently, the backup processor is the only bulk processor that creates and
registers an Aggregator. As an initial prototype this change teaches every
ExportRequest to emit ExportStats that will be aggregated by the Aggregator.

Note, this change also removes various StructuredEvents that were emitted by
the backup processor but have never proved useful. These were added as part of
the cockroach debug job-trace command which we hope to replace with this Aggregator.

Informs: #80388

Release note: None

@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@adityamaru adityamaru closed this Sep 6, 2022
@adityamaru adityamaru deleted the bulk-aggregator branch September 6, 2022 17:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants