Skip to content
This repository was archived by the owner on Sep 30, 2024. It is now read-only.

gitserver: Add observability to chunked messages#62825

Merged
eseliger merged 1 commit into
mainfrom
es/05-18-gitserveraddobservabilitytochunkedmessages
May 21, 2024
Merged

gitserver: Add observability to chunked messages#62825
eseliger merged 1 commit into
mainfrom
es/05-18-gitserveraddobservabilitytochunkedmessages

Conversation

@eseliger

Copy link
Copy Markdown
Member

This PR adds event markers for the chunked sender. In tracing, this will tell how many messages and how many items in a message we sent. That should help understand better how much overhead we're incurring by splitting the data into multiple gRPC chunks.

Test plan:

Ran Jaeger locally, got good markers and interesting insights. For ReadDir, we batch roughly 8k records in one message.

@github-actions github-actions Bot added team/product-platform team/source Tickets under the purview of Source - the one Source to graph it all labels May 21, 2024
@eseliger eseliger marked this pull request as ready for review May 21, 2024 15:15
@eseliger eseliger requested a review from a team May 21, 2024 15:15
@eseliger eseliger force-pushed the es/05-17-gitserverdeprecateexecandremovelocalgit branch from 858cb3d to 44b9087 Compare May 21, 2024 16:06
Base automatically changed from es/05-17-gitserverdeprecateexecandremovelocalgit to main May 21, 2024 16:19
This PR adds event markers for the chunked sender. In tracing, this will tell how many messages and how many items in a message we sent. That should help understand better how much overhead we're incurring by splitting the data into multiple gRPC chunks.

Test plan:

Ran Jaeger locally, got good markers and interesting insights. For ReadDir, we batch roughly 8k records in one message.
@eseliger eseliger force-pushed the es/05-18-gitserveraddobservabilitytochunkedmessages branch from 956bcdd to ec039d1 Compare May 21, 2024 16:23

eseliger commented May 21, 2024

Copy link
Copy Markdown
Member Author

Merge activity

  • May 21, 12:24 PM EDT: Graphite rebased this pull request as part of a merge.
  • May 21, 12:33 PM EDT: @eseliger merged this pull request with Graphite.

@eseliger eseliger merged commit 8040a26 into main May 21, 2024
@eseliger eseliger deleted the es/05-18-gitserveraddobservabilitytochunkedmessages branch May 21, 2024 16:33
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

cla-signed team/product-platform team/source Tickets under the purview of Source - the one Source to graph it all

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants