Skip to content

Conversation

@JoshuaMoelans
Copy link
Member

@JoshuaMoelans JoshuaMoelans commented Aug 29, 2025

Fixes #1342


Truncation occurrences

MAX_ENVELOPE_ITEMS

See definition https://github.com/getsentry/sentry-native/blob/master/src/sentry_envelope.h#L13

This is only used in envelope_add_item (here) which can only trigger for attachments (since the other APIs calling add_item all capture the envelope after adding the first item), so if a user sets more than 9 attachments we would lose the 10th onward.

The Envelopes docs mention that we accept as most 100 sessions per envelope, which is presumably where this MAX_ENVELOPE_ITEMS originated from. The question now is whether this also applies to other envelope items (like attachments/events/...)?

-> we should only have the limit for sessions, not attachments (or other envelope items). we should check whether we can actually construct envelopes with multiple sessions, and if so, still limit this to 100 (not 10). Remove 'truncating'(dropping) envelope items for any other type of telemetry. ( ✅ updated session test )

Out-of-Scope

Stack Traces

It was decided that Stack Trace Truncation was out of scope for this first round of SDK truncation logic updates (TODO: link new Linear ticket for this topic)

🔍 sentry_unwind_stack(..., max_frames)

Code here. Need to investigate if this is something we should be truncating still, or if Relay can handle this.

🔍 inproc MAX_FRAMES

Code here and used for unwinding the stack here

Keep non-truncated

sentry_set_tag

Correctly gets truncated to 200 characters in Relay (count including ...)
Screenshot 2025-10-17 at 09 38 04

Keep truncation

Span Tags

We keep truncation because

span tags are a legacy concept so we're not touching it ~ingest

The following was observed with this snippet:

Code Snippet ```c sentry_transaction_context_t *tx_ctx = sentry_transaction_context_new("my_tx", "op"); sentry_transaction_t *tx = sentry_transaction_start(tx_ctx, sentry_value_new_null()); sentry_span_t *span = sentry_transaction_start_child(tx, "span_op", "span_desc"); char *tag = "supermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagname"; char *tag_val = "supermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagnamesupermegalongtagname"; sentry_set_tag(tag, tag_val); sentry_span_set_tag(span, tag, tag_val); sentry_span_finish(span); sentry_transaction_finish(tx); sentry_value_t event = sentry_value_new_message_event( SENTRY_LEVEL_INFO, "my-logger", "Hello World!"); ```

sentry_span_set_tag

(from a prior discussion, TBD if this is still true)

We keep SDK-side truncation as span tags are soon to be deprecated (replaced by span attributes, which have way larger length limits (or possibly have no limited)).

‼️ todo: check if this PR addresses the missing truncation: getsentry/relay@d181bbb
(UPDATE 2025-11-13) -> we see correct truncation on transactions, but not on spans yet

code here and mention of truncation for sentry_span_set_tag here

removed in a9712b2 but seems like this is not truncated during ingestion... docs mention that tags must be less than 200 characters
Screenshot 2025-08-29 at 10 47 40

Product doesn't seem to like these large values for searchability
Screenshot 2025-08-29 at 10 53 03

@JoshuaMoelans JoshuaMoelans changed the title no longer truncate tag value chore: SDK Truncation Logic Sep 8, 2025
@JoshuaMoelans
Copy link
Member Author

To remove the MAX_ENVELOPE_ITEMS limit, I introduced a linked-list-based envelope item structure (instead of relying on a pre-allocated array of MAX_ENVELOPE_ITEMS) in 8f9a689 .

Since the only have index-based envelope item access happens inside our unit tests, there is no real performance impact. This allows for attachment counts limited only by available memory.

@JoshuaMoelans JoshuaMoelans marked this pull request as ready for review November 18, 2025 17:14
@JoshuaMoelans
Copy link
Member Author

@sentry review

@mujacica
Copy link
Contributor

Can we add a test that allocates more than 10 items in an envelope, and utilizes the functions we changed. Also, we could think about performance implications, since now we need to loop through all of the items in the linked list to find the correct one on the proper index. But two questions:

  1. Do we really need a linked list here? We are optimizing for adding case - probably makes sense?
  2. With an array and realloc we could optimize for get/search case - probably not something we need?

@JoshuaMoelans JoshuaMoelans force-pushed the joshua/chore/truncation_logic branch from 06333dd to bdebd99 Compare December 1, 2025 13:33
- no longer limited to 10; we test for 15, but have tested up to 1000 transactions locally and that works
Copy link
Contributor

@mujacica mujacica left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for adding the test.

@JoshuaMoelans JoshuaMoelans merged commit b8eae03 into master Dec 2, 2025
68 of 69 checks passed
@JoshuaMoelans JoshuaMoelans deleted the joshua/chore/truncation_logic branch December 2, 2025 10:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

chore: SDK Truncation Logic

3 participants