Skip to content

fix: update memory usage test assertions#5592

Merged
jmayclin merged 10 commits intoaws:mainfrom
jmayclin:2025-10-29-fix-memory-benchmark
Nov 4, 2025
Merged

fix: update memory usage test assertions#5592
jmayclin merged 10 commits intoaws:mainfrom
jmayclin:2025-10-29-fix-memory-benchmark

Conversation

@jmayclin
Copy link
Copy Markdown
Contributor

@jmayclin jmayclin commented Oct 30, 2025

Goal

Fix the failing memory test, and add more memory information

Why

The maximum memory usage is not deterministic in CI 😦. So we can't assert on that until we figure it out.

Also, this flakiness is revealing that we don't have a super clear understanding of all the allocations that are happening.

How

So we remove the assertion on max memory, and store all of the heap information.

All of the measurements get printed out in a table, which is copied below.

Callouts

stage total_blocks total_bytes curr_blocks curr_bytes max_blocks max_bytes test_pair_size
ConnectionInit 134 64650 108 61482 85 35500 0
AfterClientHello 149 91847 116 88302 93 62320 248
AfterServerHello 353 163191 121 116669 123 102571 3524
AfterClientFinished 851 204094 257 107976 258 105777 3524
HandshakeComplete 875 206206 256 90563 258 105777 3524
ApplicationData 875 206206 256 90563 258 105777 3524

We should also makes the sensitive CI job required.

Testing

Should pass CI, and also passed locally

Related

#5329 added the memory profiler test.
#5593 is the issue that I opened to investigate the funky max memory behavior.

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@github-actions github-actions Bot added the s2n-core team label Oct 30, 2025
@jmayclin jmayclin enabled auto-merge October 30, 2025 00:38
@kaukabrizvi kaukabrizvi self-requested a review October 30, 2025 00:52
@jmayclin jmayclin disabled auto-merge October 30, 2025 00:53
Comment thread bindings/rust/standard/integration/Cargo.toml Outdated
* move Tabled to dev dependency
@dougch dougch added this pull request to the merge queue Nov 3, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Nov 3, 2025
@jmayclin jmayclin added this pull request to the merge queue Nov 3, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Nov 3, 2025
@jmayclin jmayclin added this pull request to the merge queue Nov 3, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Nov 3, 2025
@jmayclin jmayclin added this pull request to the merge queue Nov 3, 2025
@github-merge-queue github-merge-queue Bot removed this pull request from the merge queue due to failed status checks Nov 3, 2025
@jmayclin jmayclin added this pull request to the merge queue Nov 4, 2025
Merged via the queue into aws:main with commit b24be99 Nov 4, 2025
52 of 53 checks passed
@jmayclin jmayclin deleted the 2025-10-29-fix-memory-benchmark branch November 4, 2025 00:52
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants