Skip to content

Update benchmarks#2713

Merged
martincostello merged 1 commit intomainfrom
update-benchmark-results-after-2664
Aug 22, 2025
Merged

Update benchmarks#2713
martincostello merged 1 commit intomainfrom
update-benchmark-results-after-2664

Conversation

@martincostello
Copy link
Member

Update benchmarks after merging changes from #2664.

Just need to do some number crunching on the ratios to do a summary table of the changes.

Update benchmarks after merging changes from #2664.
@codecov
Copy link

codecov bot commented Aug 22, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 96.12%. Comparing base (a14508b) to head (a9ec43d).
⚠️ Report is 1 commits behind head on main.
✅ All tests successful. No failed tests found.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2713   +/-   ##
=======================================
  Coverage   96.12%   96.12%           
=======================================
  Files         309      309           
  Lines        7118     7118           
  Branches     1006     1006           
=======================================
  Hits         6842     6842           
  Misses        222      222           
  Partials       54       54           
Flag Coverage Δ
linux 96.12% <ø> (ø)
macos 96.12% <ø> (ø)
windows 96.11% <ø> (ø)

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@martincostello
Copy link
Member Author

5603fa0 vs. a14508b

Method Before After Ratio
NoOpAsync 36.72 ns 32.02 ns 0.87
NullResiliencePipeline 129.25 ns 128.75 ns 0.99
ExecuteCircuitBreaker_V7 111.6 ns 105.5 ns 0.95
ExecuteCircuitBreaker_V8 190.2 ns 137.7 ns 0.72
ExecuteAsync_Exception_V7 8,496.4 ns 8,001.6 ns 0.94
ExecuteAsync_Exception_V8 5,645.8 ns 5,150.7 ns 0.91
ExecuteAsync_Outcome_V8 345.8 ns 233.7 ns 0.68
CompositeComponent_ExecuteCore 24.47 ns 22.38 ns 0.91
Fallback_V7 36.09 ns 34.11 ns 0.95
Fallback_V8 1,466.52 ns 1,350.30 ns 0.92
DelegatingComponent_ExecuteCore_Jit 17.73 ns 16.79 ns 0.95
DelegatingComponent_ExecuteCore_Aot 28.07 ns 25.07 ns 0.89
ExecuteAsync_Generic 8.720 ns 7.510 ns 0.86
ExecuteAsync_NonGeneric 13.574 ns 12.465 ns 0.92
Hedging_Primary 480.9 ns 394.6 ns 0.82
Hedging_Secondary 784.6 ns 655.0 ns 0.83
Hedging_Primary_AsyncWork 3,119.4 ns 1,854.6 ns 0.59
Hedging_Secondary_AsyncWork 3,581.9 ns 2,299.9 ns 0.64
ExecuteStrategyPipeline_Generic_V7 994.4 ns 926.0 ns 0.93
ExecuteStrategyPipeline_Generic_V8 900.6 ns 766.3 ns 0.85
ExecuteStrategyPipeline_GenericTelemetry_V8 1,277.0 ns 1,042.7 ns 0.82
ExecuteStrategyPipeline_NonGeneric_V8 953.5 ns 872.1 ns 0.91
ExecuteStrategyPipeline_NonGenericTelemetry_V8 1,297.5 ns 1,125.7 ns 0.87
ExecutePipeline_V7(1) 49.19 ns 46.43 ns 0.94
ExecutePipeline_V8(1) 45.41 ns 43.76 ns 0.96
ExecutePipeline_V7(2) 107.03 ns 104.95 ns 0.98
ExecutePipeline_V8(2) 63.22 ns 59.60 ns 0.94
ExecutePipeline_V7(5) 367.20 ns 387.16 ns 1.05
ExecutePipeline_V8(5) 169.31 ns 159.45 ns 0.94
ExecutePipeline_V7(10) 813.37 ns 771.09 ns 0.95
ExecutePipeline_V8(10) 362.39 ns 347.47 ns 0.96
Predicate_SwitchExpression 7.809 ns 7.625 ns 0.98
Predicate_PredicateBuilder 14.890 ns 14.278 ns 0.96
ExecuteRateLimiter_V7 125.5 ns 122.9 ns 0.98
ExecuteRateLimiter_V8 132.3 ns 128.4 ns 0.97
ExecuteOutcomeAsync 28.96 ns 28.16 ns 0.97
ExecuteAsync_ResilienceContextAndState 55.90 ns 54.02 ns 0.97
ExecuteAsync_CancellationToken 59.75 ns 58.20 ns 0.97
ExecuteAsync_GenericStrategy_CancellationToken 62.98 ns 58.45 ns 0.93
Execute_ResilienceContextAndState 44.60 ns 31.65 ns 0.71
Execute_CancellationToken 45.80 ns 36.59 ns 0.80
Execute_GenericStrategy_CancellationToken 46.75 ns 36.80 ns 0.79
GetPipeline_Ok 7.829 ns 7.247 ns 0.93
GetPipeline_Generic_Ok 28.304 ns 27.297 ns 0.96
ExecuteRetry_V7 85.19 ns 86.09 ns 1.01
ExecuteRetry_V8 130.07 ns 109.46 ns 0.84
Execute(False, False) 43.26 ns 39.50 ns 0.91
Execute(False, True) 44.97 ns 41.71 ns 0.93
Execute(True, False) 316.54 ns 271.68 ns 0.86
Execute(True, True) 435.78 ns 323.94 ns 0.74
ExecuteTimeout_V7 185.4 ns 169.9 ns 0.92
ExecuteTimeout_V8 169.5 ns 147.6 ns 0.87

@martincostello martincostello marked this pull request as ready for review August 22, 2025 10:43
Copilot AI review requested due to automatic review settings August 22, 2025 10:43
@martincostello martincostello merged commit cf50bc5 into main Aug 22, 2025
28 checks passed
@martincostello martincostello deleted the update-benchmark-results-after-2664 branch August 22, 2025 10:44
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR updates benchmark reports to reflect performance changes after merging improvements from PR #2664. The changes show updated performance metrics including execution times, memory allocations, and ratios across various Polly Core components.

  • Updated benchmark results across 18 benchmark files
  • Performance improvements shown in most benchmark scenarios
  • Memory allocation reductions in several test cases

Reviewed Changes

Copilot reviewed 17 out of 17 changed files in this pull request and generated no comments.

Show a summary per file
File Description
Polly.Core.Benchmarks.TimeoutBenchmark-report-github.md Updated timeout benchmark results showing improved performance for both V7 and V8
Polly.Core.Benchmarks.TelemetryBenchmark-report-github.md Updated telemetry benchmark results with improved execution times
Polly.Core.Benchmarks.RetryBenchmark-report-github.md Updated retry benchmark results showing performance changes
Polly.Core.Benchmarks.ResiliencePipelineProviderBenchmark-report-github.md Updated pipeline provider benchmark results
Polly.Core.Benchmarks.ResiliencePipelineBenchmark-report-github.md Updated resilience pipeline benchmark results
Polly.Core.Benchmarks.RateLimiterBenchmark-report-github.md Updated rate limiter benchmark results
Polly.Core.Benchmarks.PredicateBenchmark-report-github.md Updated predicate benchmark results
Polly.Core.Benchmarks.PipelineBenchmark-report-github.md Updated pipeline benchmark results across multiple component configurations
Polly.Core.Benchmarks.MultipleStrategiesBenchmark-report-github.md Updated multiple strategies benchmark results
Polly.Core.Benchmarks.HedgingBenchmark-report-github.md Updated hedging benchmark results showing significant performance improvements
Polly.Core.Benchmarks.GenericOverheadBenchmark-report-github.md Updated generic overhead benchmark results
Polly.Core.Benchmarks.DelegatingComponentBenchmark-report-github.md Updated delegating component benchmark results
Polly.Core.Benchmarks.CreationBenchmark-report-github.md Updated creation benchmark results
Polly.Core.Benchmarks.CompositeComponentBenchmark-report-github.md Updated composite component benchmark results
Polly.Core.Benchmarks.CircuitBreakerOpenedBenchmark-report-github.md Updated circuit breaker opened benchmark results
Polly.Core.Benchmarks.CircuitBreakerBenchmark-report-github.md Updated circuit breaker benchmark results
Polly.Core.Benchmarks.BridgeBenchmark-report-github.md Updated bridge benchmark results

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

This was referenced Aug 22, 2025
PhilipWoulfe pushed a commit to PhilipWoulfe/F1Competition that referenced this pull request Mar 2, 2026
[//]: # (dependabot-start)
⚠️  **Dependabot is rebasing this PR** ⚠️ 

Rebasing might not happen immediately, so don't worry if this takes some
time.

Note: if you make any changes to this PR yourself, they will take
precedence over the rebase.

---

[//]: # (dependabot-end)

Updated [Polly](https://github.com/App-vNext/Polly) from 8.5.2 to 8.6.5.

<details>
<summary>Release notes</summary>

_Sourced from [Polly's
releases](https://github.com/App-vNext/Polly/releases)._

## 8.6.5

## What's Changed

* Extend NuGet package validation by @​martincostello in
App-vNext/Polly#2762
* Suppress S2094 warning by @​martincostello in
App-vNext/Polly#2765
* Refactor cake script by @​martincostello in
App-vNext/Polly#2769
* Pass timeout to `TimeoutRejectedException` by @​martincostello in
App-vNext/Polly#2827

**Full Changelog**:
App-vNext/Polly@8.6.4...8.6.5


## 8.6.4

## What's Changed

* Fix after-release and update CHANGELOG by @​martincostello in
App-vNext/Polly#2714
* Use collection expressions by @​martincostello in
App-vNext/Polly#2715
* Fix flaky mutants by @​martincostello in
App-vNext/Polly#2717
* fix documentation for ExecuteOutcomeAsync by @​carvex21 in
App-vNext/Polly#2710
* Bump MartinCostello.WaitForNuGetPackage by @​martincostello in
App-vNext/Polly#2721
* Bump sign tool by @​martincostello in
App-vNext/Polly#2722
* xunit v3 preparation by @​martincostello in
App-vNext/Polly#2723
* Add summary NuGet badges by @​martincostello in
App-vNext/Polly#2724
* Delete actionlint config by @​martincostello in
App-vNext/Polly#2730
* RateLimiting: add typed builder/guard tests and external limiter
lifetime test by @​mohammed-saalim in
App-vNext/Polly#2711
* Update Dependabot auto-merge conditions by @​martincostello in
App-vNext/Polly#2736
* Bump NuGet packages by @​martincostello in
App-vNext/Polly#2738
* Bump dotnet-stryker to 4.8.1 by @​martincostello in
App-vNext/Polly#2739
* Simplify code by @​martincostello in
App-vNext/Polly#2740
* Update zizmor by @​martincostello in
App-vNext/Polly#2746
* Use NuGet Trusted Publishing by @​martincostello in
App-vNext/Polly#2751
* Respect override for PipelineExecuting and PipelineExecuted by
@​peter-csala in App-vNext/Polly#2752

## New Contributors

* @​carvex21 made their first contribution in
App-vNext/Polly#2710
* @​mohammed-saalim made their first contribution in
App-vNext/Polly#2711

**Full Changelog**:
App-vNext/Polly@8.6.3...8.6.4


## 8.6.3

## What's Changed

* Add release notes configuration by @​martincostello in
App-vNext/Polly#2678
* Simplify release workflow by @​martincostello in
App-vNext/Polly#2679
* Sign-off commits by @​martincostello in
App-vNext/Polly#2694
* Add GitHub sponsorship by @​martincostello in
App-vNext/Polly#2695
* Refactor project dependencies by @​martincostello in
App-vNext/Polly#2696
* Add zizmor by @​martincostello in
App-vNext/Polly#2698
* Update benchmarks by @​martincostello in
App-vNext/Polly#2712
* Reduce async overhead by @​pentp in
App-vNext/Polly#2664
* Update benchmarks by @​martincostello in
App-vNext/Polly#2713

## New Contributors

* @​pentp made their first contribution in
App-vNext/Polly#2664

**Full Changelog**:
App-vNext/Polly@8.6.2...8.6.3


## 8.6.2

## What's Changed

* Performance tweaks by @​martincostello in
App-vNext/Polly#2667
* Update dependencies by @​martincostello in
App-vNext/Polly#2668
* Update benchmark results by @​martincostello in
App-vNext/Polly#2669

## New Contributors

* @​pentp made their first contribution in
App-vNext/Polly#2667

**Full Changelog**:
App-vNext/Polly@8.6.1...8.6.2


## 8.6.1

## What's Changed

* Fix integer overflow in `BulkheadSemaphoreFactory` by @​ahusseini in
App-vNext/Polly#2638
* Generate SBOM by @​martincostello in
App-vNext/Polly#2640
* Attest artifacts by @​martincostello in
App-vNext/Polly#2647

## New Contributors

* @​ahusseini made their first contribution in
App-vNext/Polly#2638

**Full Changelog**:
App-vNext/Polly@8.6.0...8.6.1

## 8.6.0

## What's Changed

* Bump Stryker by @​martincostello in
App-vNext/Polly#2476
* Fix chaos example issue and enrich notes & diagram by @​caigen in
App-vNext/Polly#2482
* Add diagram for the main chaos page sample by @​peter-csala in
App-vNext/Polly#2484
* Fix broken CI by @​martincostello in
App-vNext/Polly#2497
* Remove .NET 6 SDK by @​martincostello in
App-vNext/Polly#2501
* Use Stryker Mutator Dashboard by @​martincostello in
App-vNext/Polly#2500
* Fix Polly.Testing mutations by @​martincostello in
App-vNext/Polly#2503
* Lint PowerShell scripts by @​martincostello in
App-vNext/Polly#2504
* Improve Polly coverage by @​martincostello in
App-vNext/Polly#2505
* Improve mutation score by @​martincostello in
App-vNext/Polly#2506
* Run CodeQL for GitHub Actions by @​martincostello in
App-vNext/Polly#2498
* Add missing mutations by @​martincostello in
App-vNext/Polly#2508
* Remove dotnet tool restore by @​martincostello in
App-vNext/Polly#2513
* Add missing coverage by @​martincostello in
App-vNext/Polly#2514
* Improve mutation test perf by @​slang25 in
App-vNext/Polly#2520
* Improve coverage by @​martincostello in
App-vNext/Polly#2526
* Remove System.Text.Json reference by @​martincostello in
App-vNext/Polly#2532
* Fix test summary reliability by @​martincostello in
App-vNext/Polly#2543
* Use AuthenticodeLint by @​martincostello in
App-vNext/Polly#2553
* Use actions/create-github-app-token by @​martincostello in
App-vNext/Polly#2572
* Fix Retry strategy ShouldHandle in example code by @​marcrocny in
App-vNext/Polly#2527
* Tweak docs formatting by @​martincostello in
App-vNext/Polly#2575
* Dispose registry which contains rate limiters by @​peter-csala in
App-vNext/Polly#2578
* Improve mutation tests performance by ensuring solution file isn't
discovered by @​slang25 in App-vNext/Polly#2589
* Update LICENSE metadata by @​martincostello in
App-vNext/Polly#2590
* Add HTTP client integration samples by @​peter-csala in
App-vNext/Polly#2587
* Dedupe links by @​martincostello in
App-vNext/Polly#2592
* Add test analytics by @​martincostello in
App-vNext/Polly#2593
* Add note about context/state mix-ups by @​martincostello in
App-vNext/Polly#2598
* Emit annotation for packages by @​martincostello in
App-vNext/Polly#2601
* Add `AttemptNumber` to `HedgingPredicateArguments` by @​peter-csala in
App-vNext/Polly#2603
* .NET 10 preparation by @​martincostello in
App-vNext/Polly#2620
* Migrate to slnx by @​martincostello in
App-vNext/Polly#2623
* Fix `OnRetryArguments` comments by @​lchaoer in
App-vNext/Polly#2627
* Fix package signing by @​martincostello in
App-vNext/Polly#2631

## New Contributors

* @​caigen made their first contribution in
App-vNext/Polly#2482
* @​slang25 made their first contribution in
App-vNext/Polly#2520
* @​marcrocny made their first contribution in
App-vNext/Polly#2527
* @​lchaoer made their first contribution in
App-vNext/Polly#2627

**Full Changelog**:
App-vNext/Polly@8.5.2...8.6.0

Commits viewable in [compare
view](App-vNext/Polly@8.5.2...8.6.5).
</details>

[![Dependabot compatibility
score](https://dependabot-badges.githubapp.com/badges/compatibility_score?dependency-name=Polly&package-manager=nuget&previous-version=8.5.2&new-version=8.6.5)](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores)

Dependabot will resolve any conflicts with this PR as long as you don't
alter it yourself. You can also trigger a rebase manually by commenting
`@dependabot rebase`.

[//]: # (dependabot-automerge-start)
[//]: # (dependabot-automerge-end)

---

<details>
<summary>Dependabot commands and options</summary>
<br />

You can trigger Dependabot actions by commenting on this PR:
- `@dependabot rebase` will rebase this PR
- `@dependabot recreate` will recreate this PR, overwriting any edits
that have been made to it
- `@dependabot show <dependency name> ignore conditions` will show all
of the ignore conditions of the specified dependency
- `@dependabot ignore this major version` will close this PR and stop
Dependabot creating any more for this major version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this minor version` will close this PR and stop
Dependabot creating any more for this minor version (unless you reopen
the PR or upgrade to it yourself)
- `@dependabot ignore this dependency` will close this PR and stop
Dependabot creating any more for this dependency (unless you reopen the
PR or upgrade to it yourself)


</details>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants