Skip test GetOrCreateAsync_WithUnhandledExceptionInPlugin_Throws#4831
Skip test GetOrCreateAsync_WithUnhandledExceptionInPlugin_Throws#4831
Conversation
erdembayar
left a comment
There was a problem hiding this comment.
According to https://github.com/NuGet/Entropy/tree/main/client-ci-analysis/ci-testfailure-analyzer this test failed 17 times in last 30 weeks, so this is definitely flaky test.
I didn't know that we have an analyzer to help analyze CI builds for failed/flaky tests. Good find @erdembayar. Thanks. This test has failed few times in my PR builds also. I am okay to skip this one for now. |
|
@erdembayar Azure DevOps also has an "Analytics" tab near the top of the page when viewing the pipeline. The test analytics can show the most common failures. It's a bit limited in its functionality, so a custom tool certainly has the potential for more advanced features, but if you just want to check most common test failures, it's probably quicker to used AzDO's website. |
Insert 6.4.0-rc.123 into rel/d17.4 on 11/07/2022 23:47:12 * tag '6.4.0.123': (60 commits) fix a logic error that caused AbandonedMutexException while executing migrations (release-6.4.x) (NuGet#4895) unblock source build failing due to fatal: transport 'file' not allowed error (NuGet#4867) (NuGet#4874) Signing: update to August 2022 CTL (NuGet#4791) (NuGet#4850) Merged PR 422933: Prefer BCL Directory create API over helper class (7.0.1xx-rc2) Fix empty combobox when package is not present in project file (NuGet#4844) (NuGet#4848) Fix component detection alert for microsoft.owin package (NuGet#4841) (NuGet#4845) Make release label RC, move to escrow mode Adds special case to include transitive origins in GetInstalledAndTransitivePackagesAsync API (NuGet#4824) Add longPathAware manifest to NuGet.Build.Tasks.Console (NuGet#4830) VsPackageInstallerServices should not post ProjectNotNominatedException faults (NuGet#4814) Skip test GetOrCreateAsync_WithUnhandledExceptionInPlugin_Throws (NuGet#4831) Improve OptProf pipeline job run names (NuGet#4825) Increase HttpClientHandler.MaxConnectionsPerServer to 64 to improve PM UI performance in Visual Studio (NuGet#4798) Suppress CA2213 warnings to unblock dev branch (NuGet#4823) Ensure IsVsOfflineFeed is calculated correctly on 64-bit machines (NuGet#4817) Add better handling of AggregateExceptions in static graph-based restore (NuGet#4809) Add Component Detection task into each pipeline (NuGet#4813) Localizes nuget.exe with default, embedded resource assembly lookup (NuGet#4773) Removes BrowseObjectBase class in NuGet Solution Explorer (NuGet#4807) Improve TryCreateContext (NuGet#4762) ...
Bug
Tracking issue: NuGet/Home#12122
Regression? no
Description
See linked issue for details
PR Checklist
PR has a meaningful title
PR has a linked issue.
Described changes
Tests
Documentation