System.Threading.Tests.Perf_Timer.SynchronousContention has regressed on macOS x64 #66774
Description
System.Threading.Tests.Perf_Timer.SynchronousContention
This particular benchmark has regressed even up to x10. I happened between preview 1 and preview 2 and is specific to macOS x64 . All Other configs are fine.
Repro:
git clone https://github.com/dotnet/performance.git
python3 ./performance/scripts/benchmarks_monthly.py net6.0 net7.0-preview2 --filter 'System.Threading.Tests.Perf_Timer.SynchronousContention'6.0 vs 7.0-preview2
Details
| Result | Base | Diff | Ratio | Operating System | Bit |
|---|---|---|---|---|---|
| Faster | 7592192700.00 | 6422264200.00 | 1.18 | Windows 11 | X64 |
| Faster | 3445500800.00 | 2991632200.00 | 1.15 | Windows 11 | X64 |
| Slower | 2753284900.00 | 3795765650.00 | 0.73 | Windows 11 | X64 |
| Same | 4362702200.00 | 4351387000.00 | 1.00 | Windows 10 | X64 |
| Same | 5140070400.00 | 5374294100.00 | 0.96 | Windows 11 | X64 |
| Slower | 3936259350.00 | 4533561150.00 | 0.87 | Windows 11 | X64 |
| Same | 3142999426.00 | 3060466877.00 | 1.03 | ubuntu 18.04 | X64 |
| Same | 3190544427.00 | 2896090257.00 | 1.10 | ubuntu 20.04 | X64 |
| Same | 4975816946.00 | 5315933153.00 | 0.94 | ubuntu 18.04 | X64 |
| Same | 3223415168.00 | 3261809279.00 | 0.99 | ubuntu 18.04 | X64 |
| Slower | 870459584.00 | 1018058722.50 | 0.86 | pop 20.04 | X64 |
| Same | 2250512250.00 | 2085430500.00 | 1.08 | alpine 3.13 | X64 |
| Same | 2175078950.00 | 2285564750.00 | 0.95 | debian 11 | X64 |
| Faster | 6984751875.00 | 2829376125.00 | 2.47 | macOS Monterey 12.2.1 | Arm64 |
| Same | 7679052700.00 | 8032133900.00 | 0.96 | Windows 10 | Arm64 |
| Same | 8556989400.00 | 8450397500.00 | 1.01 | Windows 11 | Arm64 |
| Same | 3196248800.00 | 3052868200.00 | 1.05 | Windows 10 | X86 |
| Same | 2562783800.00 | 2557121100.00 | 1.00 | Windows 10 | X86 |
| Same | 2660015150.00 | 2554015100.00 | 1.04 | Windows 10 | X86 |
| Same | 5298881900.00 | 5701486950.00 | 0.93 | Windows 10 | Arm |
| Same | 1978640207.50 | 1936352036.00 | 1.02 | macOS Big Sur 11.6.3 | X64 |
| Slower | 2720032892.00 | 30488358818.00 | 0.09 | macOS Monterey 12.2.1 | X64 |
| Slower | 1625397605.00 | 9434815791.50 | 0.17 | macOS Monterey 12.2.1 | X64 |
6.0 vs 7.0-preview1
no regression
Details
| Result | Base | Diff | Ratio | Operating System | Bit |
|---|---|---|---|---|---|
| Slower | 7592192700.00 | 9025713200.00 | 0.84 | Windows 11 | X64 |
| Same | 3445500800.00 | 3497805750.00 | 0.99 | Windows 11 | X64 |
| Same | 3503478400.00 | 3521395300.00 | 0.99 | Windows 10 | X64 |
| Slower | 2753284900.00 | 4392316050.00 | 0.63 | Windows 11 | X64 |
| Same | 4480273700.00 | 4425113900.00 | 1.01 | Windows 10 | X64 |
| Faster | 5903656900.00 | 4395902900.00 | 1.34 | Windows 11 | X64 |
| Same | 5961020800.00 | 5530985700.00 | 1.08 | Windows 11 | X64 |
| Same | 3936259350.00 | 6987893650.00 | 0.56 | Windows 11 | X64 |
| Slower | 4086706650.00 | 4782135950.00 | 0.85 | Windows 11 | X64 |
| Same | 3190544427.00 | 3533905849.00 | 0.90 | ubuntu 20.04 | X64 |
| Same | 4975816946.00 | 5295691582.00 | 0.94 | ubuntu 18.04 | X64 |
| Same | 3940314238.00 | 3937037070.00 | 1.00 | centos 7 | X64 |
| Same | 3244566566.00 | 3200415653.00 | 1.01 | ubuntu 18.04 | X64 |
| Same | 2178689950.00 | 2201137150.00 | 0.99 | alpine 3.13 | X64 |
| Same | 1993444350.00 | 2193017300.00 | 0.91 | ubuntu 18.04 | X64 |
| Same | 2064021500.00 | 2262614500.00 | 0.91 | ubuntu 20.04 | X64 |
| Same | 7934386550.00 | 7985192600.00 | 0.99 | Windows 10 | Arm64 |
| Same | 3196248800.00 | 3061675600.00 | 1.04 | Windows 10 | X86 |
| Same | 5786057350.00 | 5734487600.00 | 1.01 | Windows 10 | Arm |
| Same | 1978640207.50 | 2018054987.00 | 0.98 | macOS Big Sur 11.6.3 | X64 |
| Faster | 1492929237.50 | 1163942736.50 | 1.28 | macOS Big Sur 11.4 | X64 |
cc @kouvel