A number of C# and VB compiler unit-tests utilizing formatting of numbers fail in CI due to a baseline difference when run on CoreCLR against Microsoft.NETCore.App 3.0.0-preview4-27420-5. The formatting of numbers possibly became dependent on environment. 

The tests do not fail when I run them locally, but failed in CI (https://dev.azure.com/dnceng/public/_build/results?buildId=102071).
```
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Release\Microsoft.CodeAnalysis.VisualBasic.Emit.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\VisualBasic\Test\Emit\Microsoft.CodeAnalysis.VisualBasic.Emit.UnitTests.vbproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Release\Microsoft.CodeAnalysis.CSharp.Semantic.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\CSharp\Test\Semantic\Microsoft.CodeAnalysis.CSharp.Semantic.UnitTests.csproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Release\Microsoft.CodeAnalysis.CSharp.Scripting.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Scripting\CSharpTest\Microsoft.CodeAnalysis.CSharp.Scripting.UnitTests.csproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Release\Microsoft.CodeAnalysis.VisualBasic.Semantic.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\VisualBasic\Test\Semantic\Microsoft.CodeAnalysis.VisualBasic.Semantic.UnitTests.vbproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Release\Microsoft.CodeAnalysis.CSharp.Syntax.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\CSharp\Test\Syntax\Microsoft.CodeAnalysis.CSharp.Syntax.UnitTests.csproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Release\Microsoft.CodeAnalysis.VisualBasic.Syntax.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\VisualBasic\Test\Syntax\Microsoft.CodeAnalysis.VisualBasic.Syntax.UnitTests.vbproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Release\Microsoft.CodeAnalysis.CSharp.Emit.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\CSharp\Test\Emit\Microsoft.CodeAnalysis.CSharp.Emit.UnitTests.csproj]
    0 Warning(s)
    7 Error(s)

XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Debug\Microsoft.CodeAnalysis.CSharp.Emit.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\CSharp\Test\Emit\Microsoft.CodeAnalysis.CSharp.Emit.UnitTests.csproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Debug\Microsoft.CodeAnalysis.CSharp.Syntax.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\CSharp\Test\Syntax\Microsoft.CodeAnalysis.CSharp.Syntax.UnitTests.csproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Debug\Microsoft.CodeAnalysis.CSharp.Semantic.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\CSharp\Test\Semantic\Microsoft.CodeAnalysis.CSharp.Semantic.UnitTests.csproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Debug\Microsoft.CodeAnalysis.VisualBasic.Emit.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\VisualBasic\Test\Emit\Microsoft.CodeAnalysis.VisualBasic.Emit.UnitTests.vbproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Debug\Microsoft.CodeAnalysis.VisualBasic.Semantic.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\VisualBasic\Test\Semantic\Microsoft.CodeAnalysis.VisualBasic.Semantic.UnitTests.vbproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Debug\Microsoft.CodeAnalysis.VisualBasic.Syntax.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Compilers\VisualBasic\Test\Syntax\Microsoft.CodeAnalysis.VisualBasic.Syntax.UnitTests.vbproj]
XUnit : error : Tests failed: F:\vsagent\1\s\artifacts\TestResults\Debug\Microsoft.CodeAnalysis.CSharp.Scripting.UnitTests_netcoreapp2.1_x64.html [netcoreapp2.1|x64] [F:\vsagent\1\s\src\Scripting\CSharpTest\Microsoft.CodeAnalysis.CSharp.Scripting.UnitTests.csproj]
    0 Warning(s)
    7 Error(s)
```

The tests are temporarily disabled for CoreClr in DefaultInterfaceImplementation branch. Need to decide what to do about them.

The test logs are attached:
[Windows CoreClr Release.zip](https://github.com/dotnet/roslyn/files/2890506/Windows.CoreClr.Release.zip)


[Windows CoreClr Debug.zip](https://github.com/dotnet/roslyn/files/2890497/Windows.CoreClr.Debug.zip)


Provide feedback

Saved searches

Use saved searches to filter your results more quickly

A number of C# and VB compiler unit-tests utilizing formatting of numbers fail in CI due to a baseline difference when run on CoreCLR against Microsoft.NETCore.App 3.0.0-preview4-27420-5. The formatting of numbers possibly became dependent on environment. #33564

Metadata

Assignees

Labels

Type

Fields

Projects

Milestone

Relationships

Development

A number of C# and VB compiler unit-tests utilizing formatting of numbers fail in CI due to a baseline difference when run on CoreCLR against Microsoft.NETCore.App 3.0.0-preview4-27420-5. The formatting of numbers possibly became dependent on environment. #33564

Description

Metadata

Metadata

Assignees

Labels

Type

Fields

Projects

Milestone

Relationships

Development

Issue actions