Test Roslyn-based GenAPI: regenerate source build reference packages #11225
Description
Due date: 9th of Dec. ETA ~4w. 1-2 days on a single package of various versions (usually up to 4-5 versions)
The main idea here is to regenerate all existed reference packages to prove that new GenAPI is capable to solve the problem. Gather statistics about issues still exists and where they could be solved (in GenAPI, Roslyn, etc.).
Currently in dotnet/source-build-reference-packages there are reference packages for 140 libraries, and each has [1-6] different version. Initial plan was to regenerate them all, but this no longer an option.
Below is the list of packages that A&D team suggested to start with (a representative set):
- Generate reference assembly of
System.Memory,4.5.1with the Roslyn-based GenAPI #11767 - Generate reference assembly of
Microsoft.Extensions.Primitives,2.2.1with the Roslyn-based GenAPI #11785 - Generate reference assembly of
Microsoft.Extensions.Options,2.2.1with the Roslyn-based GenAPI - Generate reference assembly of
Microsoft.Extensions.Logging,2.2.1with the Roslyn-based GenAPI #11786 - Generate reference assembly of
Microsoft.Extensions.Logging.Abstraction,2.2.1with the Roslyn-based GenAPI #11787 - Generate reference assembly of
microsoft.bcl.asyncinterfaces, of versions [1.1.0, 5.0.0] with Roslyn-based GenAPI #11327 - Generate reference assembly of
microsoft.bcl.hashcode, 1.1.1 with Roslyn-based GenAPI #11325 - Generate reference assembly of
microsoft.win32.registry,5.0.0with Roslyn-based GenAPI #11348 - Generate reference assembly of
microsoft.build.framework, with Roslyn-based GenAPI #11894 - Generate reference assembly of
microsoft.build, with Roslyn-based GenAPI #11350 - Generate reference assembly of
microsoft.build.tasks.core, with Roslyn-based GenAPI - Generate reference assembly of
microsoft.build.utilities.core, with Roslyn-based GenAPI - Generate reference assembly of
microsoft.codeanalysis.common, [4.0.1, 4.1.0] with Roslyn-based GenAPI #11955 - Generate reference assembly of
microsoft.codeanalysis.csharp, 4.0.1 with Roslyn-based GenAPI #11991 - Generate reference assembly of
microsoft.codeanalysis.workspaces.common, 4.0.1 with Roslyn-based GenAPI #11988 - Generate reference assembly of
microsoft.codeanalysis.csharp.workspaces, 4.0.1 with Roslyn-based GenAPI
We need to generate a reference package with the Roslyn-based GenAPI, compare results with a baseline (a merged reference package) and gather statistics about issues/differences between the baseline and the generated codebase: what is the problem, is it the problem in the Roslyn, or the GenAPI and provide a number, % - occurrence of the problem.
We can make a 3-way comparison: Roslyn-based <-->Baseline <-> CCi-based GenAPI