Skip to content

[release/6.0.4xx-xcode14.2] [release/7.0.2xx] [tests] Update introspection to run on latest Ventura version.#18117

Merged
rolfbjarne merged 1 commit intodotnet:release/6.0.4xx-xcode14.2from
vs-mobiletools-engineering-service2:backport-pr-18064-to-release/6.0.4xx-xcode14.2
Apr 24, 2023
Merged

[release/6.0.4xx-xcode14.2] [release/7.0.2xx] [tests] Update introspection to run on latest Ventura version.#18117
rolfbjarne merged 1 commit intodotnet:release/6.0.4xx-xcode14.2from
vs-mobiletools-engineering-service2:backport-pr-18064-to-release/6.0.4xx-xcode14.2

Conversation

@vs-mobiletools-engineering-service2
Copy link
Collaborator

@vs-mobiletools-engineering-service2 vs-mobiletools-engineering-service2 commented Apr 24, 2023

The corresponding API fixes are available in our Xcode 14.3 branch, so this is
just to make sure the current branch (supporting Xcode 14.2) doesn't have test
failures when executing on a later version of macOS.

Fixes:

Introspection.MacApiProtocolTest
	[FAIL] Coding :   1 types conforms to NSCoding but does not implement INSCoding: CAEdrMetadata
        Expected: 1
        But was:  0

    [FAIL] CAEdrMetadata conforms to NSCoding but does not implement INSCoding

		   at Introspection.ApiProtocolTest.Coding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 611
	[FAIL] Copying :   1 types conforms to NSCopying but does not implement INSCopying: CAEdrMetadata
        Expected: 1
        But was:  0

    [FAIL] CAEdrMetadata conforms to NSCopying but does not implement INSCopying

		   at Introspection.ApiProtocolTest.Copying() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 703
	[FAIL] SecureCoding :   1 types conforms to NSSecureCoding but does not implement INSSecureCoding: 
        Expected: 1
        But was:  0
        
    [FAIL] CAEdrMetadata conforms to NSSecureCoding but does not implement INSSecureCoding

		   at Introspection.ApiProtocolTest.SecureCoding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 627
		   at Introspection.MacApiProtocolTest.SecureCoding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/Mac/MacApiProtocolTest.cs:line 442
Introspection.MacApiProtocolTest : 1406.182 ms

Introspection.MacApiSelectorTest
	[FAIL] InstanceMethods :   3 errors found in 32150 instance selector validated:
        Selector not found for VideoSubscriberAccount.VSUserAccount : isDeleted in Boolean get_Deleted() on VideoSubscriberAccount.VSUserAccount
        Selector not found for VideoSubscriberAccount.VSUserAccount : setDeleted: in Void set_Deleted(Boolean) on VideoSubscriberAccount.VSUserAccount
        Selector not found for GameController.GCKeyboard : encodeWithCoder: in Void EncodeTo(Foundation.NSCoder) on GameController.GCKeyboard
        Expected: 0
        But was:  3

    [FAIL] Selector not found for VideoSubscriberAccount.VSUserAccount : isDeleted in Boolean get_Deleted() on VideoSubscriberAccount.VSUserAccount
    [FAIL] Selector not found for VideoSubscriberAccount.VSUserAccount : setDeleted: in Void set_Deleted(Boolean) on VideoSubscriberAccount.VSUserAccount
    [FAIL] Selector not found for GameController.GCKeyboard : encodeWithCoder: in Void EncodeTo(Foundation.NSCoder) on GameController.GCKeyboard
		   at Introspection.ApiSelectorTest.InstanceMethods() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiSelectorTest.cs:line 1137

Backport of #18064

@rolfbjarne
[tests] Update introspection to run on latest Ventura version.
6977f7e 
The corresponding API fixes are available in our Xcode 14.3 branch, so this is
just to make sure the current branch (supporting Xcode 14.2) doesn't have test
failures when executing on a later version of macOS.
@vs-mobiletools-engineering-service2
Copy link
Collaborator Author

vs-mobiletools-engineering-service2 commented Apr 24, 2023

❌ [PR Build] Tests on macOS M1 - Mac Big Sur (11.5) failed ❌

Failed tests are:

  • monotouch-test

Pipeline on Agent
Hash: 6977f7e5bdcb410381e7918ba2481fb7351c5071 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Collaborator Author

vs-mobiletools-engineering-service2 commented Apr 24, 2023

✅ API diff for current PR / commit

NET (empty diffs)
  • iOS: (empty diff detected)
  • tvOS: (empty diff detected)
  • MacCatalyst: (empty diff detected)
  • macOS: (empty diff detected)

✅ API diff vs stable

.NET (No breaking changes)
  • iOS: vsdrops gist (No breaking changes)
  • tvOS: (empty diff detected)
  • MacCatalyst: vsdrops gist (No breaking changes)
  • macOS: vsdrops gist (No breaking changes)
  • Microsoft.iOS vs Microsoft.MacCatalyst: vsdrops (could not create gist: file 'D:\a\1\s\change-detection\results\stable-api-comparison\diff\dotnet\iOS-MacCatalyst-diff\Microsoft.iOS.Ref\ref\net6.0\Microsoft.iOS.MacCatalyst.md' does not exist)

✅ Generator diff

Generator diff is empty

Pipeline on Agent
Hash: 6977f7e5bdcb410381e7918ba2481fb7351c5071 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Collaborator Author

vs-mobiletools-engineering-service2 commented Apr 24, 2023

❌ [PR Build] Tests on macOS M1 - Mac Ventura (13.0) failed ❌

Failed tests are:

  • monotouch-test

Pipeline on Agent
Hash: 6977f7e5bdcb410381e7918ba2481fb7351c5071 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Collaborator Author

vs-mobiletools-engineering-service2 commented Apr 24, 2023

📚 [PR Build] Artifacts 📚

Packages generated

View packages

Pipeline on Agent XAMMINI-009.Ventura
Hash: 6977f7e5bdcb410381e7918ba2481fb7351c5071 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Collaborator Author

vs-mobiletools-engineering-service2 commented Apr 24, 2023

🚀 [CI Build] Test results 🚀

Test results

✅ All tests passed on VSTS: simulator tests.

🎉 All 77 tests passed 🎉

Tests counts

⚠️ bcl: No tests selected. Html Report (VSDrops) Download
✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests: All 1 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ framework: All 4 tests passed. Html Report (VSDrops) Download
✅ generator: All 1 tests passed. Html Report (VSDrops) Download
✅ interdependent_binding_projects: All 4 tests passed. Html Report (VSDrops) Download
⚠️ install_source: No tests selected. Html Report (VSDrops) Download
✅ introspection: All 4 tests passed. Html Report (VSDrops) Download
✅ linker: All 40 tests passed. Html Report (VSDrops) Download
⚠️ mac_binding_project: No tests selected. Html Report (VSDrops) Download
⚠️ mmp: No tests selected. Html Report (VSDrops) Download
⚠️ mononative: No tests selected. Html Report (VSDrops) Download
✅ monotouch: All 11 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
⚠️ mtouch: No tests selected. Html Report (VSDrops) Download
⚠️ xammac: No tests selected. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

Pipeline on Agent
Hash: [PR build]

@rolfbjarne rolfbjarne merged commit c9132c5 into dotnet:release/6.0.4xx-xcode14.2 Apr 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@rolfbjarne rolfbjarne rolfbjarne approved these changes

Assignees

No one assigned

Labels

backported

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vs-mobiletools-engineering-service2 @rolfbjarne