Skip to content

[release/7.0.2xx] [tests] Update introspection to run on latest Ventura version.#18064

Merged
rolfbjarne merged 2 commits intodotnet:release/7.0.2xxfrom
rolfbjarne:update-tests-to-run-on-ventura
Apr 17, 2023
Merged

[release/7.0.2xx] [tests] Update introspection to run on latest Ventura version.#18064
rolfbjarne merged 2 commits intodotnet:release/7.0.2xxfrom
rolfbjarne:update-tests-to-run-on-ventura

Conversation

@rolfbjarne
Copy link
Member

@rolfbjarne rolfbjarne commented Apr 14, 2023

The corresponding API fixes are available in our Xcode 14.3 branch, so this is
just to make sure the current branch (supporting Xcode 14.2) doesn't have test
failures when executing on a later version of macOS.

Fixes:

Introspection.MacApiProtocolTest
	[FAIL] Coding :   1 types conforms to NSCoding but does not implement INSCoding: CAEdrMetadata
        Expected: 1
        But was:  0

    [FAIL] CAEdrMetadata conforms to NSCoding but does not implement INSCoding

		   at Introspection.ApiProtocolTest.Coding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 611
	[FAIL] Copying :   1 types conforms to NSCopying but does not implement INSCopying: CAEdrMetadata
        Expected: 1
        But was:  0

    [FAIL] CAEdrMetadata conforms to NSCopying but does not implement INSCopying

		   at Introspection.ApiProtocolTest.Copying() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 703
	[FAIL] SecureCoding :   1 types conforms to NSSecureCoding but does not implement INSSecureCoding: 
        Expected: 1
        But was:  0
        
    [FAIL] CAEdrMetadata conforms to NSSecureCoding but does not implement INSSecureCoding

		   at Introspection.ApiProtocolTest.SecureCoding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 627
		   at Introspection.MacApiProtocolTest.SecureCoding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/Mac/MacApiProtocolTest.cs:line 442
Introspection.MacApiProtocolTest : 1406.182 ms

Introspection.MacApiSelectorTest
	[FAIL] InstanceMethods :   3 errors found in 32150 instance selector validated:
        Selector not found for VideoSubscriberAccount.VSUserAccount : isDeleted in Boolean get_Deleted() on VideoSubscriberAccount.VSUserAccount
        Selector not found for VideoSubscriberAccount.VSUserAccount : setDeleted: in Void set_Deleted(Boolean) on VideoSubscriberAccount.VSUserAccount
        Selector not found for GameController.GCKeyboard : encodeWithCoder: in Void EncodeTo(Foundation.NSCoder) on GameController.GCKeyboard
        Expected: 0
        But was:  3

    [FAIL] Selector not found for VideoSubscriberAccount.VSUserAccount : isDeleted in Boolean get_Deleted() on VideoSubscriberAccount.VSUserAccount
    [FAIL] Selector not found for VideoSubscriberAccount.VSUserAccount : setDeleted: in Void set_Deleted(Boolean) on VideoSubscriberAccount.VSUserAccount
    [FAIL] Selector not found for GameController.GCKeyboard : encodeWithCoder: in Void EncodeTo(Foundation.NSCoder) on GameController.GCKeyboard
		   at Introspection.ApiSelectorTest.InstanceMethods() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiSelectorTest.cs:line 1137

The corresponding API fixes are available in our Xcode 14.3 branch, so this is
just to make sure the current branch (supporting Xcode 14.2) doesn't have test
failures when executing on a later version of macOS.
@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2

This comment has been minimized.

@vs-mobiletools-engineering-service2
Copy link
Collaborator

💻 [PR Build] Tests on macOS M1 - Mac Big Sur (11.5) passed 💻

All tests on macOS M1 - Mac Big Sur (11.5) passed.

Pipeline on Agent
Hash: 11650deff877c4167307a5dfde6e18c31a68de87 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Collaborator

💻 [PR Build] Tests on macOS M1 - Mac Ventura (13.0) passed 💻

All tests on macOS M1 - Mac Ventura (13.0) passed.

Pipeline on Agent
Hash: 11650deff877c4167307a5dfde6e18c31a68de87 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Collaborator

✅ API diff for current PR / commit

NET (empty diffs)
  • iOS: (empty diff detected)
  • tvOS: (empty diff detected)
  • MacCatalyst: (empty diff detected)
  • macOS: (empty diff detected)

✅ API diff vs stable

.NET (No breaking changes)
  • iOS: vsdrops gist (No breaking changes)
  • tvOS: (empty diff detected)
  • MacCatalyst: vsdrops gist (No breaking changes)
  • macOS: vsdrops gist (No breaking changes)
  • Microsoft.iOS vs Microsoft.MacCatalyst: vsdrops (could not create gist: file 'D:\a\1\s\change-detection\results\stable-api-comparison\diff\dotnet\iOS-MacCatalyst-diff\Microsoft.iOS.Ref\ref\net7.0\Microsoft.iOS.MacCatalyst.md' does not exist)

✅ Generator diff

Generator diff is empty

Pipeline on Agent
Hash: 11650deff877c4167307a5dfde6e18c31a68de87 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Collaborator

📚 [PR Build] Artifacts 📚

Packages generated

View packages

Pipeline on Agent XAMBOT-1035.Ventura
Hash: 11650deff877c4167307a5dfde6e18c31a68de87 [PR build]

@vs-mobiletools-engineering-service2
Copy link
Collaborator

🚀 [CI Build] Test results 🚀

Test results

✅ All tests passed on VSTS: simulator tests.

🎉 All 77 tests passed 🎉

Tests counts

⚠️ bcl: No tests selected. Html Report (VSDrops) Download
✅ cecil: All 1 tests passed. Html Report (VSDrops) Download
✅ dotnettests: All 1 tests passed. Html Report (VSDrops) Download
✅ fsharp: All 4 tests passed. Html Report (VSDrops) Download
✅ framework: All 4 tests passed. Html Report (VSDrops) Download
✅ generator: All 1 tests passed. Html Report (VSDrops) Download
✅ interdependent_binding_projects: All 4 tests passed. Html Report (VSDrops) Download
⚠️ install_source: No tests selected. Html Report (VSDrops) Download
✅ introspection: All 4 tests passed. Html Report (VSDrops) Download
✅ linker: All 40 tests passed. Html Report (VSDrops) Download
⚠️ mac_binding_project: No tests selected. Html Report (VSDrops) Download
⚠️ mmp: No tests selected. Html Report (VSDrops) Download
⚠️ mononative: No tests selected. Html Report (VSDrops) Download
✅ monotouch: All 11 tests passed. Html Report (VSDrops) Download
✅ msbuild: All 2 tests passed. Html Report (VSDrops) Download
⚠️ mtouch: No tests selected. Html Report (VSDrops) Download
⚠️ xammac: No tests selected. Html Report (VSDrops) Download
✅ xcframework: All 4 tests passed. Html Report (VSDrops) Download
✅ xtro: All 1 tests passed. Html Report (VSDrops) Download

Pipeline on Agent
Hash: [PR build]

@rolfbjarne rolfbjarne merged commit 60b60e1 into dotnet:release/7.0.2xx Apr 17, 2023
@rolfbjarne rolfbjarne deleted the update-tests-to-run-on-ventura branch April 17, 2023 11:18
@rolfbjarne
Copy link
Member Author

/sudo backport release/6.0.4xx-xcode14.2

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Backport Job to branch release/6.0.4xx-xcode14.2 Created! The magic is happening here

@vs-mobiletools-engineering-service2
Copy link
Collaborator

Hooray! Backport succeeded! Please see https://devdiv.visualstudio.com/DevDiv/_build/results?buildId=7671736 for more details.

rolfbjarne pushed a commit that referenced this pull request Apr 24, 2023
…ction to run on latest Ventura version. (#18117)

The corresponding API fixes are available in our Xcode 14.3 branch, so this is
just to make sure the current branch (supporting Xcode 14.2) doesn't have test
failures when executing on a later version of macOS.

Fixes:

    Introspection.MacApiProtocolTest
    	[FAIL] Coding :   1 types conforms to NSCoding but does not implement INSCoding: CAEdrMetadata
            Expected: 1
            But was:  0
    
        [FAIL] CAEdrMetadata conforms to NSCoding but does not implement INSCoding
    
    		   at Introspection.ApiProtocolTest.Coding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 611
    	[FAIL] Copying :   1 types conforms to NSCopying but does not implement INSCopying: CAEdrMetadata
            Expected: 1
            But was:  0
    
        [FAIL] CAEdrMetadata conforms to NSCopying but does not implement INSCopying
    
    		   at Introspection.ApiProtocolTest.Copying() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 703
    	[FAIL] SecureCoding :   1 types conforms to NSSecureCoding but does not implement INSSecureCoding: 
            Expected: 1
            But was:  0
            
        [FAIL] CAEdrMetadata conforms to NSSecureCoding but does not implement INSSecureCoding
    
    		   at Introspection.ApiProtocolTest.SecureCoding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiProtocolTest.cs:line 627
    		   at Introspection.MacApiProtocolTest.SecureCoding() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/Mac/MacApiProtocolTest.cs:line 442
    Introspection.MacApiProtocolTest : 1406.182 ms
    
    Introspection.MacApiSelectorTest
    	[FAIL] InstanceMethods :   3 errors found in 32150 instance selector validated:
            Selector not found for VideoSubscriberAccount.VSUserAccount : isDeleted in Boolean get_Deleted() on VideoSubscriberAccount.VSUserAccount
            Selector not found for VideoSubscriberAccount.VSUserAccount : setDeleted: in Void set_Deleted(Boolean) on VideoSubscriberAccount.VSUserAccount
            Selector not found for GameController.GCKeyboard : encodeWithCoder: in Void EncodeTo(Foundation.NSCoder) on GameController.GCKeyboard
            Expected: 0
            But was:  3
    
        [FAIL] Selector not found for VideoSubscriberAccount.VSUserAccount : isDeleted in Boolean get_Deleted() on VideoSubscriberAccount.VSUserAccount
        [FAIL] Selector not found for VideoSubscriberAccount.VSUserAccount : setDeleted: in Void set_Deleted(Boolean) on VideoSubscriberAccount.VSUserAccount
        [FAIL] Selector not found for GameController.GCKeyboard : encodeWithCoder: in Void EncodeTo(Foundation.NSCoder) on GameController.GCKeyboard
    		   at Introspection.ApiSelectorTest.InstanceMethods() in /Users/builder/azdo/_work/5/s/xamarin-macios/tests/introspection/ApiSelectorTest.cs:line 1137


Backport of #18064
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants