Since the release of 2.2 to stable, flutter/plugins CI has failing a number of iOS tests just on stable. An example failure:
https://github.com/flutter/plugins/runs/2632402452
The symptoms are generally crashes when trying to run xctest tests, although it seems like sometimes we get hangs instead.
We never saw this on master, even when master was at point where it would have branched off to 2.2. (We don't currently run tests on beta, but I tried enabling them for the current beta and it fails as well.)
This started on unrelated changes; the last passing run was with Flutter 2.0.6, and the first failing run was with 2.2 (we use channel names, not pinned versions, in the CI currently, so out-of-band breakage like this is a known possibility). After some bisecting I narrowed it down to
- 2.2.0-10.0.pre: Good
- 2.2.0-10.1.pre: Bad
Which points to: #80459
Locally I was able to reproduce and further narrow it down to the engine roll from
56b1355
to
d2a2e93510ad6cfc3d62a90d903b7056e4da8264
in that PR.
I'm able to consistently reproduce locally; my setup is Big Sur 11.3.1, Xcode 12.5.
The repro steps I was following since I was trying to stick close to flutter/plugins CI:
- Check out flutter/plugins (at head)
xcrun simctl create Flutter-iPhone com.apple.CoreSimulator.SimDeviceType.iPhone-11 com.apple.CoreSimulator.SimRuntime.iOS-14-5 | xargs xcrun simctl boot./script/tool_runner.sh build-examples --plugins local_auth --ipa./script/tool_runner.sh xctest --plugins local_auth --ios-destination "platform=iOS Simulator,name=iPhone 11,OS=latest"
Other plugins are broken as well, but doing just local_auth is sufficient to repro.
/cc @christopherfujino @gaaclarke @jmagman
Since the release of 2.2 to stable, flutter/plugins CI has failing a number of iOS tests just on stable. An example failure:
https://github.com/flutter/plugins/runs/2632402452
The symptoms are generally crashes when trying to run xctest tests, although it seems like sometimes we get hangs instead.
We never saw this on master, even when master was at point where it would have branched off to 2.2. (We don't currently run tests on beta, but I tried enabling them for the current beta and it fails as well.)
This started on unrelated changes; the last passing run was with Flutter 2.0.6, and the first failing run was with 2.2 (we use channel names, not pinned versions, in the CI currently, so out-of-band breakage like this is a known possibility). After some bisecting I narrowed it down to
Which points to: #80459
Locally I was able to reproduce and further narrow it down to the engine roll from
56b1355
to
d2a2e93510ad6cfc3d62a90d903b7056e4da8264
in that PR.
I'm able to consistently reproduce locally; my setup is Big Sur 11.3.1, Xcode 12.5.
The repro steps I was following since I was trying to stick close to flutter/plugins CI:
xcrun simctl create Flutter-iPhone com.apple.CoreSimulator.SimDeviceType.iPhone-11 com.apple.CoreSimulator.SimRuntime.iOS-14-5 | xargs xcrun simctl boot./script/tool_runner.sh build-examples --plugins local_auth --ipa./script/tool_runner.sh xctest --plugins local_auth --ios-destination "platform=iOS Simulator,name=iPhone 11,OS=latest"Other plugins are broken as well, but doing just local_auth is sufficient to repro.
/cc @christopherfujino @gaaclarke @jmagman