Skip to content

webgl: Update stable test expectations to close intermittent issue#44344

Merged
yezhizhen merged 1 commit intoservo:mainfrom
simartin:issue_44280
Apr 19, 2026
Merged

webgl: Update stable test expectations to close intermittent issue#44344
yezhizhen merged 1 commit intoservo:mainfrom
simartin:issue_44280

Conversation

@simartin
Copy link
Copy Markdown
Contributor

Since 5634eab, tex-3d-size-limit.html is not crashing anymore, and even though I updated the test expectations and the test is consistently passing locally at that commit, it's now failing some tests that should have failed since the beginning (since there's no associated check in the code).

I'm not sure why things seem to work with the previous test expectations update and will follow-up, but in the meanwhile let's update them.

With this, things seem to be pretty good:

$ ./mach test-wpt --dev tests/wpt/webgl/tests/conformance2/textures/misc/tex-3d-size-limit.html --repeat 1000 [...]
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 92000 checks (91000 subtests, 1000 tests)
Expected results: 92000
Unexpected results: 0
OK

Testing: Test seems to pass consistently with the updated expectations.
Fixes: #44280

Since 5634eab, tex-3d-size-limit.html is not crashing anymore, and
even though I updated the test expectations and the test is consistently
passing locally at that commit, it's now failing some tests that should
have failed since the beginning (since there's no associated check in
the code).

I'm not sure why things seem to work with the previous test expectations
update and will follow-up, but in the meanwhile let's update them.

With this, things seem to be pretty good:
$ ./mach test-wpt --dev tests/wpt/webgl/tests/conformance2/textures/misc/tex-3d-size-limit.html --repeat 1000
[...]
web-platform-test
~~~~~~~~~~~~~~~~~
Ran 92000 checks (91000 subtests, 1000 tests)
Expected results: 92000
Unexpected results: 0
OK

Signed-off-by: Simon Martin <simon@nasilyan.com>
@servo-highfive servo-highfive added the S-awaiting-review There is new code that needs to be reviewed. label Apr 19, 2026
@simartin
Copy link
Copy Markdown
Contributor Author

@servo-highfive servo-highfive removed the S-awaiting-review There is new code that needs to be reviewed. label Apr 19, 2026
@yezhizhen yezhizhen changed the title webgl: update test expectations webgl: Update stable test expectations to close intermittent issue Apr 19, 2026
@yezhizhen yezhizhen enabled auto-merge April 19, 2026 08:30
@yezhizhen yezhizhen added this pull request to the merge queue Apr 19, 2026
@servo-highfive servo-highfive added the S-awaiting-merge The PR is in the process of compiling and running tests on the automated CI. label Apr 19, 2026
Merged via the queue into servo:main with commit d5dab9e Apr 19, 2026
34 checks passed
@servo-highfive servo-highfive removed the S-awaiting-merge The PR is in the process of compiling and running tests on the automated CI. label Apr 19, 2026
@simartin simartin deleted the issue_44280 branch April 19, 2026 09:15
@yezhizhen
Copy link
Copy Markdown
Member

Stable unexpected results (1):
▶ ERROR /_webgl/conformance2/textures/misc/tex-3d-size-limit.html
│ → gl.texSubImage3D is not a function

│ test3DTexturePixelSize/<@http://web-platform.test:8000/_webgl/conformance2/textures/misc/tex-3d-size-limit.html:171:12
│ test3DTexturePixelSize@http://web-platform.test:8000/_webgl/conformance2/textures/misc/tex-3d-size-limit.html:159:11
│ @http://web-platform.test:8000/_webgl/conformance2/textures/misc/tex-3d-size-limit.html:183:1
│ ▶ PASS [expected FAIL] WebGL test #36
│ │ PASS [expected FAIL] WebGL test #37
│ │ PASS [expected FAIL] WebGL test #39
│ │ PASS [expected FAIL] WebGL test #40
│ │ PASS [expected FAIL] WebGL test #41
│ └ PASS [expected FAIL] WebGL test #44
│ ▶ FAIL [expected PASS] WebGL test #77
│ │ → assert_true: successfullyParsed should be true (of type boolean). Was undefined (of type undefined). expected true got false
│ │
│ │ reportTestResultsToHarness/<@http://web-platform.test:8000/_webgl/js/js-test-pre.js:115:24
│ │ Test.prototype.step@http://web-platform.test:8000/resources/testharness.js:2869:25
│ │ test@http://web-platform.test:8000/resources/testharness.js:633:30
│ │ reportTestResultsToHarness@http://web-platform.test:8000/_webgl/js/js-test-pre.js:114:15
│ │ testFailed@http://web-platform.test:8000/_webgl/js/js-test-pre.js:246:31
│ │ shouldBe@http://web-platform.test:8000/_webgl/js/js-test-pre.js:413:19
│ │ shouldBeTrue@http://web-platform.test:8000/_webgl/js/js-test-pre.js:439:37
└ └ @http://web-platform.test:8000/_webgl/js/js-test-post.js:7:13

We still have this right now?

@simartin
Copy link
Copy Markdown
Contributor Author

It seems we can flip between the expectations priori to this PR and that after it - I start to regret fixing the crash that was hiding everything ;-)

I'll look into this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Intermittent failures in /_webgl/conformance2/textures/misc/tex-3d-size-limit.html

3 participants