Skip to content

TestModels_new_jit_API.test_inception is flaky #79540

@zengk95

Description

@zengk95

🐛 Describe the bug

The TestModels_new_jit_API.test_inception test is flaky. It's failed 3 times in a row on master and then started working again after no meaningful changes.

image

2022-06-14T16:29:53.6327793Z SKIPPED [1] test/onnx/test_utility_funs.py:680: Unsupported opset_version: 10 < 11
2022-06-14T16:29:53.6328112Z SKIPPED [1] test/onnx/test_utility_funs.py:134: Unsupported opset_version: 10 < 11
2022-06-14T16:29:53.6328414Z SKIPPED [1] test/onnx/test_utility_funs.py:757: Unsupported opset_version: 11 < 15
2022-06-14T16:29:53.6328727Z SKIPPED [1] test/onnx/test_utility_funs.py:913: Unsupported opset_version: 11 < 15
2022-06-14T16:29:53.6329038Z SKIPPED [1] test/onnx/test_utility_funs.py:873: Unsupported opset_version: 11 < 15
2022-06-14T16:29:53.6329353Z SKIPPED [1] test/onnx/test_utility_funs.py:937: Unsupported opset_version: 11 < 15
2022-06-14T16:29:53.6329653Z SKIPPED [1] test/onnx/test_utility_funs.py:1131: Unsupported opset_version: 11 > 10
2022-06-14T16:29:53.6330004Z SKIPPED [1] test/onnx/test_utility_funs.py:757: Unsupported opset_version: 12 < 15
2022-06-14T16:29:53.6330322Z SKIPPED [1] test/onnx/test_utility_funs.py:913: Unsupported opset_version: 12 < 15
2022-06-14T16:29:53.6330627Z SKIPPED [1] test/onnx/test_utility_funs.py:873: Unsupported opset_version: 12 < 15
2022-06-14T16:29:53.6330945Z SKIPPED [1] test/onnx/test_utility_funs.py:937: Unsupported opset_version: 12 < 15
2022-06-14T16:29:53.6331259Z SKIPPED [1] test/onnx/test_utility_funs.py:1131: Unsupported opset_version: 12 > 10
2022-06-14T16:29:53.6331577Z SKIPPED [1] test/onnx/test_utility_funs.py:757: Unsupported opset_version: 13 < 15
2022-06-14T16:29:53.6331874Z SKIPPED [1] test/onnx/test_utility_funs.py:913: Unsupported opset_version: 13 < 15
2022-06-14T16:29:53.6332189Z SKIPPED [1] test/onnx/test_utility_funs.py:873: Unsupported opset_version: 13 < 15
2022-06-14T16:29:53.6332502Z SKIPPED [1] test/onnx/test_utility_funs.py:937: Unsupported opset_version: 13 < 15
2022-06-14T16:29:53.6332808Z SKIPPED [1] test/onnx/test_utility_funs.py:1131: Unsupported opset_version: 13 > 10
2022-06-14T16:29:53.6333124Z SKIPPED [1] test/onnx/test_utility_funs.py:757: Unsupported opset_version: 14 < 15
2022-06-14T16:29:53.6333435Z SKIPPED [1] test/onnx/test_utility_funs.py:913: Unsupported opset_version: 14 < 15
2022-06-14T16:29:53.6333768Z SKIPPED [1] test/onnx/test_utility_funs.py:873: Unsupported opset_version: 14 < 15
2022-06-14T16:29:53.6334066Z SKIPPED [1] test/onnx/test_utility_funs.py:937: Unsupported opset_version: 14 < 15
2022-06-14T16:29:53.6334383Z SKIPPED [1] test/onnx/test_utility_funs.py:1131: Unsupported opset_version: 14 > 10
2022-06-14T16:29:53.6334702Z SKIPPED [1] test/onnx/test_utility_funs.py:1131: Unsupported opset_version: 15 > 10
2022-06-14T16:29:53.6335017Z FAILED test/onnx/test_models_onnxruntime.py::TestModels_new_jit_API::test_inception
2022-06-14T16:29:53.6335199Z 
2022-06-14T16:29:53.6335274Z Results (1120.92s):
2022-06-14T16:29:53.6335495Z      393 passed
2022-06-14T16:29:53.6335710Z        1 failed
2022-06-14T16:29:53.6336041Z          - test/onnx/test_models.py:155 TestModels_new_jit_API.test_inception
2022-06-14T16:29:53.6336326Z       60 skipped
2022-06-14T16:29:54.4670969Z ##[error]Process completed with exit code 1.
2022-06-14T16:29:54.4730658Z Prepare all required actions
2022-06-14T16:29:54.4730993Z Getting action download info
<probably uninteresting folded group, click to show>

Versions

n/a

cc @ezyang @gchanan @zou3519

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions