Skip to content

dnn(test): replace SkipTestException with tags#14814

Merged
opencv-pushbot merged 1 commit intoopencv:3.4from
alalek:dnn_skip_test_tags
Jun 25, 2019
Merged

dnn(test): replace SkipTestException with tags#14814
opencv-pushbot merged 1 commit intoopencv:3.4from
alalek:dnn_skip_test_tags

Conversation

@alalek
Copy link
Copy Markdown
Member

@alalek alalek commented Jun 15, 2019 •
edited
Loading

For easy enabling of skipped tests without touching of test code.

Example:

./bin/opencv_test_dnn --test_tag_enable=dnn_skip_ie_myriadx --test_tag=dnn_skip_ie_myriadx
./bin/opencv_test_dnn --test_tag_enable=dnn_skip_ie_myriadx
./bin/opencv_test_dnn --test_tag_force=dnn_skip_ie_myriadx

Output examples:

[ SKIPSTAT ] 449 tests via tags
[ SKIPSTAT ] TAG='mem_6gb' skip 14 tests
[ SKIPSTAT ] TAG='verylong' skip 7 tests
[ SKIPSTAT ] TAG='dnn_skip_ie_myriadx' skip 131 tests
[ SKIPSTAT ] TAG='dnn_skip_ocl_fp16' skip 21 tests
[ SKIPSTAT ] TAG='dnn_skip_ie_2019r1' skip 0 tests (150 times in extra skip list)
[ SKIPSTAT ] TAG='dnn_skip_ie' skip 250 tests
[ SKIPSTAT ] TAG='dnn_skip_ie_ocl' skip 10 tests
[ SKIPSTAT ] TAG='dnn_skip_ie_ocl_fp16' skip 16 tests

[ SKIPSTAT ] 370 tests via tags
[ SKIPSTAT ] TAG='mem_6gb' skip 14 tests
[ SKIPSTAT ] TAG='verylong' skip 7 tests
[ SKIPSTAT ] TAG='dnn_skip_ie_myriad2' skip 52 tests
[ SKIPSTAT ] TAG='dnn_skip_ocl_fp16' skip 21 tests
[ SKIPSTAT ] TAG='dnn_skip_ie_2019r1' skip 0 tests (102 times in extra skip list)
[ SKIPSTAT ] TAG='dnn_skip_ie' skip 250 tests
[ SKIPSTAT ] TAG='dnn_skip_ie_ocl' skip 10 tests
[ SKIPSTAT ] TAG='dnn_skip_ie_ocl_fp16' skip 16 tests

force_builders=Custom,Custom Win,Custom Mac
docker_image:Custom=ubuntu-openvino-2019r1:16.04
docker_image:Custom Win=openvino-2019r1
docker_image:Custom Mac=openvino-2019r1
test_modules=dnn,python2,python3,java

buildworker:Custom=linux-1
test_opencl:Custom=ON
test_bigdata:Custom=1
test_filter:Custom=*

ci_branch:Linux AVX2=no-checks
docker_image:Linux AVX2=ubuntu-openvino-2019r1:16.04
buildworker:Linux AVX2=linux-2
test_opencl:Linux AVX2=ON
test_bigdata:Linux AVX2=1
test_filter:Linux AVX2=*

dkurt
dkurt approved these changes Jun 25, 2019
View reviewed changes
Copy link
Copy Markdown
Member

@dkurt dkurt left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 Thank you!

@dkurt dkurt self-assigned this Jun 25, 2019
@opencv-pushbot opencv-pushbot merged commit 894f208 into opencv:3.4 Jun 25, 2019
opencv-pushbot pushed a commit that referenced this pull request Jun 25, 2019
@alalek
Merge pull request #14814 from alalek:dnn_skip_test_tags
44d146a
@alalek alalek mentioned this pull request Jun 26, 2019
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dkurt dkurt dkurt approved these changes

Assignees

@dkurt dkurt

Labels

category: dnn test

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@alalek @dkurt @opencv-pushbot