Skip to content

Remove tests from test_jit.py that are now passing#11279

Closed
driazati wants to merge 5 commits intopytorch:masterfrom
driazati:remove_excludes
Closed

Remove tests from test_jit.py that are now passing#11279
driazati wants to merge 5 commits intopytorch:masterfrom
driazati:remove_excludes

Conversation

@driazati
Copy link
Contributor

@driazati driazati commented Sep 5, 2018

A bunch of the tests that were being excluded for tracing/script for
failing are now passing, so this PR takes them out of the list

@zdevito

@apaszke
Copy link
Contributor

apaszke commented Sep 6, 2018

Can we please make mark all skipped tests as expected failures to ensure that the list will always be up to date?

test/test_jit.py Outdated

This comment was marked as off-topic.

David Riazati added 4 commits September 13, 2018 12:14
Summary:
A bunch of the tests that were being excluded for tracing/script for
failing are now passing, so this PR takes them out of the list

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
Summary:

Test Plan:

Reviewers:

Subscribers:

Tasks:

Tags:
@driazati
Copy link
Contributor Author

There are a couple flakiness issues with the tests that I'm not sure about:

  • test_nn_ctc_loss seems to succeed/fail non-deterministically on the same machine
  • test_nn_group_norm fails on certain environments

colesbury pushed a commit to colesbury/pytorch that referenced this pull request Sep 21, 2018
Summary:
Spruriously added in pytorch#11261

I had a PR to catch these automatically (pytorch#11279), but it had some issues
passing on some CI environments but not others (e.g. for
`test_nn_group_norm`), any ideas?
Pull Request resolved: pytorch#11916

Differential Revision: D9992065

Pulled By: driazati

fbshipit-source-id: 05cfa8ed9af939e8ffd5827847ee7bfe0be799b2
@zou3519 zou3519 added the oncall: jit Add this issue/PR to JIT oncall triage queue label Sep 25, 2018
@zou3519
Copy link
Contributor

zou3519 commented Sep 25, 2018

test_nn_ctc_loss seems to succeed/fail non-deterministically on the same machine
test_nn_group_norm fails on certain environments

If they're flaky we shouldn't mark them as an expected fail and we should probably just skip those for now and file an issue / note

@driazati driazati closed this Oct 24, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

oncall: jit Add this issue/PR to JIT oncall triage queue

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants