Skip to content

[Bash][3/3] Remove benchmack tests from rerun disbled test #139422

Closed
yangw-dev wants to merge 3 commits intopytorch:mainfrom
yangw-dev:testbashchange
Closed

[Bash][3/3] Remove benchmack tests from rerun disbled test #139422
yangw-dev wants to merge 3 commits intopytorch:mainfrom
yangw-dev:testbashchange

Conversation

@yangw-dev
Copy link
Copy Markdown
Contributor

@yangw-dev yangw-dev commented Oct 31, 2024

Fixes #5774

Overview

Remove benchmark tests from rerun-disabled-tests, this is considered non-unittest.
See one page doc: [Bootcamp Task] Remove non-unittest test during rerun-disabled-tests

Steps to fix the issue

  • Create inductor-unittest.yml to handle unit test and daily rerun for inductor
  • Create Inductor-cu124-unittest.yml to handle unit tests and daily rerun for inductor-cu124
  • Disable benchmark test in mixed test such as CPP_Wrapper which includes both unittest and benchmark test

@pytorch-bot
Copy link
Copy Markdown

pytorch-bot bot commented Oct 31, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/139422

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 454f74e with merge base 29eb65f (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@yangw-dev
Copy link
Copy Markdown
Contributor Author

@pytorchbot label "topic: not user facing"

@pytorch-bot pytorch-bot bot added the topic: not user facing topic category label Oct 31, 2024
@yangw-dev yangw-dev requested a review from huydhn October 31, 2024 19:27
@yangw-dev yangw-dev changed the title [Workflow][3/3] Remove benchmack tests from rerun disbled test [Bash][3/3] Remove benchmack tests from rerun disbled test Oct 31, 2024
@yangw-dev yangw-dev marked this pull request as ready for review October 31, 2024 19:27
@yangw-dev yangw-dev requested a review from a team as a code owner October 31, 2024 19:27
Copy link
Copy Markdown
Contributor

@huydhn huydhn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@yangw-dev
Copy link
Copy Markdown
Contributor Author

@pytorchbot merge
All test passed and pr is approved

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Oct 31, 2024
@pytorchmergebot
Copy link
Copy Markdown
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

rahulsingh-intel pushed a commit to rahulsingh-intel/pytorch that referenced this pull request Nov 5, 2024
…39422)

Fixes [pytorch#5774](pytorch/test-infra#5774)
# Overview
Remove benchmark tests from rerun-disabled-tests, this is considered non-unittest.
See one page doc: [[Bootcamp Task] Remove non-unittest test during rerun-disabled-tests](https://docs.google.com/document/d/1xffkt_LNC5ZLsoVQDmuKbNqYnMUW_xYYStv66Pr-qac/edit?tab=t.0)

# Steps to fix the issue
- [ ] Create inductor-unittest.yml to handle unit test and daily rerun for inductor
- [ ] Create Inductor-cu124-unittest.yml to handle unit tests and daily rerun for inductor-cu124
- [x] Disable benchmark test in mixed test such as CPP_Wrapper which includes both unittest and benchmark test

Pull Request resolved: pytorch#139422
Approved by: https://github.com/huydhn
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk Trigger trunk jobs on your pull request Merged topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

rerun disable tests should not run benchmarks/dynamo in ciflow/inductor

3 participants