Skip to content

[dynamo] Cache size calc for differing config#111300

Closed
jon-chuang wants to merge 29 commits intogh/jon-chuang/36/basefrom
gh/jon-chuang/36/head
Closed

[dynamo] Cache size calc for differing config#111300
jon-chuang wants to merge 29 commits intogh/jon-chuang/36/basefrom
gh/jon-chuang/36/head

Conversation

@pytorch-bot
Copy link

pytorch-bot bot commented Oct 14, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/111300

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (1 Unrelated Failure)

As of commit d7496c5 with merge base 0ea126e (image):

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@jon-chuang
Copy link
Collaborator Author

@pytorchbot label "release notes: dynamo"



cc voznesenskym ezyang Chillee

[ghstack-poisoned]


cc voznesenskym ezyang Chillee

[ghstack-poisoned]


cc voznesenskym ezyang Chillee

[ghstack-poisoned]


cc voznesenskym ezyang Chillee

[ghstack-poisoned]


cc voznesenskym ezyang Chillee

[ghstack-poisoned]


cc voznesenskym ezyang Chillee

[ghstack-poisoned]


cc voznesenskym ezyang Chillee

[ghstack-poisoned]


cc voznesenskym ezyang Chillee

[ghstack-poisoned]
jon-chuang added a commit that referenced this pull request Oct 14, 2023
---

Fixes: #110682

Replaces: #111074

The guards are installed based on config that is valid at the call to `torch.compile`, rather than at any subsequent call / triggered compilation. Subsequent compilations will restore the config if there is a config mismatch of the existing global config with the saved config.

TODO:
- [X] add tests

Follow up PRs:
- [x] add revised cache size computation (follow up PR: #111300 , based on: #107496) 
- [ ] handle run-only mode?
- [ ] config restoration itself is not thread-safe (tracked: #111150)

cc voznesenskym ezyang Chillee


[ghstack-poisoned]
jon-chuang added a commit that referenced this pull request Oct 14, 2023
---

Fixes: #110682

Replaces: #111074

The guards are installed based on config that is valid at the call to `torch.compile`, rather than at any subsequent call / triggered compilation. Subsequent compilations will restore the config if there is a config mismatch of the existing global config with the saved config.

TODO:
- [X] add tests

Follow up PRs:
- [x] add revised cache size computation (follow up PR: #111300 , based on: #107496) 
- [ ] handle run-only mode?
- [ ] config restoration itself is not thread-safe (tracked: #111150)

cc voznesenskym ezyang Chillee


[ghstack-poisoned]
@ezyang
Copy link
Contributor

ezyang commented Nov 17, 2023

@pytorchbot merge

@pytorch-bot pytorch-bot bot added the ciflow/trunk Trigger trunk jobs on your pull request label Nov 17, 2023
@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@pytorchmergebot
Copy link
Collaborator

Merge failed

Reason: 1 mandatory check(s) failed. The first few are:

Dig deeper by viewing the failures on hud

Details for Dev Infra team Raised by workflow job

Failing merge rule: Core Maintainers



cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee

[ghstack-poisoned]
jon-chuang added a commit that referenced this pull request Nov 17, 2023
---

Fixes: #110682

Replaces: #111074

The guards are installed based on config that is valid at the call to `torch.compile`, rather than at any subsequent call / triggered compilation. Subsequent compilations will restore the config if there is a config mismatch of the existing global config with the saved config.

TODO:
- [X] add tests

Follow up PRs:
- [x] add revised cache size computation (follow up PR: #111300 , based on: #107496) 
- [ ] handle run-only mode?
- [ ] config restoration itself is not thread-safe (tracked: #111150)

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee


[ghstack-poisoned]
jon-chuang added a commit that referenced this pull request Nov 17, 2023
---

Fixes: #110682

Replaces: #111074

The guards are installed based on config that is valid at the call to `torch.compile`, rather than at any subsequent call / triggered compilation. Subsequent compilations will restore the config if there is a config mismatch of the existing global config with the saved config.

TODO:
- [X] add tests

Follow up PRs:
- [x] add revised cache size computation (follow up PR: #111300 , based on: #107496) 
- [ ] handle run-only mode?
- [ ] config restoration itself is not thread-safe (tracked: #111150)

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee


[ghstack-poisoned]
@jon-chuang
Copy link
Collaborator Author

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here



cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee

[ghstack-poisoned]
jon-chuang added a commit that referenced this pull request Nov 17, 2023
---

Fixes: #110682

Replaces: #111074

The guards are installed based on config that is valid at the call to `torch.compile`, rather than at any subsequent call / triggered compilation. Subsequent compilations will restore the config if there is a config mismatch of the existing global config with the saved config.

TODO:
- [X] add tests

Follow up PRs:
- [x] add revised cache size computation (follow up PR: #111300 , based on: #107496) 
- [ ] handle run-only mode?
- [ ] config restoration itself is not thread-safe (tracked: #111150)

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee


[ghstack-poisoned]
jon-chuang added a commit that referenced this pull request Nov 17, 2023
---

Fixes: #110682

Replaces: #111074

The guards are installed based on config that is valid at the call to `torch.compile`, rather than at any subsequent call / triggered compilation. Subsequent compilations will restore the config if there is a config mismatch of the existing global config with the saved config.

TODO:
- [X] add tests

Follow up PRs:
- [x] add revised cache size computation (follow up PR: #111300 , based on: #107496) 
- [ ] handle run-only mode?
- [ ] config restoration itself is not thread-safe (tracked: #111150)

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee


[ghstack-poisoned]
@pytorchmergebot
Copy link
Collaborator

Merge failed

Reason: New commits were pushed while merging. Please rerun the merge command.

Details for Dev Infra team Raised by workflow job



cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee

[ghstack-poisoned]
jon-chuang added a commit that referenced this pull request Nov 17, 2023
---

Fixes: #110682

Replaces: #111074

The guards are installed based on config that is valid at the call to `torch.compile`, rather than at any subsequent call / triggered compilation. Subsequent compilations will restore the config if there is a config mismatch of the existing global config with the saved config.

TODO:
- [X] add tests

Follow up PRs:
- [x] add revised cache size computation (follow up PR: #111300 , based on: #107496) 
- [ ] handle run-only mode?
- [ ] config restoration itself is not thread-safe (tracked: #111150)

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee


[ghstack-poisoned]
jon-chuang added a commit that referenced this pull request Nov 17, 2023
---

Fixes: #110682

Replaces: #111074

The guards are installed based on config that is valid at the call to `torch.compile`, rather than at any subsequent call / triggered compilation. Subsequent compilations will restore the config if there is a config mismatch of the existing global config with the saved config.

TODO:
- [X] add tests

Follow up PRs:
- [x] add revised cache size computation (follow up PR: #111300 , based on: #107496) 
- [ ] handle run-only mode?
- [ ] config restoration itself is not thread-safe (tracked: #111150)

cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee


[ghstack-poisoned]


cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee

[ghstack-poisoned]
@jon-chuang
Copy link
Collaborator Author

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here



cc voznesenskym penguinwu EikanWang jgong5 Guobing-Chen XiaobingSuper zhuhaozhe blzheng wenzhe-nrv jiayisunx chenyang78 aakhundov kadeng ezyang Chillee

[ghstack-poisoned]
@jon-chuang
Copy link
Collaborator Author

@pytorchbot merge

@pytorchmergebot
Copy link
Collaborator

The merge job was canceled. If you believe this is a mistake, then you can re trigger it through pytorch-bot.

@pytorchmergebot
Copy link
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants