ensure user modes are disabled when running aot_compile_joint_with_descriptors#169023
ensure user modes are disabled when running aot_compile_joint_with_descriptors#169023bdhirsh wants to merge 17 commits intogh/bdhirsh/679/basefrom
Conversation
…scriptors [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/169023
Note: Links to docs will display an error until the docs builds have been completed. ✅ You can merge normally! (2 Unrelated Failures)As of commit 9e704ce with merge base c49edf7 ( FLAKY - The following job failed but was likely due to flakiness present on trunk:
UNSTABLE - The following job is marked as unstable, possibly due to flakiness on trunk:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
|
@pytorchbot merge |
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
|
@pytorchbot merge |
Merge startedYour change will be merged once all checks pass (ETA 0-4 Hours). Learn more about merging in the wiki. Questions? Feedback? Please reach out to the PyTorch DevX Team |
Merge failedReason: 1 jobs have failed, first few of them are: trunk / linux-jammy-rocm-py3.10 / test (default, 3, 6, linux.rocm.gpu.gfx942.1) Details for Dev Infra teamRaised by workflow job |
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…scriptors ghstack-source-id: 30f140a Pull Request resolved: pytorch/pytorch#169023
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
…int_with_descriptors" In vanilla torch.compile, dynamo disables all active modes during compilation: [https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151](https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py?brid=t6D9McqWPJ2TbxhsrYj_dQ#L2151) When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation. We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in `aot_compile_joint_with_descriptors` directly. [ghstack-poisoned]
|
Starting merge as part of PR stack under #169295 |
1 similar comment
|
Starting merge as part of PR stack under #169295 |
…scriptors ghstack-source-id: 2230e15 Pull Request resolved: pytorch/pytorch#169023
|
Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as |
In vanilla torch.compile, dynamo disables all active modes during compilation: https://github.com/pytorch/pytorch/blob/main/torch/_dynamo/convert_frame.py#L2151
When using the compile pipeline flow that splits graph capture from compilation, since we split graph capture and compilation into two stages, we only end up disabling modes during the graph capture step but not compilation.
We already have a notion of an ExitStack, so one option would have been for me to arrange for the ExitStack to include a call to disable modes. I found it a bit unwieldy, though, since today only the AOTAutograd code handles the exit stack, and the context manager that I need is used by dynamo, so instead I just manually popped modes in
aot_compile_joint_with_descriptorsdirectly.Stack from ghstack (oldest at bottom):