We are planning to turn on the inline_inbuilt_nn_modules flag to True by default. There are a few hiccups here and there, but we will turn on the flag and fix these issues later. This is the issue to track.
### Tasks
- [ ] https://github.com/pytorch/pytorch/issues/130859
- [ ] https://github.com/pytorch/pytorch/issues/131693
- [ ] https://github.com/pytorch/pytorch/issues/132373
- [ ] https://github.com/pytorch/pytorch/issues/131929
- [ ] https://github.com/pytorch/pytorch/issues/132470
- [ ] https://github.com/pytorch/pytorch/issues/132714
- [ ] https://github.com/pytorch/pytorch/issues/132872
🐛 Describe the bug
We are planning to turn on the inline_inbuilt_nn_modules flag to True by default. There are a few hiccups here and there, but we will turn on the flag and fix these issues later. This is the issue to track.
cc @ezyang @chauhang @penguinwu @voznesenskym @EikanWang @jgong5 @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @chenyang78 @kadeng @amjames