Skip to content

[dynamo] NNModuleVariable traces into call_function#89015

Closed
wconstab wants to merge 3 commits intogh/wconstab/37/basefrom
gh/wconstab/37/head
Closed

[dynamo] NNModuleVariable traces into call_function#89015
wconstab wants to merge 3 commits intogh/wconstab/37/basefrom
gh/wconstab/37/head

Conversation

@wconstab
Copy link
Contributor

@wconstab wconstab commented Nov 14, 2022

Stack from ghstack (oldest at bottom):

  • Tracing into NNModuleVariable should reduce the special-case
    nature of nn.modules in dynamo and make graphs with nn.Module
    vs user code more consistent
  • We still specialize on NNModuleVariable, and fall back to
    UnspecializedNNModuleVaraible upon mutation. This specialization
    is thought to be important for performance (reduced guards,
    ability of backends to specialize on parameters, etc)

cc @mlazos @soumith @voznesenskym @yanboliang @penguinwu @anijain2305 @EikanWang @jgong5 @Guobing-Chen @chunyuan-w @XiaobingSuper @zhuhaozhe @blzheng @Xia-Weiwen @wenzhe-nrv @jiayisunx @desertfire

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant