Skip to content

[ao] Added function to inform dynamic vs static appropriate#79326

Closed
vspenubarthi wants to merge 7 commits intogh/vspenubarthi/7/basefrom
gh/vspenubarthi/7/head
Closed

[ao] Added function to inform dynamic vs static appropriate#79326
vspenubarthi wants to merge 7 commits intogh/vspenubarthi/7/basefrom
gh/vspenubarthi/7/head

Conversation

@vspenubarthi
Copy link
Copy Markdown
Contributor

@vspenubarthi vspenubarthi commented Jun 10, 2022

Stack from ghstack (oldest at bottom):

Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

This PR will be followed up soon with another PR that will more
rigoursly test the whole end to end performance of this system, which is
primarily how the function in this PR will be tested for functionality,
which is why this one only has 1 test.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

…ropriate

Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
@facebook-github-bot
Copy link
Copy Markdown
Contributor

facebook-github-bot commented Jun 10, 2022

🔗 Helpful links

✅ No Failures (0 Pending)

As of commit 1a5b283 (more details on the Dr. CI page):

Expand to see more

💚 💚 Looks good so far! There are no failures yet. 💚 💚


This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

vspenubarthi added a commit that referenced this pull request Jun 10, 2022
…ropriate

Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 5141b04
Pull Request resolved: #79326
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
@vspenubarthi vspenubarthi changed the title [ao][work-in-progress] Added function to inform dynamic vs static appropriate [ao] Added function to inform dynamic vs static appropriate Jun 13, 2022
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
Comment thread test/quantization/fx/test_model_report_fx.py Outdated
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Comment thread torch/ao/quantization/fx/_model_report/_detector.py
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
vspenubarthi added a commit that referenced this pull request Jun 13, 2022
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 2ea4c52
Pull Request resolved: #79326
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Comment thread torch/ao/quantization/fx/_model_report/_detector.py
Comment thread torch/ao/quantization/fx/_model_report/_detector.py
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

This PR will be followed up soon with another PR that will more
rigoursly test the whole end to end performance of this system, which is
primarily how the function in this PR will be tested for functionality,
which is why this one only has 1 test.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
vspenubarthi added a commit that referenced this pull request Jun 14, 2022
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

This PR will be followed up soon with another PR that will more
rigoursly test the whole end to end performance of this system, which is
primarily how the function in this PR will be tested for functionality,
which is why this one only has 1 test.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 7cb2dc5
Pull Request resolved: #79326
Comment thread torch/ao/quantization/fx/_model_report/_detector.py
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Comment thread torch/ao/quantization/fx/_model_report/_detector.py Outdated
Copy link
Copy Markdown
Contributor

@HDCharles HDCharles left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

see the additional comments, but otherwise looks good.

Comment thread torch/ao/quantization/fx/_model_report/_detector.py
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

This PR will be followed up soon with another PR that will more
rigoursly test the whole end to end performance of this system, which is
primarily how the function in this PR will be tested for functionality,
which is why this one only has 1 test.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

[ghstack-poisoned]
vspenubarthi added a commit that referenced this pull request Jun 14, 2022
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

This PR will be followed up soon with another PR that will more
rigoursly test the whole end to end performance of this system, which is
primarily how the function in this PR will be tested for functionality,
which is why this one only has 1 test.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

ghstack-source-id: 7e5efa7
Pull Request resolved: #79326
@vspenubarthi vspenubarthi added release notes: quantization release notes category topic: new features topic category labels Jun 15, 2022
@vspenubarthi
Copy link
Copy Markdown
Contributor Author

@pytorchbot merge -g

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

@pytorchbot successfully started a merge job. Check the current status here

@facebook-github-bot facebook-github-bot deleted the gh/vspenubarthi/7/head branch June 18, 2022 14:17
facebook-github-bot pushed a commit that referenced this pull request Jun 20, 2022
Summary:
The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

This PR will be followed up soon with another PR that will more
rigoursly test the whole end to end performance of this system, which is
primarily how the function in this PR will be tested for functionality,
which is why this one only has 1 test.

Pull Request resolved: #79326

Approved by: https://github.com/HDCharles

Test Plan:
contbuild & OSS CI, see https://hud.pytorch.org/commit/pytorch/pytorch/38952d9350e7cced8901df4cae50efddb69470a3

Test plan from GitHub:
python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewed By: malfet

Differential Revision: D37208282

Pulled By: vspenubarthi

fbshipit-source-id: 518d4287ff9b490d43db8a2146870e440f005be3
laurentdupin pushed a commit to laurentdupin/pytorch that referenced this pull request Apr 25, 2026
Summary: The _detect_dynamic_vs_static function was added to take in a
prepared fx graph model that already had ModelReportObservers built into
it and uses the collected information to determine whether input and
output are stationary or non-stationary and provides feedback on whether
to make linear modules static or dynamic based on this information.

This PR will be followed up soon with another PR that will more
rigoursly test the whole end to end performance of this system, which is
primarily how the function in this PR will be tested for functionality,
which is why this one only has 1 test.

Test Plan: python test/quantization/fx/test_model_report_fx.py TestModelReportDetectDynamicStatic

Reviewers:

Subscribers:

Tasks:

Tags:

Pull Request resolved: pytorch#79326

Approved by: https://github.com/HDCharles
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

7 participants