Skip to content

[Profiler] Add heuristic to rank events base on computed metrics#80094

Closed
davidchencsl wants to merge 12 commits intogh/davidchencsl/8/basefrom
gh/davidchencsl/8/head
Closed

[Profiler] Add heuristic to rank events base on computed metrics#80094
davidchencsl wants to merge 12 commits intogh/davidchencsl/8/basefrom
gh/davidchencsl/8/head

Conversation

@davidchencsl
Copy link
Copy Markdown
Contributor

@davidchencsl davidchencsl commented Jun 22, 2022

Stack from ghstack (oldest at bottom):

Test Plan:
Add test in test_profiler.py to check idle time computation.
To test the heuristic, we use serialized real world data stored in test_profiler_utils_golden.py to ensure a run to run stable test.

@facebook-github-bot
Copy link
Copy Markdown
Contributor

facebook-github-bot commented Jun 22, 2022

🔗 Helpful links

✅ No Failures (0 Pending)

As of commit 0caab93 (more details on the Dr. CI page):

Expand to see more

💚 💚 Looks good so far! There are no failures yet. 💚 💚


This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

davidchencsl added a commit that referenced this pull request Jun 22, 2022
ghstack-source-id: d6e440f
Pull Request resolved: #80094
@davidchencsl davidchencsl requested a review from robieta June 22, 2022 22:41
@davidchencsl davidchencsl changed the title Add heuristic to rank events base on computed metrics [Profiler] Add heuristic to rank events base on computed metrics Jun 22, 2022
…etrics"


Test Plan:
Add test in test_profiler.py

[ghstack-poisoned]
…etrics"


Test Plan:
Add test in test_profiler.py

[ghstack-poisoned]
…etrics"


Test Plan:
Add test in test_profiler.py

[ghstack-poisoned]
…etrics"


Test Plan:
Add test in test_profiler.py

[ghstack-poisoned]
…etrics"


Test Plan:
Add test in test_profiler.py

[ghstack-poisoned]
…etrics"


Test Plan:
Add test in test_profiler.py

[ghstack-poisoned]
Copy link
Copy Markdown
Contributor

@robieta robieta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Still digesting the main algorithm, but had a couple thoughts on the unit tests.

Comment thread torch/profiler/_utils.py Outdated
Comment thread test/test_profiler.py
Comment thread test/test_profiler.py Outdated
…etrics"


Test Plan:
Add test in test_profiler.py

[ghstack-poisoned]
Comment thread test/test_profiler_utils_golden.py Outdated
Comment thread test/test_profiler.py Outdated
Comment thread test/test_profiler.py Outdated
Comment thread test/test_profiler.py Outdated
Comment thread test/test_profiler.py Outdated
Comment thread torch/profiler/_utils.py Outdated
Comment thread torch/profiler/_utils.py Outdated
Comment thread torch/profiler/_utils.py Outdated
Comment thread torch/profiler/_utils.py
Comment thread torch/profiler/_utils.py
…etrics"


Test Plan:
Add test in test_profiler.py to check idle time computation.
To test the heuristic, we use serialized real world data stored in test_profiler_utils_golden.py to ensure a run to run stable test.

[ghstack-poisoned]
…etrics"


Test Plan:
Add test in test_profiler.py to check idle time computation.
To test the heuristic, we use serialized real world data stored in test_profiler_utils_golden.py to ensure a run to run stable test.

[ghstack-poisoned]
…etrics"


Test Plan:
Add test in test_profiler.py to check idle time computation.
To test the heuristic, we use serialized real world data stored in test_profiler_utils_golden.py to ensure a run to run stable test.

[ghstack-poisoned]
Copy link
Copy Markdown
Contributor

@robieta robieta left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. (modulo nits) The windows failures don't look related, but probably makes sense to rebase until CI is green.

Comment thread test/test_profiler.py Outdated
Comment thread test/test_profiler.py Outdated
Comment thread torch/profiler/_utils.py Outdated
…etrics"


Test Plan:
Add test in test_profiler.py to check idle time computation.
To test the heuristic, we use serialized real world data stored in test_profiler_utils_golden.py to ensure a run to run stable test.

[ghstack-poisoned]
@davidchencsl
Copy link
Copy Markdown
Contributor Author

@pytorchbot merge

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

@pytorchbot successfully started a merge job. Check the current status here

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented Jul 5, 2022

Hey @davidchencsl.
You've committed this PR, but it does not have both a 'release notes: ...' and 'topics: ...' label. Please add one of each to the PR. The 'release notes: ...' label should represent the part of PyTorch that this PR changes (fx, autograd, distributed, etc) and the 'topics: ...' label should represent the kind of PR it is (not user facing, new feature, bug fix, perf improvement, etc). The list of valid labels can be found here for the 'release notes: ...' and here for the 'topics: ...'.
For changes that are 'topic: not user facing' there is no need for a release notes label.

facebook-github-bot pushed a commit that referenced this pull request Jul 6, 2022
) (#80094)

Summary:
Pull Request resolved: #80094
Approved by: https://github.com/robieta

Test Plan:
contbuild & OSS CI, see https://hud.pytorch.org/commit/pytorch/pytorch/007100892718cc926b4e88e6d8a8ff5616b44428

Test plan from GitHub:
Add test in test_profiler.py to check idle time computation.
To test the heuristic, we use serialized real world data stored in test_profiler_utils_golden.py to ensure a run to run stable test.

Reviewed By: mehtanirav

Differential Revision: D37648867

Pulled By: davidchencsl

fbshipit-source-id: af8af8892a42cd3912486a63ad5deb0e668024dd
@facebook-github-bot facebook-github-bot deleted the gh/davidchencsl/8/head branch July 9, 2022 14:17
laurentdupin pushed a commit to laurentdupin/pytorch that referenced this pull request Apr 25, 2026
…orch#80094)

Test Plan:
Add test in test_profiler.py to check idle time computation.
To test the heuristic, we use serialized real world data stored in test_profiler_utils_golden.py to ensure a run to run stable test.
Pull Request resolved: pytorch#80094
Approved by: https://github.com/robieta
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants