Skip to content

[Profiler] Make KinetoEvent a view of Result (Part 4 (final), stragglers)#81322

Closed
robieta wants to merge 11 commits intogh/robieta/83/basefrom
gh/robieta/83/head
Closed

[Profiler] Make KinetoEvent a view of Result (Part 4 (final), stragglers)#81322
robieta wants to merge 11 commits intogh/robieta/83/basefrom
gh/robieta/83/head

Conversation

@robieta
Copy link
Contributor

@robieta robieta commented Jul 12, 2022

Stack from ghstack (oldest at bottom):

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in EventFieldsVisitor we can remove the reference wrapper and rename the visitor to AddKinetoMetadata since that's all it does now.

Differential Revision: D37490053

…ers)

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented Jul 12, 2022

🔗 Helpful links

❌ 3 New Failures

As of commit 0da3ad1 (more details on the Dr. CI page):

Expand to see more
  • 3/3 failures introduced in this PR

🕵️ 3 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages

See GitHub Actions build periodic / ios-12-5-1-arm64-metal / build (1/3)

Step: "Unknown" (full log | diagnosis details)

2022-08-08T05:10:14.9527130Z ##[error]The operation was canceled.
2022-08-08T02:21:40.7952700Z 
2022-08-08T02:21:40.7969470Z CodeSign /Users/runner/work/pytorch/pytorch/ios/TestApp/build/Release-iphoneos/TestApp.app (in target 'TestApp' from project 'TestApp')
2022-08-08T02:21:40.7970780Z     cd /Users/runner/work/pytorch/pytorch/ios/TestApp
2022-08-08T02:21:40.7971230Z     export CODESIGN_ALLOCATE\=/Applications/Xcode_13.4.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/codesign_allocate
2022-08-08T02:21:40.7971680Z     
2022-08-08T02:21:40.7971950Z     Signing Identity:     "Apple Development: Tao Xu (Q7PV3L5FKY)"
2022-08-08T02:21:40.7972260Z     Provisioning Profile: "PyTorch_CI_2022"
2022-08-08T02:21:40.7972820Z                           (4aacbe80-cff0-4415-9ae8-c84476678cd5)
2022-08-08T02:21:40.7973070Z     
2022-08-08T02:21:40.7974010Z     /usr/bin/codesign --force --sign 31F7F74EFAF97190E9C2F6C230C27D3AC1861A63 --entitlements /Users/runner/work/pytorch/pytorch/ios/TestApp/build/TestApp.build/Release-iphoneos/TestApp.build/TestApp.app.xcent --timestamp\=none --generate-entitlement-der /Users/runner/work/pytorch/pytorch/ios/TestApp/build/Release-iphoneos/TestApp.app
2022-08-08T05:10:14.9527130Z ##[error]The operation was canceled.
2022-08-08T05:10:14.9649110Z Post job cleanup.
2022-08-08T05:10:14.9734280Z Post job cleanup.
2022-08-08T05:10:16.7697490Z [command]/usr/local/bin/git version
2022-08-08T05:10:16.7701440Z git version 2.37.1
2022-08-08T05:10:16.7708660Z Copying '/Users/runner/.gitconfig' to '/Users/runner/work/_temp/752b4386-b530-4284-ae9c-a1abb020a312/.gitconfig'
2022-08-08T05:10:16.7711360Z Temporarily overriding HOME='/Users/runner/work/_temp/752b4386-b530-4284-ae9c-a1abb020a312' before making global git config changes
2022-08-08T05:10:16.7712200Z Adding repository directory to the temporary git global config as a safe directory
2022-08-08T05:10:16.7713110Z [command]/usr/local/bin/git config --global --add safe.directory /Users/runner/work/pytorch/pytorch
2022-08-08T05:10:16.7714000Z [command]/usr/local/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-08-08T05:10:16.7715220Z [command]/usr/local/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :

See GitHub Actions build periodic / ios-12-5-1-arm64-custom-ops / build (2/3)

Step: "Unknown" (full log | diagnosis details)

2022-08-08T05:10:12.1325680Z ##[error]The operation was canceled.
2022-08-08T02:20:54.7711560Z 
2022-08-08T02:20:54.7731730Z CodeSign /Users/runner/work/pytorch/pytorch/ios/TestApp/build/Release-iphoneos/TestApp.app (in target 'TestApp' from project 'TestApp')
2022-08-08T02:20:54.7732300Z     cd /Users/runner/work/pytorch/pytorch/ios/TestApp
2022-08-08T02:20:54.7733300Z     export CODESIGN_ALLOCATE\=/Applications/Xcode_13.4.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/codesign_allocate
2022-08-08T02:20:54.7734000Z     
2022-08-08T02:20:54.7734280Z     Signing Identity:     "Apple Development: Tao Xu (Q7PV3L5FKY)"
2022-08-08T02:20:54.7734630Z     Provisioning Profile: "PyTorch_CI_2022"
2022-08-08T02:20:54.7736610Z                           (4aacbe80-cff0-4415-9ae8-c84476678cd5)
2022-08-08T02:20:54.7739810Z     
2022-08-08T02:20:54.7741240Z     /usr/bin/codesign --force --sign 31F7F74EFAF97190E9C2F6C230C27D3AC1861A63 --entitlements /Users/runner/work/pytorch/pytorch/ios/TestApp/build/TestApp.build/Release-iphoneos/TestApp.build/TestApp.app.xcent --timestamp\=none --generate-entitlement-der /Users/runner/work/pytorch/pytorch/ios/TestApp/build/Release-iphoneos/TestApp.app
2022-08-08T05:10:12.1325680Z ##[error]The operation was canceled.
2022-08-08T05:10:12.1441080Z Post job cleanup.
2022-08-08T05:10:12.1521920Z Post job cleanup.
2022-08-08T05:10:12.8600380Z [command]/usr/local/bin/git version
2022-08-08T05:10:12.9265150Z git version 2.37.1
2022-08-08T05:10:12.9823440Z Copying '/Users/runner/.gitconfig' to '/Users/runner/work/_temp/2deedc91-8b97-42d9-9eb2-250f814f2dcc/.gitconfig'
2022-08-08T05:10:12.9927130Z Temporarily overriding HOME='/Users/runner/work/_temp/2deedc91-8b97-42d9-9eb2-250f814f2dcc' before making global git config changes
2022-08-08T05:10:13.0029120Z Adding repository directory to the temporary git global config as a safe directory
2022-08-08T05:10:13.0208550Z [command]/usr/local/bin/git config --global --add safe.directory /Users/runner/work/pytorch/pytorch
2022-08-08T05:10:13.0371970Z [command]/usr/local/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-08-08T05:10:13.0475320Z [command]/usr/local/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :

See GitHub Actions build periodic / ios-12-5-1-arm64 / build (3/3)

Step: "Unknown" (full log | diagnosis details)

2022-08-08T05:10:20.3567150Z ##[error]The operation was canceled.
2022-08-08T02:25:13.3325580Z 
2022-08-08T02:25:13.3345130Z CodeSign /Users/runner/work/pytorch/pytorch/ios/TestApp/build/Release-iphoneos/TestApp.app (in target 'TestApp' from project 'TestApp')
2022-08-08T02:25:13.3345740Z     cd /Users/runner/work/pytorch/pytorch/ios/TestApp
2022-08-08T02:25:13.3346320Z     export CODESIGN_ALLOCATE\=/Applications/Xcode_13.4.1.app/Contents/Developer/Toolchains/XcodeDefault.xctoolchain/usr/bin/codesign_allocate
2022-08-08T02:25:13.3346820Z     
2022-08-08T02:25:13.3347150Z     Signing Identity:     "Apple Development: Tao Xu (Q7PV3L5FKY)"
2022-08-08T02:25:13.3347540Z     Provisioning Profile: "PyTorch_CI_2022"
2022-08-08T02:25:13.3348080Z                           (4aacbe80-cff0-4415-9ae8-c84476678cd5)
2022-08-08T02:25:13.3348900Z     
2022-08-08T02:25:13.3350450Z     /usr/bin/codesign --force --sign 31F7F74EFAF97190E9C2F6C230C27D3AC1861A63 --entitlements /Users/runner/work/pytorch/pytorch/ios/TestApp/build/TestApp.build/Release-iphoneos/TestApp.build/TestApp.app.xcent --timestamp\=none --generate-entitlement-der /Users/runner/work/pytorch/pytorch/ios/TestApp/build/Release-iphoneos/TestApp.app
2022-08-08T05:10:20.3567150Z ##[error]The operation was canceled.
2022-08-08T05:10:20.3741300Z Post job cleanup.
2022-08-08T05:10:20.3884410Z Post job cleanup.
2022-08-08T05:10:21.2704760Z [command]/usr/local/bin/git version
2022-08-08T05:10:21.3805020Z git version 2.37.1
2022-08-08T05:10:21.3906150Z Copying '/Users/runner/.gitconfig' to '/Users/runner/work/_temp/abc1a3b9-0d8a-462f-9e0c-da26d19b837c/.gitconfig'
2022-08-08T05:10:21.3932430Z Temporarily overriding HOME='/Users/runner/work/_temp/abc1a3b9-0d8a-462f-9e0c-da26d19b837c' before making global git config changes
2022-08-08T05:10:21.3934490Z Adding repository directory to the temporary git global config as a safe directory
2022-08-08T05:10:21.3946750Z [command]/usr/local/bin/git config --global --add safe.directory /Users/runner/work/pytorch/pytorch
2022-08-08T05:10:21.4162160Z [command]/usr/local/bin/git config --local --name-only --get-regexp core\.sshCommand
2022-08-08T05:10:21.4302740Z [command]/usr/local/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :

This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

robieta pushed a commit that referenced this pull request Jul 12, 2022
…ers)

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

ghstack-source-id: 161259105
Pull Request resolved: #81322
@albanD albanD removed their request for review July 21, 2022 10:40
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
robieta pushed a commit that referenced this pull request Jul 22, 2022
…ers)

Pull Request resolved: #81322

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.
ghstack-source-id: 162345290

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
robieta pushed a commit that referenced this pull request Jul 30, 2022
…ers)

Pull Request resolved: #81322

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.
ghstack-source-id: 162969388

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
Taylor Robie added 3 commits August 3, 2022 10:40
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
robieta pushed a commit that referenced this pull request Aug 5, 2022
…ers)

Pull Request resolved: #81322

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.
ghstack-source-id: 163655372

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)
Copy link
Member

@aaronenyeshi aaronenyeshi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM! Also reviewed internally.

@robieta robieta added ciflow/trunk Trigger trunk jobs on your pull request ciflow/periodic Trigger jobs ran periodically on master (periodic.yml) on the PR labels Aug 5, 2022
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
robieta pushed a commit that referenced this pull request Aug 6, 2022
…ers)

Pull Request resolved: #81322

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.
ghstack-source-id: 163750426

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)
@robieta
Copy link
Contributor Author

robieta commented Aug 6, 2022

@pytorchbot merge -l

@pytorchmergebot
Copy link
Collaborator

@pytorchbot successfully started a merge job. Check the current status here

@pytorchmergebot
Copy link
Collaborator

Merge failed due to 2 additional jobs have failed, first few of them are: periodic ,periodic / buck-build-test / buck-build-test
Raised by https://github.com/pytorch/pytorch/actions/runs/2810411058

…l), stragglers)"

This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Differential Revision: [D37490053](https://our.internmc.facebook.com/intern/diff/D37490053/)

[ghstack-poisoned]
@robieta
Copy link
Contributor Author

robieta commented Aug 8, 2022

@pytorchbot merge -l

@pytorchmergebot
Copy link
Collaborator

@pytorchbot successfully started a merge job. Check the current status here

@pytorchmergebot
Copy link
Collaborator

Merge failed due to 1 additional jobs have failed, first few of them are: periodic
Raised by https://github.com/pytorch/pytorch/actions/runs/2815669061

@robieta
Copy link
Contributor Author

robieta commented Aug 8, 2022

@pytorchbot merge -f "I have tried to land this responsibly but infra is too flaky."

@pytorchmergebot
Copy link
Collaborator

@pytorchbot successfully started a merge job. Check the current status here

@github-actions
Copy link
Contributor

github-actions bot commented Aug 8, 2022

Hey @robieta.
You've committed this PR, but it does not have both a 'release notes: ...' and 'topics: ...' label. Please add one of each to the PR. The 'release notes: ...' label should represent the part of PyTorch that this PR changes (fx, autograd, distributed, etc) and the 'topics: ...' label should represent the kind of PR it is (not user facing, new feature, bug fix, perf improvement, etc). The list of valid labels can be found here for the 'release notes: ...' and here for the 'topics: ...'.
For changes that are 'topic: not user facing' there is no need for a release notes label.

@robieta robieta added the release notes: profiler release notes category label Aug 8, 2022
facebook-github-bot pushed a commit that referenced this pull request Aug 9, 2022
…ers) (#81322) (#81322)

Summary:
This PR just moves all the KinetoEvent methods which didn't fit the previous categories. Now that we no longer need to set Kineto event fields in `EventFieldsVisitor` we can remove the reference wrapper and rename the visitor to `AddKinetoMetadata` since that's all it does now.

Pull Request resolved: #81322
Approved by: https://github.com/aaronenyeshi

Test Plan:
contbuild & OSS CI, see https://hud.pytorch.org/commit/pytorch/pytorch/73ddd412475cce8575494096ff33e39bb6ea4784

Original Phabricator Test Plan:
Existing unit tests.

Reviewed By: chaekit, seemethere, kit1980

Differential Revision: D37490053

Pulled By: robieta

fbshipit-source-id: 3e8dcab51c6e5fe617306b0657f40f11b1817d3a
@facebook-github-bot facebook-github-bot deleted the gh/robieta/83/head branch August 11, 2022 14:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/periodic Trigger jobs ran periodically on master (periodic.yml) on the PR ciflow/trunk Trigger trunk jobs on your pull request cla signed Merged release notes: profiler release notes category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants