Skip to content

[JIT] RUN_CUDA -> RUN_NVFUSER to fix nvfuser ci#75134

Closed
davidberard98 wants to merge 2 commits intogh/davidberard98/82/basefrom
gh/davidberard98/82/head
Closed

[JIT] RUN_CUDA -> RUN_NVFUSER to fix nvfuser ci#75134
davidberard98 wants to merge 2 commits intogh/davidberard98/82/basefrom
gh/davidberard98/82/head

Conversation

@davidberard98
Copy link
Copy Markdown
Contributor

@davidberard98 davidberard98 commented Apr 1, 2022 •
edited
Loading

Stack from ghstack:

fixes merge issue between #75016 and #73322

@davidberard98
[JIT] RUN_CUDA -> RUN_NVFUSER to fix nvfuser ci
379aac2 
fixes merge issue between #75016 and #73322

[ghstack-poisoned]
@facebook-github-bot
Copy link
Copy Markdown
Contributor

facebook-github-bot commented Apr 1, 2022 •
edited
Loading

🔗 Helpful links

💊 CI failures summary and remediations

As of commit 456aaa4 (more details on the Dr. CI page):

  • 5/5 failures introduced in this PR

🕵️ 5 new failures recognized by patterns

The following CI failures do not appear to be due to upstream breakages

See GitHub Actions build pull / win-vs2019-cuda11.3-py3 / test (force_on_cpu, 1, 1, windows.4xlarge) (1/5)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-04-01T23:46:52.9506955Z Build left local git repository checkout dirty 
2022-04-01T23:46:51.7653080Z + assert_git_not_dirty
2022-04-01T23:46:51.7653611Z + [[ win-vs2019-cuda11.3-py3 != *rocm* ]]
2022-04-01T23:46:51.7653862Z + [[ win-vs2019-cuda11.3-py3 != *xla* ]]
2022-04-01T23:46:51.7722522Z ++ git status --porcelain
2022-04-01T23:46:52.9505379Z + git_status='?? RUN_NVFUSER'
2022-04-01T23:46:52.9505783Z + [[ -n ?? RUN_NVFUSER ]]
2022-04-01T23:46:52.9506091Z + echo 'Build left local git repository checkout dirty'
2022-04-01T23:46:52.9506350Z + echo 'git status --porcelain:'
2022-04-01T23:46:52.9506559Z + echo '?? RUN_NVFUSER'
2022-04-01T23:46:52.9506734Z + exit 1
2022-04-01T23:46:52.9506955Z Build left local git repository checkout dirty
2022-04-01T23:46:52.9507184Z git status --porcelain:
2022-04-01T23:46:52.9507355Z ?? RUN_NVFUSER
2022-04-01T23:46:52.9507527Z + cleanup
2022-04-01T23:46:52.9507685Z + retcode=1
2022-04-01T23:46:52.9507828Z + set +x
2022-04-01T23:46:52.9551088Z ##[error]Process completed with exit code 1.
2022-04-01T23:46:52.9926228Z Prepare all required actions
2022-04-01T23:46:52.9926806Z Getting action download info
2022-04-01T23:46:53.1472905Z Download action repository 'seemethere/upload-artifact-s3@v3' (SHA:9d298f4a34a19beb76876fe16bcd4aa6389bd42c)
2022-04-01T23:46:54.0010382Z Download action repository 'actions/upload-artifact@v2' (SHA:82c141cc518b40d92cc801eee768e7aafc9c2fa2)

See GitHub Actions build pull / win-vs2019-cuda11.3-py3 / test (default, 2, 2, windows.8xlarge.nvidia.gpu) (2/5)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-04-02T01:23:29.6176229Z Build left local git repository checkout dirty 
2022-04-02T01:23:23.5769606Z [W C:\actions-runner\_work\pytorch\pytorch\torch\csrc\autograd\engine.cpp:994] Warning: Using backward() with create_graph=True will create a reference cycle between the parameter and its gradient which can cause a memory leak. We recommend using autograd.grad when creating the graph to avoid this. If you have to use this function, make sure to reset the .grad fields of your parameters to None after use to break the cycle and avoid the leak. (function operator ())
2022-04-02T01:23:24.6682677Z ok
2022-04-02T01:23:24.8711885Z + assert_git_not_dirty
2022-04-02T01:23:24.8721713Z + [[ win-vs2019-cuda11.3-py3 != *rocm* ]]
2022-04-02T01:23:24.8732221Z + [[ win-vs2019-cuda11.3-py3 != *xla* ]]
2022-04-02T01:23:24.8840911Z ++ git status --porcelain
2022-04-02T01:23:29.6174373Z + git_status='?? RUN_NVFUSER'
2022-04-02T01:23:29.6174810Z + [[ -n ?? RUN_NVFUSER ]]
2022-04-02T01:23:29.6175259Z + echo 'Build left local git repository checkout dirty'
2022-04-02T01:23:29.6175826Z + echo 'git status --porcelain:'
2022-04-02T01:23:29.6176229Z Build left local git repository checkout dirty
2022-04-02T01:23:29.6176985Z git status --porcelain:
2022-04-02T01:23:29.6177270Z + echo '?? RUN_NVFUSER'
2022-04-02T01:23:29.6177466Z + exit 1
2022-04-02T01:23:29.6177659Z + cleanup
2022-04-02T01:23:29.6177852Z + retcode=1
2022-04-02T01:23:29.6178420Z + set +x
2022-04-02T01:23:29.6178652Z ?? RUN_NVFUSER
2022-04-02T01:23:29.6816383Z ##[error]Process completed with exit code 1.
2022-04-02T01:23:29.9292612Z Prepare all required actions
2022-04-02T01:23:29.9293162Z Getting action download info

See GitHub Actions build pull / win-vs2019-cpu-py3 / test (default, 2, 2, windows.4xlarge) (3/5)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-04-01T22:28:25.4202260Z + echo 'Build left local git repository checkout dirty' 
2022-04-01T22:28:22.3984795Z Generated XML report: test-reports\python-unittest\test_custom_ops\TEST-TestCustomOperators-20220401222822.xml
2022-04-01T22:28:23.6322661Z [W C:\actions-runner\_work\pytorch\pytorch\torch\csrc\autograd\engine.cpp:994] Warning: Using backward() with create_graph=True will create a reference cycle between the parameter and its gradient which can cause a memory leak. We recommend using autograd.grad when creating the graph to avoid this. If you have to use this function, make sure to reset the .grad fields of your parameters to None after use to break the cycle and avoid the leak. (function operator ())
2022-04-01T22:28:24.3368684Z ok
2022-04-01T22:28:24.3440040Z + assert_git_not_dirty
2022-04-01T22:28:24.3440311Z + [[ win-vs2019-cpu-py3 != *rocm* ]]
2022-04-01T22:28:24.3440535Z + [[ win-vs2019-cpu-py3 != *xla* ]]
2022-04-01T22:28:24.3513081Z ++ git status --porcelain
2022-04-01T22:28:25.4201465Z + git_status='?? RUN_NVFUSER'
2022-04-01T22:28:25.4201769Z Build left local git repository checkout dirty
2022-04-01T22:28:25.4202015Z + [[ -n ?? RUN_NVFUSER ]]
2022-04-01T22:28:25.4202260Z + echo 'Build left local git repository checkout dirty'
2022-04-01T22:28:25.4202531Z + echo 'git status --porcelain:'
2022-04-01T22:28:25.4202723Z + echo '?? RUN_NVFUSER'
2022-04-01T22:28:25.4202897Z + exit 1
2022-04-01T22:28:25.4203056Z + cleanup
2022-04-01T22:28:25.4203254Z git status --porcelain:
2022-04-01T22:28:25.4203439Z ?? RUN_NVFUSER
2022-04-01T22:28:25.4203611Z + retcode=1
2022-04-01T22:28:25.4203760Z + set +x
2022-04-01T22:28:25.4247632Z ##[error]Process completed with exit code 1.
2022-04-01T22:28:25.4449093Z Prepare all required actions

See GitHub Actions build pull / win-vs2019-cpu-py3 / test (default, 1, 2, windows.4xlarge) (4/5)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-04-01T22:47:38.8605295Z Build left local git repository checkout dirty 
2022-04-01T22:47:37.6499910Z + assert_git_not_dirty
2022-04-01T22:47:37.6500116Z + [[ win-vs2019-cpu-py3 != *rocm* ]]
2022-04-01T22:47:37.6500337Z + [[ win-vs2019-cpu-py3 != *xla* ]]
2022-04-01T22:47:37.6571329Z ++ git status --porcelain
2022-04-01T22:47:38.8603752Z + git_status='?? RUN_NVFUSER'
2022-04-01T22:47:38.8604237Z + [[ -n ?? RUN_NVFUSER ]]
2022-04-01T22:47:38.8604481Z + echo 'Build left local git repository checkout dirty'
2022-04-01T22:47:38.8604732Z + echo 'git status --porcelain:'
2022-04-01T22:47:38.8604918Z + echo '?? RUN_NVFUSER'
2022-04-01T22:47:38.8605084Z + exit 1
2022-04-01T22:47:38.8605295Z Build left local git repository checkout dirty
2022-04-01T22:47:38.8605509Z git status --porcelain:
2022-04-01T22:47:38.8605689Z ?? RUN_NVFUSER
2022-04-01T22:47:38.8605849Z + cleanup
2022-04-01T22:47:38.8605989Z + retcode=1
2022-04-01T22:47:38.8606139Z + set +x
2022-04-01T22:47:38.8647130Z ##[error]Process completed with exit code 1.
2022-04-01T22:47:38.8993214Z Prepare all required actions
2022-04-01T22:47:38.8993803Z Getting action download info
2022-04-01T22:47:39.0596663Z Download action repository 'seemethere/upload-artifact-s3@v3' (SHA:9d298f4a34a19beb76876fe16bcd4aa6389bd42c)
2022-04-01T22:47:39.9431419Z Download action repository 'actions/upload-artifact@v2' (SHA:82c141cc518b40d92cc801eee768e7aafc9c2fa2)

See GitHub Actions build pull / win-vs2019-cuda11.3-py3 / test (default, 1, 2, windows.8xlarge.nvidia.gpu) (5/5)

Step: "Test" (full log | diagnosis details | 🔁 rerun)

2022-04-02T00:31:39.1302537Z Build left local git repository checkout dirty 
2022-04-02T00:31:37.1794650Z Generated XML report: test-reports\python-unittest\test_jit_fuser_legacy\TEST-test_jit_fuser.TestFuser-20220402003137.xml
2022-04-02T00:31:37.8711547Z + assert_git_not_dirty
2022-04-02T00:31:37.8711910Z + [[ win-vs2019-cuda11.3-py3 != *rocm* ]]
2022-04-02T00:31:37.8712208Z + [[ win-vs2019-cuda11.3-py3 != *xla* ]]
2022-04-02T00:31:37.8807708Z ++ git status --porcelain
2022-04-02T00:31:39.1299913Z + git_status='?? RUN_NVFUSER'
2022-04-02T00:31:39.1300500Z + [[ -n ?? RUN_NVFUSER ]]
2022-04-02T00:31:39.1301014Z + echo 'Build left local git repository checkout dirty'
2022-04-02T00:31:39.1301528Z + echo 'git status --porcelain:'
2022-04-02T00:31:39.1301961Z + echo '?? RUN_NVFUSER'
2022-04-02T00:31:39.1302537Z Build left local git repository checkout dirty
2022-04-02T00:31:39.1302999Z git status --porcelain:
2022-04-02T00:31:39.1303398Z + exit 1
2022-04-02T00:31:39.1303596Z + cleanup
2022-04-02T00:31:39.1303780Z + retcode=1
2022-04-02T00:31:39.1303977Z + set +x
2022-04-02T00:31:39.1304173Z ?? RUN_NVFUSER
2022-04-02T00:31:39.1352863Z ##[error]Process completed with exit code 1.
2022-04-02T00:31:39.1821645Z Prepare all required actions
2022-04-02T00:31:39.1822287Z Getting action download info
2022-04-02T00:31:39.3597779Z Download action repository 'seemethere/upload-artifact-s3@v3' (SHA:9d298f4a34a19beb76876fe16bcd4aa6389bd42c)
This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

@davidberard98
Update on "[JIT] RUN_CUDA -> RUN_NVFUSER to fix nvfuser ci"
456aaa4 
fixes merge issue between #75016 and #73322

[ghstack-poisoned]
davidberard98 added a commit that referenced this pull request Apr 1, 2022
@davidberard98
[JIT] RUN_CUDA -> RUN_NVFUSER to fix nvfuser ci
857f21c 
fixes merge issue between #75016 and #73322

ghstack-source-id: a79f74a
Pull Request resolved: #75134
@facebook-github-bot facebook-github-bot deleted the gh/davidberard98/82/head branch May 2, 2022 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

cla signed

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@davidberard98 @facebook-github-bot