Skip to content

Update quantized README for registering operators with new API.#36531

Closed
ezyang wants to merge 6 commits intogh/ezyang/723/basefrom
gh/ezyang/723/head
Closed

Update quantized README for registering operators with new API.#36531
ezyang wants to merge 6 commits intogh/ezyang/723/basefrom
gh/ezyang/723/head

Conversation

@ezyang
Copy link
Copy Markdown
Contributor

@ezyang ezyang commented Apr 13, 2020

Stack from ghstack:

Signed-off-by: Edward Z. Yang ezyang@fb.com

Differential Revision: D21017670

Signed-off-by: Edward Z. Yang <ezyang@fb.com>

[ghstack-poisoned]
@dr-ci
Copy link
Copy Markdown

dr-ci Bot commented Apr 13, 2020

💊 Build failures summary and remediations

As of commit 3563be4 (more details on the Dr. CI page):


  • 4/4 failures introduced in this PR

🕵️ 4 new failures recognized by patterns

The following build failures do not appear to be due to upstream breakages:

See CircleCI build pytorch_linux_xenial_py3_6_gcc5_4_build (1/4)

Step: "Build" (full log | pattern match details | 🔁 rerun)

Automatic merge failed; fix conflicts and then commit the result.
 
  git checkout -b <new-branch-name> 
 
HEAD is now at 3563be4701 Update on "Update quantized README for registering operators with new API." 
+ git reset --hard 3563be4701d825a63cfa3f5a89c7912a85a57e81 
HEAD is now at 3563be4701 Update on "Update quantized README for registering operators with new API." 
+ git merge --allow-unrelated-histories --no-edit --no-ff f98e0a099a0c035631b15fdde31092f38cbdccf1 
Auto-merging tools/code_analyzer/run_analyzer.sh 
CONFLICT (content): Merge conflict in tools/code_analyzer/run_analyzer.sh 
Removing caffe2/python/operator_test/mkl_speed_test.py 
Automatic merge failed; fix conflicts and then commit the result. 

See CircleCI build pytorch_linux_xenial_py3_clang5_mobile_custom_build_static (2/4)

Step: "Build" (full log | pattern match details | 🔁 rerun)

Apr 15 18:17:05 caused by: Connection refused (os error 111)
Apr 15 18:17:05 +++ eval 'extract_trap_cmd ' 
Apr 15 18:17:05 ++++ extract_trap_cmd 
Apr 15 18:17:05 ++++ printf '%s\n' '' 
Apr 15 18:17:05 +++ printf '%s\n' cleanup 
Apr 15 18:17:05 ++ trap -- ' 
Apr 15 18:17:05 cleanup' EXIT 
Apr 15 18:17:05 ++ which sccache 
Apr 15 18:17:05 ++ sccache --stop-server 
Apr 15 18:17:05 Stopping sccache server... 
Apr 15 18:17:05 error: couldn't connect to server 
Apr 15 18:17:05 caused by: Connection refused (os error 111) 
Apr 15 18:17:05 ++ true 
Apr 15 18:17:05 ++ rm /var/lib/jenkins/sccache_error.log 
Apr 15 18:17:05 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory 
Apr 15 18:17:05 ++ true 
Apr 15 18:17:05 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log 
Apr 15 18:17:05 ++ SCCACHE_IDLE_TIMEOUT=1200 
Apr 15 18:17:05 ++ RUST_LOG=sccache::server=error 
Apr 15 18:17:05 ++ sccache --start-server 
Apr 15 18:17:05 Starting sccache server... 
Apr 15 18:17:05 ++ sccache --zero-stats 

See CircleCI build pytorch_linux_xenial_py3_clang5_mobile_custom_build_dynamic (3/4)

Step: "Build" (full log | pattern match details | 🔁 rerun)

Apr 15 18:19:00 caused by: Connection refused (os error 111)
Apr 15 18:19:00 ++++ trap -p EXIT 
Apr 15 18:19:00 +++ eval 'extract_trap_cmd ' 
Apr 15 18:19:00 ++++ extract_trap_cmd 
Apr 15 18:19:00 ++++ printf '%s\n' '' 
Apr 15 18:19:00 +++ printf '%s\n' cleanup 
Apr 15 18:19:00 ++ trap -- ' 
Apr 15 18:19:00 cleanup' EXIT 
Apr 15 18:19:00 ++ which sccache 
Apr 15 18:19:00 ++ sccache --stop-server 
Apr 15 18:19:00 error: couldn't connect to server 
Apr 15 18:19:00 caused by: Connection refused (os error 111) 
Apr 15 18:19:00 Stopping sccache server... 
Apr 15 18:19:00 ++ true 
Apr 15 18:19:00 ++ rm /var/lib/jenkins/sccache_error.log 
Apr 15 18:19:00 rm: cannot remove '/var/lib/jenkins/sccache_error.log': No such file or directory 
Apr 15 18:19:00 ++ true 
Apr 15 18:19:00 ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log 
Apr 15 18:19:00 ++ SCCACHE_IDLE_TIMEOUT=1200 
Apr 15 18:19:00 ++ RUST_LOG=sccache::server=error 
Apr 15 18:19:00 ++ sccache --start-server 
Apr 15 18:19:00 Starting sccache server... 

See CircleCI build pytorch_xla_linux_xenial_py3_6_clang7_build (4/4)

Step: "Build" (full log | pattern match details | 🔁 rerun)

Apr 15 19:20:31 torch_xla/csrc/aten_xla_type_default.cpp:9517:33: error: no member named 'import' in namespace 'torch'
ackages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/torch_util.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/torch_util.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/random.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/random.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
ges/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/ir_dump_util.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/ir_dump_util.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/pooling.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/pooling.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
kages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/tensor_impl.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/tensor_impl.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
kages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/python_util.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/python_util.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/device.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/device.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
e/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/init_python_bindings.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/init_python_bindings.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
ackages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/debug_util.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/debug_util.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/aten_xla_type_default.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/aten_xla_type_default.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
Apr 15 19:20:31 torch_xla/csrc/aten_xla_type_default.cpp:9517:33: error: no member named 'import' in namespace 'torch' 
Apr 15 19:20:31   static auto dispatch = torch::import() 
Apr 15 19:20:31                          ~~~~~~~^ 
ackages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/batch_norm.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/batch_norm.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
Apr 15 19:20:39 1 error generated. 
torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/layout_manager.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/layout_manager.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
on3.6/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/view.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/view.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
te-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/nll_loss.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/nll_loss.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
-packages/torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/reduction.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/reduction.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/tensor_methods.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/tensor_methods.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 
torch/include/torch/csrc/api/include -I/opt/conda/lib/python3.6/site-packages/torch/include/TH -I/opt/conda/lib/python3.6/site-packages/torch/include/THC -I/opt/conda/include/python3.6m -c torch_xla/csrc/xla_lower_util.cpp -o build/temp.linux-x86_64-3.6/torch_xla/csrc/xla_lower_util.o -std=c++14 -Wno-sign-compare -Wno-deprecated-declarations -Wno-return-type -Wno-macro-redefined -Wno-return-std-move -DNDEBUG -DTORCH_API_INCLUDE_EXTENSION_H -DTORCH_EXTENSION_NAME=_XLAC -D_GLIBCXX_USE_CXX11_ABI=1 

This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker.

See how this bot performed.

This comment has been revised 24 times.

… API."

Signed-off-by: Edward Z. Yang <ezyang@fb.com>

[ghstack-poisoned]
ljk53 pushed a commit to ljk53/pytorch that referenced this pull request Apr 14, 2020
Signed-off-by: Edward Z. Yang <ezyang@fb.com>

ghstack-source-id: 320d4f1
Pull Request resolved: pytorch#36531
ezyang added 4 commits April 15, 2020 10:09
… API."

Signed-off-by: Edward Z. Yang <ezyang@fb.com>

Differential Revision: [D21017670](https://our.internmc.facebook.com/intern/diff/D21017670)

[ghstack-poisoned]
… API."

Signed-off-by: Edward Z. Yang <ezyang@fb.com>

Differential Revision: [D21017670](https://our.internmc.facebook.com/intern/diff/D21017670)

[ghstack-poisoned]
… API."

Signed-off-by: Edward Z. Yang <ezyang@fb.com>

Differential Revision: [D21017670](https://our.internmc.facebook.com/intern/diff/D21017670)

[ghstack-poisoned]
… API."

Signed-off-by: Edward Z. Yang <ezyang@fb.com>

Differential Revision: [D21017670](https://our.internmc.facebook.com/intern/diff/D21017670)

[ghstack-poisoned]
ezyang added a commit that referenced this pull request Apr 16, 2020
This is a roll up of a bunch of small PRs for ease of landing.

- Update reference to RegisterOperators in error message in Convolution. #36389
- Port Resize to use new registration API. #36390
- Port detach/detach to new registration API. #36512
- Add explicit schema for quantized conv/conv_prepack (fixes #36511). #36513
- Add a centralized TORCH_LIBRARY declaration for quantized and xnnpack ops (fixes #36510). #36520
- Functionalize qadd and register with new registration API. #36527
- Update quantized README for registering operators with new API. #36531
- Convert qbatch_norm to new operator registration API. #36534
- Convert qclamp to new operator registration API. #36535
- Functionalize qconcat and register with new registration API. #36536

Differential Revision: [D20964193](https://our.internmc.facebook.com/intern/diff/D20964193)

[ghstack-poisoned]
ezyang added a commit that referenced this pull request Apr 16, 2020
This is a roll up of a bunch of small PRs for ease of landing.

- Update reference to RegisterOperators in error message in Convolution. #36389
- Port Resize to use new registration API. #36390
- Port detach/detach to new registration API. #36512
- Add explicit schema for quantized conv/conv_prepack (fixes #36511). #36513
- Add a centralized TORCH_LIBRARY declaration for quantized and xnnpack ops (fixes #36510). #36520
- Functionalize qadd and register with new registration API. #36527
- Update quantized README for registering operators with new API. #36531
- Convert qbatch_norm to new operator registration API. #36534
- Convert qclamp to new operator registration API. #36535
- Functionalize qconcat and register with new registration API. #36536

Differential Revision: [D20964193](https://our.internmc.facebook.com/intern/diff/D20964193)

[ghstack-poisoned]
ezyang added a commit that referenced this pull request Apr 16, 2020
This is a roll up of a bunch of small PRs for ease of landing.

- Update reference to RegisterOperators in error message in Convolution. #36389
- Port Resize to use new registration API. #36390
- Port detach/detach to new registration API. #36512
- Add explicit schema for quantized conv/conv_prepack (fixes #36511). #36513
- Add a centralized TORCH_LIBRARY declaration for quantized and xnnpack ops (fixes #36510). #36520
- Functionalize qadd and register with new registration API. #36527
- Update quantized README for registering operators with new API. #36531
- Convert qbatch_norm to new operator registration API. #36534
- Convert qclamp to new operator registration API. #36535
- Functionalize qconcat and register with new registration API. #36536

ghstack-source-id: fe27bc1
Pull Request resolved: #36389
@ezyang
Copy link
Copy Markdown
Contributor Author

ezyang commented Apr 16, 2020

This will be rolled up into #36389

@ezyang ezyang closed this Apr 16, 2020
ezyang added a commit that referenced this pull request Apr 16, 2020
This is a roll up of a bunch of small PRs for ease of landing.

- Update reference to RegisterOperators in error message in Convolution. #36389
- Port Resize to use new registration API. #36390
- Port detach/detach to new registration API. #36512
- Add explicit schema for quantized conv/conv_prepack (fixes #36511). #36513
- Add a centralized TORCH_LIBRARY declaration for quantized and xnnpack ops (fixes #36510). #36520
- Functionalize qadd and register with new registration API. #36527
- Update quantized README for registering operators with new API. #36531
- Convert qbatch_norm to new operator registration API. #36534
- Convert qclamp to new operator registration API. #36535
- Functionalize qconcat and register with new registration API. #36536

Differential Revision: [D20964193](https://our.internmc.facebook.com/intern/diff/D20964193)

[ghstack-poisoned]
ezyang added a commit that referenced this pull request Apr 16, 2020
This is a roll up of a bunch of small PRs for ease of landing.

- Update reference to RegisterOperators in error message in Convolution. #36389
- Port Resize to use new registration API. #36390
- Port detach/detach to new registration API. #36512
- Add explicit schema for quantized conv/conv_prepack (fixes #36511). #36513
- Add a centralized TORCH_LIBRARY declaration for quantized and xnnpack ops (fixes #36510). #36520
- Functionalize qadd and register with new registration API. #36527
- Update quantized README for registering operators with new API. #36531
- Convert qbatch_norm to new operator registration API. #36534
- Convert qclamp to new operator registration API. #36535
- Functionalize qconcat and register with new registration API. #36536

Differential Revision: [D20964193](https://our.internmc.facebook.com/intern/diff/D20964193)

[ghstack-poisoned]
@facebook-github-bot facebook-github-bot deleted the gh/ezyang/723/head branch May 17, 2020 14:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants