Skip to content

Set SCCACHE_IDLE_TIMEOUT to INFINITE(0) on Windows#37993

Closed
peterjc123 wants to merge 1 commit intopytorch:masterfrom
peterjc123:sccache_windows_usage_improvement
Closed

Set SCCACHE_IDLE_TIMEOUT to INFINITE(0) on Windows#37993
peterjc123 wants to merge 1 commit intopytorch:masterfrom
peterjc123:sccache_windows_usage_improvement

Conversation

@peterjc123
Copy link
Copy Markdown
Collaborator

@peterjc123 peterjc123 commented May 7, 2020

No description provided.

@dr-ci
Copy link
Copy Markdown

dr-ci bot commented May 7, 2020 •
edited
Loading

💊 Build failures summary and remediations

As of commit fc4bf99 (more details on the Dr. CI page):

1 job timed out:

  • pytorch_linux_xenial_py3_clang5_asan_test

🚧 1 ongoing upstream failure:

These were probably caused by upstream breakages that are not fixed yet:

This comment was automatically generated by Dr. CI (expand for details).Follow this link to opt-out of these comments for your Pull Requests.

Please report bugs/suggestions on the GitHub issue tracker.

See how this bot performed.

This comment has been revised 2 times.

malfet
malfet reviewed May 7, 2020
View reviewed changes
@ezyang
Copy link
Copy Markdown
Contributor

ezyang commented May 8, 2020

I'm going to go ahead and land this, because it doesn't seem like it should do any harm

facebook-github-bot
facebook-github-bot reviewed May 8, 2020
View reviewed changes
Copy link
Copy Markdown
Contributor

@facebook-github-bot facebook-github-bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@ezyang is landing this pull request. If you are a Facebook employee, you can view this diff on Phabricator.

@facebook-github-bot
Copy link
Copy Markdown
Contributor

facebook-github-bot commented May 8, 2020

@ezyang merged this pull request in 4ae187f.

@peterjc123
Copy link
Copy Markdown
Collaborator Author

peterjc123 commented May 8, 2020 •
edited
Loading

@malfet I found one occurrence in the binary jobs. Will apply this PR to those jobs later.
https://app.circleci.com/pipelines/github/pytorch/pytorch/166757/workflows/848d5d89-05b9-4dc4-9a11-8c434dfa1da6/jobs/5401724/steps

  [1926/3476] Building CXX object caffe2\CMakeFiles\torch_cpu.dir\operators\channel_stats_op.cc.obj
  FAILED: caffe2/CMakeFiles/torch_cpu.dir/operators/channel_stats_op.cc.obj
  C:\w\b\windows\tmp_bin\sccache-cl.exe  /nologo /TP -DAT_PARALLEL_OPENMP=1 -DCPUINFO_SUPPORTED_PLATFORM=1 -DFMT_HEADER_ONLY=1 -DIDEEP_USE_MKL -DMAGMA_V2 -DMINIZ_DISABLE_ZIP_READER_CRC32_CHECKS -DONNXIFI_ENABLE_EXT=1 -DONNX_ML=1 -DONNX_NAMESPACE=onnx_torch -DTH_BLAS_MKL -DWIN32_LEAN_AND_MEAN -D_CRT_SECURE_NO_DEPRECATE=1 -D_OPENMP_NOFORCE_MANIFEST -Dtorch_cpu_EXPORTS -Iaten\src -I..\aten\src -I. -I..\ -I..\cmake\..\third_party\benchmark\include -Icaffe2\contrib\aten -I..\third_party\onnx -Ithird_party\onnx -I..\third_party\foxi -Ithird_party\foxi -I..\caffe2\..\torch\csrc\api -I..\caffe2\..\torch\csrc\api\include -I..\caffe2\aten\src\TH -Icaffe2\aten\src\TH -I..\caffe2\..\torch\..\aten\src -Icaffe2\aten\src -Icaffe2\..\aten\src -Icaffe2\..\aten\src\ATen -I..\caffe2\..\torch\csrc -I..\caffe2\..\torch\..\third_party\miniz-2.0.8 -I..\aten\src\TH -I..\aten\..\third_party\catch\single_include -I..\aten\src\ATen\.. -Icaffe2\aten\src\ATen -I..\third_party\miniz-2.0.8 -I..\caffe2\core\nomnigraph\include -I..\c10\.. -Ithird_party\ideep\mkl-dnn\include -I..\third_party\ideep\mkl-dnn\src\..\include -I..\third_party\cpuinfo\include -I..\third_party\fbgemm\include -I..\third_party\fbgemm -I..\third_party\fbgemm\third_party\asmjit\src -I..\third_party\FP16\include -I..\third_party\fmt\include -I..\cmake\..\third_party\googletest\googlemock\include -I..\cmake\..\third_party\googletest\googletest\include -I..\third_party\protobuf\src -IC:\w\b\windows\mkl\include -I..\third_party -I..\cmake\..\third_party\eigen -IC:\w\b\windows\conda\envs\py37\include -IC:\w\b\windows\conda\envs\py37\lib\site-packages\numpy\core\include -I..\cmake\..\third_party\pybind11\include -I..\cmake\..\third_party\cub -IC:\w\b\windows\magma_cuda102_release\include -I"C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v10.2\include" -I..\third_party\ideep\mkl-dnn\include -I..\third_party\ideep\include -I..\caffe2 /DWIN32 /D_WINDOWS /GR /EHsc /w /bigobj -openmp -DNDEBUG -DUSE_FBGEMM -DHAVE_AVX_CPU_DEFINITION -DHAVE_AVX2_CPU_DEFINITION /MD /O2 /Ob2 /DNDEBUG /w /bigobj -DNDEBUG   -DCUDA_HAS_FP16=1 -DUSE_GCC_GET_CPUID -DUSE_AVX -DUSE_AVX2 -DTH_HAVE_THREAD /Z7 /EHsc /DNOMINMAX /wd4267 /wd4251 /wd4522 /wd4838 /wd4305 /wd4244 /wd4190 /wd4101 /wd4996 /wd4275 /bigobj -O2 -DCAFFE2_BUILD_MAIN_LIB -DONNX_BUILD_MAIN_LIB -std:c++14 /showIncludes /Focaffe2\CMakeFiles\torch_cpu.dir\operators\channel_stats_op.cc.obj /Fdcaffe2\CMakeFiles\torch_cpu.dir\ /FS -c ..\caffe2\operators\channel_stats_op.cc
  error: failed to execute compile
  caused by: error reading compile response from server
  caused by: Failed to read response header
  caused by: failed to fill whole buffer
  ninja: build stopped: subcommand failed.
  Traceback (most recent call last):
    File "<string>", line 1, in <module>
    File "C:\w\b\windows\pytorch\setup.py", line 740, in <module>
      build_deps()
    File "C:\w\b\windows\pytorch\setup.py", line 323, in build_deps
      cmake=cmake)
    File "C:\w\b\windows\pytorch\tools\build_pytorch_libs.py", line 62, in build_caffe2
      cmake.build(my_env)
    File "C:\w\b\windows\pytorch\tools\setup_helpers\cmake.py", line 345, in build
      self.run(build_args, my_env)
    File "C:\w\b\windows\pytorch\tools\setup_helpers\cmake.py", line 141, in run
      check_call(command, cwd=self.build_dir, env=env)
    File "C:\w\b\windows\conda\envs\py37\lib\subprocess.py", line 363, in check_call
      raise CalledProcessError(retcode, cmd)

@peterjc123 peterjc123 mentioned this pull request May 8, 2020
Merged
@peterjc123 peterjc123 deleted the sccache_windows_usage_improvement branch May 12, 2020 04:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ezyang ezyang ezyang approved these changes

@malfet malfet malfet left review comments

@kostmo kostmo Awaiting requested review from kostmo

@seemethere seemethere Awaiting requested review from seemethere

+1 more reviewer

@facebook-github-bot facebook-github-bot facebook-github-bot left review comments

Reviewers whose approvals may not affect merge requirements

Assignees

No one assigned

Labels

Merged open source

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

6 participants

@peterjc123 @ezyang @facebook-github-bot @malfet @pytorchbot @mruberry