Skip to content

torch/csrc/distributed/c10d/Types.hpp: No such file or directory #87173

Closed
Closed
torch/csrc/distributed/c10d/Types.hpp: No such file or directory#87173
Labels
module: buildBuild system issuesmodule: c10dIssues/PRs related to collective communications and process groupsmodule: regressionIt used to work, and now it doesn'toncall: distributedAdd this issue/PR to distributed oncall triage queuetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module
Milestone
1.13.0
@jingxu10

Description

@jingxu10
jingxu10
opened on Oct 18, 2022

🐛 Describe the bug

Types.hpp and Store.hpp are missing from ${CONDA_PREFIX}/lib/python3.8/site-packages/torch/include/torch/csrc/distributed/c10d/, but Types.hpp is included in ProcessGroup.hpp.
image

Error message:

In file included from /workspace/dl/pytorch/srcs/ipex/cpu/frameworks.ai.pytorch.torch-ccl/src/ProcessGroupCCL.hpp:41,
                 from /workspace/dl/pytorch/srcs/ipex/cpu/frameworks.ai.pytorch.torch-ccl/src/ccl_comm_collector.h:37,
                 from /workspace/dl/pytorch/srcs/ipex/cpu/frameworks.ai.pytorch.torch-ccl/src/ccl_comm_collector.cpp:4:
/root/miniconda3/envs/py38/lib/python3.8/site-packages/torch/include/c10d/ProcessGroup.hpp:13:10: fatal error: torch/csrc/distributed/c10d/Types.hpp: No such file or directory
   13 | #include <torch/csrc/distributed/c10d/Types.hpp>
      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Types.hpp and Store.hpp are not in directory torch/csrc/distributed/c10d, but in torch/include/c10d

# find $CONDA_PREFIX/lib/python3.8/site-packages/torch -name Types.hpp
/root/miniconda3/envs/py38/lib/python3.8/site-packages/torch/include/c10d/Types.hpp
# find $CONDA_PREFIX/lib/python3.8/site-packages/torch -name Store.hpp
/root/miniconda3/envs/py38/lib/python3.8/site-packages/torch/include/c10d/Store.hpp

Versions

Installed with command pip3 install --pre torch torchvision torchaudio -f https://download.pytorch.org/whl/test/cpu/torch_test.html

PyTorch version: 1.13.0+cpu
Is debug build: False
CUDA used to build PyTorch: None
ROCM used to build PyTorch: N/A

OS: CentOS Linux 7 (Core) (x86_64)
GCC version: (GCC) 11.2.1 20220127 (Red Hat 11.2.1-9)
Clang version: 3.4.2 (tags/RELEASE_34/dot2-final)
CMake version: Could not collect
Libc version: glibc-2.17

Python version: 3.8.13 (default, Mar 28 2022, 11:38:47)  [GCC 7.5.0] (64-bit runtime)
Python platform: Linux-5.15.0-50-generic-x86_64-with-glibc2.17
Is CUDA available: False
CUDA runtime version: No CUDA
GPU models and configuration: No CUDA
Nvidia driver version: No CUDA
cuDNN version: No CUDA
HIP runtime version: N/A
MIOpen runtime version: N/A

Versions of relevant libraries:
[pip3] numpy==1.23.4
[pip3] torch==1.13.0+cpu
[pip3] torchaudio==0.13.0+cpu
[pip3] torchvision==0.14.0+cpu
[conda] numpy                     1.23.4                   pypi_0    pypi
[conda] torch                     1.13.0+cpu               pypi_0    pypi
[conda] torchaudio                0.13.0+cpu               pypi_0    pypi
[conda] torchvision               0.14.0+cpu               pypi_0    pypi

cc @mrshenli @pritamdamania87 @zhaojuanmao @satgera @rohan-varma @gqchen @aazzolini @osalpekar @jiayisuse @H-Huang @kwen2501 @awgu @malfet @seemethere

Metadata

Metadata

Assignees

No one assigned

    Labels

    module: buildBuild system issuesmodule: c10dIssues/PRs related to collective communications and process groupsmodule: regressionIt used to work, and now it doesn'toncall: distributedAdd this issue/PR to distributed oncall triage queuetriagedThis issue has been looked at a team member, and triaged and prioritized into an appropriate module

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions