Skip to content

Reorganize third-party libraries into top-level third_party directory#6025

Merged
ezyang merged 9 commits intopytorch:masterfrom
ezyang:pr/third-party-reorg
Mar 28, 2018
Merged

Reorganize third-party libraries into top-level third_party directory#6025
ezyang merged 9 commits intopytorch:masterfrom
ezyang:pr/third-party-reorg

Conversation

@ezyang
Copy link
Copy Markdown
Contributor

@ezyang ezyang commented Mar 26, 2018

  • gloo, pybind11, nanopb and nccl now live in third_party.
  • ATen builds in aten/build rather than torch/lib/build/aten
  • A bit of faffing about in the scripts was necessary, because they used to assume that everything lived in the same directory. Now you are expected to cd into the correct directory before calling one of the build functions
  • Lint now just unconditionally ignores third_party, rather than enumerating folders explicitly

Please don't forget to squash on merge, and add this PR comment.

CC @peterjc123 @soumith

Signed-off-by: Edward Z. Yang ezyang@fb.com

Signed-off-by: Edward Z. Yang <ezyang@fb.com>
@ezyang
Copy link
Copy Markdown
Contributor Author

ezyang commented Mar 26, 2018

@pytorchbot retest this please

@soumith
Copy link
Copy Markdown
Collaborator

soumith commented Mar 26, 2018

why is THD going into third_party? it's our code

@peterjc123
Copy link
Copy Markdown
Collaborator

I'm okay with the code change. But I think it should need a test.

@ezyang
Copy link
Copy Markdown
Contributor Author

ezyang commented Mar 27, 2018

@soumith My bad, I just moved everything from torch/lib indiscriminately. The CI didn't run on this due to submod shenanigans. Fix coming.

@apaszke
Copy link
Copy Markdown
Contributor

apaszke commented Mar 27, 2018

Libshm is also our code

@ezyang
Copy link
Copy Markdown
Contributor Author

ezyang commented Mar 27, 2018

@pytorchbot retest this please

1 similar comment
@ezyang
Copy link
Copy Markdown
Contributor Author

ezyang commented Mar 27, 2018

@pytorchbot retest this please

@ezyang
Copy link
Copy Markdown
Contributor Author

ezyang commented Mar 27, 2018

Dammit, somewhere between git 2.7.4 and git 2.13.5 they made merges involving submodules actually work XD

@ezyang
Copy link
Copy Markdown
Contributor Author

ezyang commented Mar 27, 2018

@pytorchbot retest this please

ezyang added 6 commits March 27, 2018 08:05
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
@ezyang ezyang changed the title [WIP] third_party reorg Reorganize third-party libraries into top-level third_party directory Mar 27, 2018
@ezyang
Copy link
Copy Markdown
Contributor Author

ezyang commented Mar 27, 2018

This is ready for merge. CI failure is gpu-perf-test being flaky.

Comment thread build_pytorch_libs.sh
@@ -1,10 +1,12 @@
#!/usr/bin/env bash

This comment was marked as off-topic.

This comment was marked as off-topic.

This comment was marked as off-topic.

Signed-off-by: Edward Z. Yang <ezyang@fb.com>
Signed-off-by: Edward Z. Yang <ezyang@fb.com>
@ezyang ezyang merged commit eb18a2f into pytorch:master Mar 28, 2018
laurentdupin pushed a commit to laurentdupin/pytorch that referenced this pull request Apr 24, 2026
…pytorch#6025)

- gloo, pybind11, nanopb and nccl now live in third_party.
- ATen builds in aten/build rather than torch/lib/build/aten
- A bit of faffing about in the scripts was necessary, because they used to assume that everything lived in the same directory. Now you are expected to cd into the correct directory before calling one of the build functions. The actual builder script lives in tools
- Lint now just unconditionally ignores third_party, rather than enumerating folders explicitly
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants