Skip to content

Build Python module and tests CPU mode with Bazel in CI#78221

Closed
dreiss wants to merge 7 commits intogh/dreiss/119/basefrom
gh/dreiss/119/head
Closed

Build Python module and tests CPU mode with Bazel in CI#78221
dreiss wants to merge 7 commits intogh/dreiss/119/basefrom
gh/dreiss/119/head

Conversation

@dreiss
Copy link
Contributor

@dreiss dreiss commented May 24, 2022

Stack from ghstack:

This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

[ghstack-poisoned]
@facebook-github-bot
Copy link
Contributor

facebook-github-bot commented May 24, 2022

🔗 Helpful links

✅ No Failures (0 Pending)

As of commit 09ff91d (more details on the Dr. CI page):

Expand to see more

💚 💚 Looks good so far! There are no failures yet. 💚 💚


This comment was automatically generated by Dr. CI (expand for details).

Please report bugs/suggestions to the (internal) Dr. CI Users group.

Click here to manually regenerate this comment.

@dreiss
Copy link
Contributor Author

dreiss commented May 24, 2022

CI should fail initially because #77002 is currently in viable/strict, which I'm based on.

This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

[ghstack-poisoned]
@dreiss dreiss changed the title Build everything in CPU mode with Bazel in CI Build Python module and tests CPU mode with Bazel in CI May 24, 2022
This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

[ghstack-poisoned]
dreiss added a commit that referenced this pull request May 24, 2022
This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

ghstack-source-id: a1ca617
Pull Request resolved: #78221
This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

[ghstack-poisoned]
dreiss added a commit that referenced this pull request May 24, 2022
This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

ghstack-source-id: c8241b4
Pull Request resolved: #78221
This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

[ghstack-poisoned]
This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

[ghstack-poisoned]
@dreiss
Copy link
Contributor Author

dreiss commented May 25, 2022

Okay, I finally got this version to fail with the proper error ("torch/csrc/Module.cpp:10:10: fatal error: ATen/cuda/CUDAConfig.h: No such file or directory"). https://github.com/pytorch/pytorch/runs/6596140899?check_suite_focus=true

Now I'm going to rebase, make sure it passes, and see what the perf impact is.

@dreiss
Copy link
Contributor Author

dreiss commented May 25, 2022

It looks like the extra command took ~5:30, which is more than I expected, but still not a problem. I'm going to combine the two CPU builds to hopefully unlock a bit more parallelism, then land.

This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

[ghstack-poisoned]
dreiss added a commit that referenced this pull request May 25, 2022
This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

ghstack-source-id: 8164cfc
Pull Request resolved: #78221
@dreiss
Copy link
Contributor Author

dreiss commented May 25, 2022

@pytorchbot help

@pytorch-bot
Copy link

pytorch-bot bot commented May 25, 2022

To see all options for pytorchbot, please refer to this page.

@dreiss
Copy link
Contributor Author

dreiss commented May 25, 2022

@pytorchbot merge -g

please

@github-actions
Copy link
Contributor

Hey @dreiss.
You've committed this PR, but it does not have both a 'release notes: ...' and 'topics: ...' label. Please add one of each to the PR. The 'release notes: ...' label should represent the part of PyTorch that this PR changes (fx, autograd, distributed, etc) and the 'topics: ...' label should represent the kind of PR it is (not user facing, new feature, bug fix, perf improvement, etc). The list of valid labels can be found here for the 'release notes: ...' and here for the 'topics: ...'.
For changes that are 'topic: not user facing' there is no need for a release notes label.

@dreiss dreiss added the topic: not user facing topic category label May 25, 2022
facebook-github-bot pushed a commit that referenced this pull request May 26, 2022
Summary:
This can potentially catch issues like #77002 before they hit
Meta-internal CI, because Bazel is more strict about header visibility
than (our current setup of) CMake.

Pull Request resolved: #78221

Approved by: https://github.com/malfet

Test Plan: contbuild & OSS CI, see https://hud.pytorch.org/commit/pytorch/pytorch/8449ac770c29a52257a3f2842c1dfd06d2c2a497

Reviewed By: mehtanirav

Differential Revision: D36707271

Pulled By: dreiss

fbshipit-source-id: d9c3d17e9227b7660a0819e9894767035d10863f
@facebook-github-bot facebook-github-bot deleted the gh/dreiss/119/head branch May 29, 2022 14:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants