[CircleCI] Store build artifacts for python docs#37658
[CircleCI] Store build artifacts for python docs#37658ShawnZhong wants to merge 10 commits intopytorch:masterfrom
Conversation
This reverts commit 32cba5d.
rgommers
left a comment
There was a problem hiding this comment.
Nice, thanks @ShawnZhong!
This works, I have a small possible improvement suggestion:
- store_artifacts:
path: ~/workspace/build_artifacts/master
destination: docs
should change the full path of all files under the artifacts tab from ~/workspace/build_artifacts/master/* to docs/* so it's easier to read.
rgommers
left a comment
There was a problem hiding this comment.
Looks great, good to merge.
|
This is nice, I will merge it. However, it is not very discoverable right now. Is there some way we can give more information to users when they modify docs that their docs are viewable at some spot? @kostmo maybe this is something Dr. CI could do? |
facebook-github-bot
left a comment
There was a problem hiding this comment.
@ezyang is landing this pull request. If you are a Facebook employee, you can view this diff on Phabricator.
SciPy has a little GitHub app (https://github.com/apps/circleci-artifacts-redirector/) that adds a direct link as a separate CI result after the docs build job has completed: It does require some permissions to install on this repo of course, not sure if that's desirable. Otherwise it may be a matter of just teaching people. I'm personally not a fan of posting a comment after each CI run, that's way too noisy. |
|
Unfortunately if this adds a link for every circleci artifact, we'll probably need to do some tweaking, as I think we do a lot of these right now |
Ah yes, SciPy uses CircleCI only to build the docs. That app may need a tweak to work here, to take into account the job name. And since it's a Heroku app, it may need to be cloned and tweaked for PyTorch. Too much trouble at this point probably. |
@ezyang , yes, sounds doable. The necessary ingredients would be associations of file glob patterns with jobs names, to determine which job artifacts link(s) we should surface through Dr. CI based on the files modified in the diff. We could either store these associations as a text file in the pytorch repo or hard-code them in the Dr. CI app. |
|
Is there a simple way to determine which files edited constitute changes to documentation? Is it as straightforward as any file that ends in the |
Summary: This PR allows the build artifacts for python docs to be stored on CircieCI, which helps the reviewer to preview doc changes before merging. The artifacts can be found in the [`ARTIFACTS` tab]( https://app.circleci.com/pipelines/github/pytorch/pytorch/162986/workflows/a969f256-3243-414f-8a02-1234b9dac149/jobs/5320907/artifacts) of the test **pytorch_cpp_doc_push**, and the website is served at https://5320907-65600975-gh.circle-artifacts.com/0/docs/index.html This PR is inspired by rgommers's comment under pytorch#37419 (comment) > There's a CircleCI job pytorch_python_doc_push that builds the docs, however it doesn't store any artifacts for PRs. Controlled by .circleci/scripts/python_doc_push_script.sh. I think that's the only doc build (?). Not sure why it doesn't store the artifacts, that would be useful. Pull Request resolved: pytorch#37658 Differential Revision: D21380094 Pulled By: ezyang fbshipit-source-id: 1dd44bf836ebc74454f4444ae9321807dccdb313
Like all the *.rst files under |
|
I don't think there's a good way to do that. Touching I'd just always link to the top-level |
Summary: This PR allows the build artifacts for python docs to be stored on CircieCI, which helps the reviewer to preview doc changes before merging. The artifacts can be found in the [`ARTIFACTS` tab]( https://app.circleci.com/pipelines/github/pytorch/pytorch/162986/workflows/a969f256-3243-414f-8a02-1234b9dac149/jobs/5320907/artifacts) of the test **pytorch_cpp_doc_push**, and the website is served at https://5320907-65600975-gh.circle-artifacts.com/0/docs/index.html This PR is inspired by rgommers's comment under pytorch#37419 (comment) > There's a CircleCI job pytorch_python_doc_push that builds the docs, however it doesn't store any artifacts for PRs. Controlled by .circleci/scripts/python_doc_push_script.sh. I think that's the only doc build (?). Not sure why it doesn't store the artifacts, that would be useful. Pull Request resolved: pytorch#37658 Differential Revision: D21380094 Pulled By: ezyang fbshipit-source-id: 1dd44bf836ebc74454f4444ae9321807dccdb313
|
Yes, I agree. If it rolls into an existing comment the CI bot makes, it's NBD. |
Summary: This PR allows the build artifacts for python docs to be stored on CircieCI, which helps the reviewer to preview doc changes before merging. The artifacts can be found in the [`ARTIFACTS` tab]( https://app.circleci.com/pipelines/github/pytorch/pytorch/162986/workflows/a969f256-3243-414f-8a02-1234b9dac149/jobs/5320907/artifacts) of the test **pytorch_cpp_doc_push**, and the website is served at https://5320907-65600975-gh.circle-artifacts.com/0/docs/index.html This PR is inspired by rgommers's comment under pytorch#37419 (comment) > There's a CircleCI job pytorch_python_doc_push that builds the docs, however it doesn't store any artifacts for PRs. Controlled by .circleci/scripts/python_doc_push_script.sh. I think that's the only doc build (?). Not sure why it doesn't store the artifacts, that would be useful. Pull Request resolved: pytorch#37658 Differential Revision: D21380094 Pulled By: ezyang fbshipit-source-id: 1dd44bf836ebc74454f4444ae9321807dccdb313


This PR allows the build artifacts for python docs to be stored on CircieCI, which helps the reviewer to preview doc changes before merging.
The artifacts can be found in the
ARTIFACTStab of the test pytorch_cpp_doc_push, and the website is served at https://5320907-65600975-gh.circle-artifacts.com/0/docs/index.htmlThis PR is inspired by @rgommers's comment under #37419 (comment)