Skip to content

Update lintrunner to version that uses as default mergebase#95938

Closed
ZainRizvi wants to merge 5 commits intomasterfrom
zainr/linter-update
Closed

Update lintrunner to version that uses as default mergebase#95938
ZainRizvi wants to merge 5 commits intomasterfrom
zainr/linter-update

Conversation

@ZainRizvi
Copy link
Copy Markdown
Contributor

Fixes #93156

Upgrades lintrunner to the latest version which can use the master branch as the merge base by default (provided it's specified in .lintrunner.toml and update .lintrunner.toml accordingly

@pytorch-bot
Copy link
Copy Markdown

pytorch-bot bot commented Mar 3, 2023

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/95938

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit f0ff6ea:
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added the topic: not user facing topic category label Mar 3, 2023
@ZainRizvi ZainRizvi requested review from huydhn and suo March 3, 2023 02:46
@ZainRizvi ZainRizvi marked this pull request as ready for review March 3, 2023 02:46
@ZainRizvi ZainRizvi requested review from a team and jeffdaily as code owners March 3, 2023 02:46
@ZainRizvi ZainRizvi requested review from jeffdaily and removed request for jeffdaily March 3, 2023 02:47
Copy link
Copy Markdown
Contributor

@huydhn huydhn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's happened with everyone from 0.9.3 to 0.10.6? :P

@ZainRizvi
Copy link
Copy Markdown
Contributor Author

What's happened with everyone from 0.9.3 to 0.10.6? :P

https://github.com/suo/lintrunner/blob/main/CHANGELOG.md has all the deets :)

@ZainRizvi
Copy link
Copy Markdown
Contributor Author

@huy fyi, I had to update the fetch depth in .github/workflows/_calculate-docker-image.yml, since otherwise it was impossible for the calculate-docker-image action to find a merge base.

Seems like we hadn't run into this corner case in the past three weeks since docker images were added for linters

@ZainRizvi ZainRizvi added the ciflow/trunk Trigger trunk jobs on your pull request label Mar 3, 2023
@huydhn
Copy link
Copy Markdown
Contributor

huydhn commented Mar 3, 2023

@huy fyi, I had to update the fetch depth in .github/workflows/_calculate-docker-image.yml, since otherwise it was impossible for the calculate-docker-image action to find a merge base.

Seems like we hadn't run into this corner case in the past three weeks since docker images were added for linters

Oh I see. I'm about to ask that question. Here is what works for me in my previous PR: This step fails if the Docker image hasn't been built yet. But once the image is ready, rerunning it works.

Now I understand why some people had this step failing in their PRs and needed to rebase.

@ZainRizvi
Copy link
Copy Markdown
Contributor Author

@pytorchbot rebase

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

@pytorchbot successfully started a rebase job. Check the current status here

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

Successfully rebased zainr/linter-update onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout zainr/linter-update && git pull --rebase)

@ZainRizvi ZainRizvi force-pushed the zainr/linter-update branch 2 times, most recently from 847a26f to 769d3b7 Compare March 3, 2023 17:25
pytorchmergebot pushed a commit that referenced this pull request Mar 6, 2023
From #95938 where a new Docker image build fails to start sccache. This issue starts to happen today (Mar 3rd).   The server fails to start with a cryptic `sccache: error: Invalid argument (os error 22)`

```
=================== sccache compilation log ===================
ERROR 2023-03-03T20:31:14Z: sccache::server: failed to start server: Invalid argument (os error 22)

sccache: error: Invalid argument (os error 22)

=========== If your build fails, please take a look at the log above for possible reasons ===========

+ sccache --show-stats
sccache: error: Connection to server timed out
```

I don't have a good explanation for this yet.  The version of sccache we build from https://github.com/pytorch/sccache is ancient.  If I start to build the exact same version on Ubuntu Docker image now, the issue will manifest.  But the older binary built only few days ago https://hud.pytorch.org/pytorch/pytorch/commit/e50ff3fcdb3890ce3bbab99e60b1c27ff49be2af works without any issue.  So I fix sccache binary to that version instead of rebuilding it every time in the image as a temporary mitigation while trying to root cause this further.

Pull Request resolved: #95997
Approved by: https://github.com/ZainRizvi
@ZainRizvi
Copy link
Copy Markdown
Contributor Author

@pytorchbot rebase

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

@pytorchbot successfully started a rebase job. Check the current status here

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

Successfully rebased zainr/linter-update onto refs/remotes/origin/viable/strict, please pull locally before adding more changes (for example, via git checkout zainr/linter-update && git pull --rebase)

@ZainRizvi
Copy link
Copy Markdown
Contributor Author

@pytorchbot merge

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

pytorchmergebot pushed a commit that referenced this pull request Mar 8, 2023
Let users know if they have an outdated version of lintrunner installed on their box

Sets the minimum version to one which uses master as a default mergebase (see #95938)
Pull Request resolved: #96241
Approved by: https://github.com/huydhn
cyyever pushed a commit to cyyever/pytorch_private that referenced this pull request Mar 12, 2023
From pytorch/pytorch#95938 where a new Docker image build fails to start sccache. This issue starts to happen today (Mar 3rd).   The server fails to start with a cryptic `sccache: error: Invalid argument (os error 22)`

```
=================== sccache compilation log ===================
ERROR 2023-03-03T20:31:14Z: sccache::server: failed to start server: Invalid argument (os error 22)

sccache: error: Invalid argument (os error 22)

=========== If your build fails, please take a look at the log above for possible reasons ===========

+ sccache --show-stats
sccache: error: Connection to server timed out
```

I don't have a good explanation for this yet.  The version of sccache we build from https://github.com/pytorch/sccache is ancient.  If I start to build the exact same version on Ubuntu Docker image now, the issue will manifest.  But the older binary built only few days ago https://hud.pytorch.org/pytorch/pytorch/commit/e50ff3fcdb3890ce3bbab99e60b1c27ff49be2af works without any issue.  So I fix sccache binary to that version instead of rebuilding it every time in the image as a temporary mitigation while trying to root cause this further.

Pull Request resolved: pytorch/pytorch#95997
Approved by: https://github.com/ZainRizvi
cyyever pushed a commit to cyyever/pytorch_private that referenced this pull request Mar 12, 2023
Fixes pytorch/pytorch#93156

Upgrades lintrunner to the latest version which can use the `master` branch as the merge base by default (provided it's specified in `.lintrunner.toml` and update `.lintrunner.toml` accordingly

Pull Request resolved: pytorch/pytorch#95938
Approved by: https://github.com/huydhn
cyyever pushed a commit to cyyever/pytorch_private that referenced this pull request Mar 12, 2023
Let users know if they have an outdated version of lintrunner installed on their box

Sets the minimum version to one which uses master as a default mergebase (see pytorch/pytorch#95938)
Pull Request resolved: pytorch/pytorch#96241
Approved by: https://github.com/huydhn
cyyever pushed a commit to cyyever/pytorch_private that referenced this pull request Mar 12, 2023
From pytorch/pytorch#95938 where a new Docker image build fails to start sccache. This issue starts to happen today (Mar 3rd).   The server fails to start with a cryptic `sccache: error: Invalid argument (os error 22)`

```
=================== sccache compilation log ===================
ERROR 2023-03-03T20:31:14Z: sccache::server: failed to start server: Invalid argument (os error 22)

sccache: error: Invalid argument (os error 22)

=========== If your build fails, please take a look at the log above for possible reasons ===========

+ sccache --show-stats
sccache: error: Connection to server timed out
```

I don't have a good explanation for this yet.  The version of sccache we build from https://github.com/pytorch/sccache is ancient.  If I start to build the exact same version on Ubuntu Docker image now, the issue will manifest.  But the older binary built only few days ago https://hud.pytorch.org/pytorch/pytorch/commit/e50ff3fcdb3890ce3bbab99e60b1c27ff49be2af works without any issue.  So I fix sccache binary to that version instead of rebuilding it every time in the image as a temporary mitigation while trying to root cause this further.

Pull Request resolved: pytorch/pytorch#95997
Approved by: https://github.com/ZainRizvi
cyyever pushed a commit to cyyever/pytorch_private that referenced this pull request Mar 12, 2023
Fixes pytorch/pytorch#93156

Upgrades lintrunner to the latest version which can use the `master` branch as the merge base by default (provided it's specified in `.lintrunner.toml` and update `.lintrunner.toml` accordingly

Pull Request resolved: pytorch/pytorch#95938
Approved by: https://github.com/huydhn
cyyever pushed a commit to cyyever/pytorch_private that referenced this pull request Mar 12, 2023
Let users know if they have an outdated version of lintrunner installed on their box

Sets the minimum version to one which uses master as a default mergebase (see pytorch/pytorch#95938)
Pull Request resolved: pytorch/pytorch#96241
Approved by: https://github.com/huydhn
ydwu4 added a commit to ydwu4/pytorch that referenced this pull request Mar 13, 2023
From pytorch#95938 where a new Docker image build fails to start sccache. This issue starts to happen today (Mar 3rd).   The server fails to start with a cryptic `sccache: error: Invalid argument (os error 22)`

```
=================== sccache compilation log ===================
ERROR 2023-03-03T20:31:14Z: sccache::server: failed to start server: Invalid argument (os error 22)

sccache: error: Invalid argument (os error 22)

=========== If your build fails, please take a look at the log above for possible reasons ===========

+ sccache --show-stats
sccache: error: Connection to server timed out
```

I don't have a good explanation for this yet.  The version of sccache we build from https://github.com/pytorch/sccache is ancient.  If I start to build the exact same version on Ubuntu Docker image now, the issue will manifest.  But the older binary built only few days ago https://hud.pytorch.org/pytorch/pytorch/commit/e50ff3fcdb3890ce3bbab99e60b1c27ff49be2af works without any issue.  So I fix sccache binary to that version instead of rebuilding it every time in the image as a temporary mitigation while trying to root cause this further.

Pull Request resolved: pytorch#95997
Approved by: https://github.com/ZainRizvi
ydwu4 added a commit to ydwu4/pytorch that referenced this pull request Mar 13, 2023
…95938)

Fixes pytorch#93156

Upgrades lintrunner to the latest version which can use the `master` branch as the merge base by default (provided it's specified in `.lintrunner.toml` and update `.lintrunner.toml` accordingly

Pull Request resolved: pytorch#95938
Approved by: https://github.com/huydhn
ydwu4 added a commit to ydwu4/pytorch that referenced this pull request Mar 13, 2023
Let users know if they have an outdated version of lintrunner installed on their box

Sets the minimum version to one which uses master as a default mergebase (see pytorch#95938)
Pull Request resolved: pytorch#96241
Approved by: https://github.com/huydhn
@ZainRizvi ZainRizvi deleted the zainr/linter-update branch April 27, 2023 23:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ciflow/trunk Trigger trunk jobs on your pull request Merged topic: not user facing topic category

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Local and CI lintrunner should be more consistent

3 participants