Skip to content

[CI] Script to fetch creds from current AWS session#121426

Closed
malfet wants to merge 2 commits intomainfrom
malfet/add-get-aws-creds-script
Closed

[CI] Script to fetch creds from current AWS session#121426
malfet wants to merge 2 commits intomainfrom
malfet/add-get-aws-creds-script

Conversation

@malfet
Copy link
Copy Markdown
Contributor

@malfet malfet commented Mar 7, 2024 •
edited
Loading

Because some implementations, like OpenDAL does not work with AWS IMDSv2, but this script will bridge the gap and enables more recent sccache releases(that switched from simple-s3 to OpenDAL) to work in current CI system

When launched it prints something like:

export AWS_ACCESS_KEY_ID=XXXXX
export AWS_SECRET_ACCESS_KEY=YYYY
export AWS_SESSION_TOKEN=ZZZZ

which can be evaled and passed then sccache can use those failures.

Validated in #121323

@malfet malfet requested review from a team and jeffdaily as code owners March 7, 2024 17:44
@pytorch-bot pytorch-bot bot added the topic: not user facing topic category label Mar 7, 2024
@pytorch-bot
Copy link
Copy Markdown

pytorch-bot bot commented Mar 7, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/121426

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 New Failure, 4 Pending, 13 Unrelated Failures

As of commit ee44880 with merge base 7feabe9 (image):

NEW FAILURE - The following job has failed:

  • pull / linux-docs / build-docs-python-false (gh)
    ImportError: /opt/conda/envs/py_3.8/bin/../lib/libstdc++.so.6: version GLIBCXX_3.4.30' not found (required by /opt/conda/envs/py_3.8/lib/python3.8/site-packages/torch/lib/libtorch_python.so)`

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@malfet
[CI] Script to fetch creds from current AWS session
eade104 
Because some implementations, like OpenDAL does not work with AWS
IMDSv2, but this script will bridge the gap and enables more recnet
sccache releases(that swtiched from simple-s3 to OpenDAL) to work in current CI system
@malfet malfet force-pushed the malfet/add-get-aws-creds-script branch from 69ea1b9 to eade104 Compare March 7, 2024 17:45
@malfet malfet changed the title malfet/add get aws creds script [CI] Script to fetch creds from current AWS session Mar 7, 2024
@malfet
Copy link
Copy Markdown
Contributor Author

malfet commented Mar 7, 2024

@pytorchbot merge -f "Lint is green, other failures are clearly irrelevant"

@pytorchmergebot
Copy link
Copy Markdown
Collaborator

pytorchmergebot commented Mar 7, 2024

Merge started

Your change will be merged immediately since you used the force (-f) flag, bypassing any CI checks (ETA: 1-5 minutes). Please use -f as last resort and instead consider -i/--ignore-current to continue the merge ignoring current failures. This will allow currently pending tests to finish and report signal before the merge.

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging
Check the merge workflow status
here

@malfet malfet deleted the malfet/add-get-aws-creds-script branch March 9, 2024 18:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Skylion007 Skylion007 Skylion007 approved these changes

@jeffdaily jeffdaily Awaiting requested review from jeffdaily

Assignees

No one assigned

Labels

Merged topic: not user facing topic category

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@malfet @pytorchmergebot @Skylion007