Skip to content

Fix test_remote_io.py due to mutating public s3 bucket (#997)#3

Merged
kace merged 1 commit intokace:torchdata_pt_1.12.1from
ShiboXing:torchdata_pt_1.12.1
Feb 9, 2023
Merged

Fix test_remote_io.py due to mutating public s3 bucket (#997)#3
kace merged 1 commit intokace:torchdata_pt_1.12.1from
ShiboXing:torchdata_pt_1.12.1

Conversation

@ShiboXing
Copy link

Summary:
Please read through our contribution guide prior to creating your pull request.

  • Note that there is a section on requirements related to adding a new DataPipe.

Fixes meta-pytorch#984

  • Add a private function to TestDataPipeRemoteIO in test_remote_io.py to get s3 objects count label through aws cli
  • add awscli in requirements

Pull Request resolved: meta-pytorch#997

Reviewed By: ejguan

Differential Revision: D43157757

Pulled By: NivekT

fbshipit-source-id: 7e9ee8299a28a087f88024c3b3e77be3bfe5adf0

Please read through our contribution guide prior to
creating your pull request.

  • Note that there is a section on requirements related to adding a new DataPipe.

Fixes #{issue number}

Changes

)

Summary:
Please read through our [contribution guide](https://github.com/pytorch/data/blob/main/CONTRIBUTING.md) prior to
creating your pull request.

- Note that there is a section on requirements related to adding a new DataPipe.

Fixes meta-pytorch#984
- Add a private function to TestDataPipeRemoteIO in test_remote_io.py to get s3 objects count label through aws cli
- add awscli in requirements

Pull Request resolved: meta-pytorch#997

Reviewed By: ejguan

Differential Revision: D43157757

Pulled By: NivekT

fbshipit-source-id: 7e9ee8299a28a087f88024c3b3e77be3bfe5adf0
@kace kace merged commit a7f9843 into kace:torchdata_pt_1.12.1 Feb 9, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants