Skip to content

Fix nightly shuffle_data_loader by pinning down dependencies versions#22183

Merged
scv119 merged 1 commit intoray-project:masterfrom
jjyao:jjyao/nightly
Feb 7, 2022
Merged

Fix nightly shuffle_data_loader by pinning down dependencies versions#22183
scv119 merged 1 commit intoray-project:masterfrom
jjyao:jjyao/nightly

Conversation

@jjyao
Copy link
Copy Markdown
Contributor

@jjyao jjyao commented Feb 7, 2022

Why are these changes needed?

See fsspec/s3fs#588

Related issue number

Closes #22162

Checks

  • I've run scripts/format.sh to lint the changes in this PR.
  • I've included any doc changes needed for https://docs.ray.io/en/master/.
  • I've made sure the tests are passing. Note that there might be a few flaky tests, see the recent failures at https://flakey-tests.ray.io/
  • Testing Strategy
    • Unit tests
    • Release tests
    • This PR is not tested :(

@jjyao
Copy link
Copy Markdown
Contributor Author

jjyao commented Feb 7, 2022

@jjyao jjyao requested a review from scv119 February 7, 2022 19:02
@scv119
Copy link
Copy Markdown
Contributor

scv119 commented Feb 7, 2022

@clarkzinzow @ericl we should consider deprecate this shuffle loader once dataset is GA.

@scv119 scv119 added the tests-ok The tagger certifies test failures are unrelated and assumes personal liability. label Feb 7, 2022
@scv119 scv119 merged commit 355ee4a into ray-project:master Feb 7, 2022
@jjyao jjyao deleted the jjyao/nightly branch February 7, 2022 19:28
@clarkzinzow
Copy link
Copy Markdown
Contributor

@scv119 AFAIK no one is using it, and it never made it out of alpha, so we could deprecate it now or whenever is convenient.

@jjyao
Copy link
Copy Markdown
Contributor Author

jjyao commented Feb 7, 2022

@scv119 Are you fine with me removing it now. We should remove it if it's not used to reduce maintenance overhead.

@scv119
Copy link
Copy Markdown
Contributor

scv119 commented Feb 7, 2022

If nobody is using it, let's remove it!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

tests-ok The tagger certifies test failures are unrelated and assumes personal liability.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] shuffle_data_loader seems we have some dependencies issue

3 participants