[train][data] Enable Train v2 for ray/air/tests#57534
Merged
justinvyu merged 12 commits intoray-project:masterfrom Oct 9, 2025
Merged
[train][data] Enable Train v2 for ray/air/tests#57534justinvyu merged 12 commits intoray-project:masterfrom
justinvyu merged 12 commits intoray-project:masterfrom
Conversation
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
matthewdeng
approved these changes
Oct 9, 2025
…enable_v2 Signed-off-by: Justin Yu <justinvyu@anyscale.com>
pavitrabhalla
pushed a commit
to superserve-ai/ray
that referenced
this pull request
Oct 10, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Pavitra Bhalla <pavitra@rayai.com>
joshkodi
pushed a commit
to joshkodi/ray
that referenced
this pull request
Oct 13, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Josh Kodi <joshkodi@gmail.com>
ArturNiederfahrenhorst
pushed a commit
to ArturNiederfahrenhorst/ray
that referenced
this pull request
Oct 13, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
7 tasks
harshit-anyscale
pushed a commit
that referenced
this pull request
Oct 15, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
justinvyu
added a commit
that referenced
this pull request
Oct 16, 2025
Ports over the remaining unit tests that were marked as TODOs from this series of PRs: #57534, #57256, #56868, #56820, #56816. Notably: * `test_new_dataset_config -> test_data_integration` * `test_backend -> test_torch_trainer, test_worker_group` * `test_gpu -> test_torch_gpu` This PR also finishes migrating the Tune LightGBM/Keras examples which were unblocked by #57042 and #57121. --------- Signed-off-by: Justin Yu <justinvyu@anyscale.com>
justinyeh1995
pushed a commit
to justinyeh1995/ray
that referenced
this pull request
Oct 20, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
justinyeh1995
pushed a commit
to justinyeh1995/ray
that referenced
this pull request
Oct 20, 2025
Ports over the remaining unit tests that were marked as TODOs from this series of PRs: ray-project#57534, ray-project#57256, ray-project#56868, ray-project#56820, ray-project#56816. Notably: * `test_new_dataset_config -> test_data_integration` * `test_backend -> test_torch_trainer, test_worker_group` * `test_gpu -> test_torch_gpu` This PR also finishes migrating the Tune LightGBM/Keras examples which were unblocked by ray-project#57042 and ray-project#57121. --------- Signed-off-by: Justin Yu <justinvyu@anyscale.com>
xinyuangui2
pushed a commit
to xinyuangui2/ray
that referenced
this pull request
Oct 22, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: xgui <xgui@anyscale.com>
xinyuangui2
pushed a commit
to xinyuangui2/ray
that referenced
this pull request
Oct 22, 2025
Ports over the remaining unit tests that were marked as TODOs from this series of PRs: ray-project#57534, ray-project#57256, ray-project#56868, ray-project#56820, ray-project#56816. Notably: * `test_new_dataset_config -> test_data_integration` * `test_backend -> test_torch_trainer, test_worker_group` * `test_gpu -> test_torch_gpu` This PR also finishes migrating the Tune LightGBM/Keras examples which were unblocked by ray-project#57042 and ray-project#57121. --------- Signed-off-by: Justin Yu <justinvyu@anyscale.com> Signed-off-by: xgui <xgui@anyscale.com>
elliot-barn
pushed a commit
that referenced
this pull request
Oct 23, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
elliot-barn
pushed a commit
that referenced
this pull request
Oct 23, 2025
Ports over the remaining unit tests that were marked as TODOs from this series of PRs: #57534, #57256, #56868, #56820, #56816. Notably: * `test_new_dataset_config -> test_data_integration` * `test_backend -> test_torch_trainer, test_worker_group` * `test_gpu -> test_torch_gpu` This PR also finishes migrating the Tune LightGBM/Keras examples which were unblocked by #57042 and #57121. --------- Signed-off-by: Justin Yu <justinvyu@anyscale.com> Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>
landscapepainter
pushed a commit
to landscapepainter/ray
that referenced
this pull request
Nov 17, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
landscapepainter
pushed a commit
to landscapepainter/ray
that referenced
this pull request
Nov 17, 2025
Ports over the remaining unit tests that were marked as TODOs from this series of PRs: ray-project#57534, ray-project#57256, ray-project#56868, ray-project#56820, ray-project#56816. Notably: * `test_new_dataset_config -> test_data_integration` * `test_backend -> test_torch_trainer, test_worker_group` * `test_gpu -> test_torch_gpu` This PR also finishes migrating the Tune LightGBM/Keras examples which were unblocked by ray-project#57042 and ray-project#57121. --------- Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Aydin-ab
pushed a commit
to Aydin-ab/ray-aydin
that referenced
this pull request
Nov 19, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Aydin-ab
pushed a commit
to Aydin-ab/ray-aydin
that referenced
this pull request
Nov 19, 2025
Ports over the remaining unit tests that were marked as TODOs from this series of PRs: ray-project#57534, ray-project#57256, ray-project#56868, ray-project#56820, ray-project#56816. Notably: * `test_new_dataset_config -> test_data_integration` * `test_backend -> test_torch_trainer, test_worker_group` * `test_gpu -> test_torch_gpu` This PR also finishes migrating the Tune LightGBM/Keras examples which were unblocked by ray-project#57042 and ray-project#57121. --------- Signed-off-by: Justin Yu <justinvyu@anyscale.com> Signed-off-by: Aydin Abiar <aydin@anyscale.com>
Future-Outlier
pushed a commit
to Future-Outlier/ray
that referenced
this pull request
Dec 7, 2025
* Enables V2 env variable for most `ray/air/tests` and
`py_doctest[air]`.
* Explicitly disables V2 for certain tests that test legacy behavior
such as the old Tune integration, or marks them for migration in a
followup.
* Removes some unmaintained/deprecated code (`DummyTrainer`,
`custom_trainer`)
* Moved some tests to `ray/data` for utils that live in `ray.air` but
are only used in Ray Data. Note that I didn't move the util source code
to Data as that would have been a large change, but I moved the tests
out of this deprecated "air tests" suite:
* `test_arrow` -> `test_arrow_type_conversion`
* `test_data_batch_conversion`
* `test_object_extension`
* `test_tensor_extension`
* `test_torch_tensor_utils`
---------
Signed-off-by: Justin Yu <justinvyu@anyscale.com>
Signed-off-by: Future-Outlier <eric901201@gmail.com>
Future-Outlier
pushed a commit
to Future-Outlier/ray
that referenced
this pull request
Dec 7, 2025
Ports over the remaining unit tests that were marked as TODOs from this series of PRs: ray-project#57534, ray-project#57256, ray-project#56868, ray-project#56820, ray-project#56816. Notably: * `test_new_dataset_config -> test_data_integration` * `test_backend -> test_torch_trainer, test_worker_group` * `test_gpu -> test_torch_gpu` This PR also finishes migrating the Tune LightGBM/Keras examples which were unblocked by ray-project#57042 and ray-project#57121. --------- Signed-off-by: Justin Yu <justinvyu@anyscale.com> Signed-off-by: Future-Outlier <eric901201@gmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ray/air/testsandpy_doctest[air].DummyTrainer,custom_trainer)ray/datafor utils that live inray.airbut are only used in Ray Data. Note that I didn't move the util source code to Data as that would have been a large change, but I moved the tests out of this deprecated "air tests" suite:test_arrow->test_arrow_type_conversiontest_data_batch_conversiontest_object_extensiontest_tensor_extensiontest_torch_tensor_utils