[Data] Remove deprecated TENSOR_COLUMN_NAME constant and associated dead code [1] by Hyunoh-Yeo · Pull Request #60573 · ray-project/ray

Hyunoh-Yeo · 2026-01-28T23:52:07Z

Description

Remove safe TENSOR_COLUMN_NAME related

Related issues

Related to #60547

Additional information

Remove TENSOR_COLUMN_NAME from arrow_block, pandas_block, and table_block.py.

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

gemini-code-assist

Code Review

This pull request effectively removes the deprecated TENSOR_COLUMN_NAME constant and cleans up associated dead code and backward compatibility logic across several files. The changes are well-contained and align with the goal of simplifying the codebase. I have one minor suggestion to update a type hint for better code clarity and correctness.

python/ray/data/_internal/table_block.py

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

python/ray/data/util/data_batch_conversion.py

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

cursor

Cursor Bugbot has reviewed your changes and found 1 potential issue.

python/ray/data/util/data_batch_conversion.py

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

bveeramani

Could you update the PR description to give a bit more context? Just a couple lines on (1) why we're making this change, and (2) how this PR fits in with the rest planned

bveeramani · 2026-02-02T19:38:13Z

python/ray/data/tests/unit/test_data_batch_conversion.py

    output_array = _convert_pandas_to_batch_type(
        actual_output, type=BatchFormat.NUMPY, cast_tensor_columns=cast_tensor_columns
    )
+


Nit: Could you remove the unrelated whitespace to minimize the size of the diff?

…ead code [1] (ray-project#60573) ## Description Remove safe TENSOR_COLUMN_NAME related ## Related issues Related to ray-project#60547 ## Additional information - Remove TENSOR_COLUMN_NAME from arrow_block, pandas_block, and table_block.py. --------- Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com> Co-authored-by: Balaji Veeramani <balaji@anyscale.com> Signed-off-by: Sirui Huang <ray.huang@anyscale.com>

…ead code [1] (ray-project#60573) ## Description Remove safe TENSOR_COLUMN_NAME related ## Related issues Related to ray-project#60547 ## Additional information - Remove TENSOR_COLUMN_NAME from arrow_block, pandas_block, and table_block.py. --------- Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com> Co-authored-by: Balaji Veeramani <balaji@anyscale.com>

…ead code [1] (#60573) ## Description Remove safe TENSOR_COLUMN_NAME related ## Related issues Related to #60547 ## Additional information - Remove TENSOR_COLUMN_NAME from arrow_block, pandas_block, and table_block.py. --------- Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com> Co-authored-by: Balaji Veeramani <balaji@anyscale.com> Signed-off-by: elliot-barn <elliot.barnwell@anyscale.com>

…ead code [1] (#60573) ## Description Remove safe TENSOR_COLUMN_NAME related ## Related issues Related to #60547 ## Additional information - Remove TENSOR_COLUMN_NAME from arrow_block, pandas_block, and table_block.py. --------- Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com> Co-authored-by: Balaji Veeramani <balaji@anyscale.com>

…ead code [1] (ray-project#60573) ## Description Remove safe TENSOR_COLUMN_NAME related ## Related issues Related to ray-project#60547 ## Additional information - Remove TENSOR_COLUMN_NAME from arrow_block, pandas_block, and table_block.py. --------- Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com> Co-authored-by: Balaji Veeramani <balaji@anyscale.com> Signed-off-by: Adel Nour <ans9868@nyu.edu>

…ead code [1] (ray-project#60573) ## Description Remove safe TENSOR_COLUMN_NAME related ## Related issues Related to ray-project#60547 ## Additional information - Remove TENSOR_COLUMN_NAME from arrow_block, pandas_block, and table_block.py. --------- Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com> Co-authored-by: Balaji Veeramani <balaji@anyscale.com> Signed-off-by: peterxcli <peterxcli@gmail.com>

Hyunoh-Yeo added 7 commits January 28, 2026 12:55

initial delete

b722f9e

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

.

8ff246d

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

.

ff8ab1d

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

.

ad3c3b7

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

some more modifications

8fedf22

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

delete dead code

8415dbb

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

tests modification

e61d3d9

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

gemini-code-assist bot reviewed Jan 28, 2026

View reviewed changes

python/ray/data/_internal/table_block.py Outdated Show resolved Hide resolved

Hyunoh-Yeo added 2 commits January 28, 2026 15:55

tests modification

9337deb

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

fixed failing tests

fae9f9b

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

Hyunoh-Yeo marked this pull request as ready for review January 29, 2026 03:47

Hyunoh-Yeo requested a review from a team as a code owner January 29, 2026 03:47

cursor bot reviewed Jan 29, 2026

View reviewed changes

python/ray/data/util/data_batch_conversion.py Show resolved Hide resolved

Hyunoh-Yeo marked this pull request as draft January 29, 2026 04:26

Hyunoh-Yeo added 13 commits January 28, 2026 21:27

Version 1: save preprocessor

1978640

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

keep constant

f83834a

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

delete abstract

367c2b5

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

detect ndarray convert dict

d5d5cb5

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

some modifications

4e92a06

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

saves constant for preprocessor

b9c4f4c

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

fixed minor error

331a65b

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

minor error fix

eeb3277

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

small error fix

10fd610

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

tests fixes

1a3886d

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

convert ndarrays to dicts

50d1377

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

convert all ndarrays to dict

2df75e1

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

future warning tests added

a938ed6

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

Hyunoh-Yeo marked this pull request as ready for review January 30, 2026 14:14

cursor bot reviewed Jan 30, 2026

View reviewed changes

python/ray/data/util/data_batch_conversion.py Outdated Show resolved Hide resolved

minor issue

58adc3e

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

ray-gardener bot added data Ray Data-related issues community-contribution Contributed by the community labels Jan 30, 2026

Hyunoh-Yeo added 3 commits January 30, 2026 18:29

PR1: safe deletions

86c2fcf

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

PR1: safe deletions

a0a7ccb

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

Merge branch 'master' into in-progress-60547

8a52761

Hyunoh-Yeo changed the title ~~[Data] Remove deprecated TENSOR_COLUMN_NAME constant and associated dead code~~ [Data] Remove deprecated TENSOR_COLUMN_NAME constant and associated dead code [1] Jan 31, 2026

Hyunoh-Yeo and others added 3 commits January 30, 2026 19:08

PR1: safe deletions + removed future warning

f952ef0

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

comment deleted

add1277

Signed-off-by: Hyunoh-Yeo <hyunoh.yeo@gmail.com>

Merge branch 'master' into in-progress-60547

cbad454

bveeramani approved these changes Feb 2, 2026

View reviewed changes

bveeramani added the go add ONLY when ready to merge, run all tests label Feb 3, 2026

Merge branch 'master' into in-progress-60547

65a2670

bveeramani enabled auto-merge (squash) February 3, 2026 07:10

bveeramani merged commit ebf82c7 into ray-project:master Feb 3, 2026
7 checks passed

bveeramani mentioned this pull request Feb 3, 2026

[Data] Remove deprecated TENSOR_COLUMN_NAME constant and associated dead code #60547

Closed

Hyunoh-Yeo deleted the in-progress-60547 branch February 4, 2026 09:19

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Data] Remove deprecated TENSOR_COLUMN_NAME constant and associated dead code [1]#60573

[Data] Remove deprecated TENSOR_COLUMN_NAME constant and associated dead code [1]#60573
bveeramani merged 30 commits intoray-project:masterfrom
Hyunoh-Yeo:in-progress-60547

Hyunoh-Yeo commented Jan 28, 2026 •

edited

Loading

Uh oh!

gemini-code-assist bot left a comment

Uh oh!

Uh oh!

Uh oh!

cursor bot left a comment

Uh oh!

Uh oh!

bveeramani left a comment

Uh oh!

bveeramani Feb 2, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

Hyunoh-Yeo commented Jan 28, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Description

Related issues

Additional information

Uh oh!

gemini-code-assist bot left a comment

Choose a reason for hiding this comment

Code Review

Uh oh!

Uh oh!

Uh oh!

cursor bot left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

bveeramani left a comment

Choose a reason for hiding this comment

Uh oh!

bveeramani Feb 2, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Hyunoh-Yeo commented Jan 28, 2026 •

edited

Loading