Skip to content

ARROW-15870: [Python] Start to raise deprecation warnings for use_legacy_dataset=True in parquet.read_table#12584

Closed
jorisvandenbossche wants to merge 3 commits intoapache:masterfrom
jorisvandenbossche:ARROW-15870
Closed

ARROW-15870: [Python] Start to raise deprecation warnings for use_legacy_dataset=True in parquet.read_table#12584
jorisvandenbossche wants to merge 3 commits intoapache:masterfrom
jorisvandenbossche:ARROW-15870

Conversation

@jorisvandenbossche
Copy link
Copy Markdown
Member

Currently, users can still specify use_legacy_dataset=True explicitly to get the old implementation/behaviour. But if we want to remove that implementation at some point (ARROW-15868), we should start deprecating that option, to futher nudge people to the new implementation.

@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 8, 2022

@jorisvandenbossche
Copy link
Copy Markdown
Member Author

@github-actions crossbow submit -g integration

@github-actions
Copy link
Copy Markdown

github-actions bot commented Mar 8, 2022

Revision: 78ff0a5

Submitted crossbow builds: ursacomputing/crossbow @ actions-1730

Task Status
test-conda-python-3.7-hdfs-2.9.2 Github Actions
test-conda-python-3.7-hdfs-3.2.1 Github Actions
test-conda-python-3.7-kartothek-latest Github Actions
test-conda-python-3.7-kartothek-master Github Actions
test-conda-python-3.7-pandas-0.24 Github Actions
test-conda-python-3.7-pandas-latest Github Actions
test-conda-python-3.7-spark-v3.1.2 Github Actions
test-conda-python-3.7-turbodbc-latest Github Actions
test-conda-python-3.7-turbodbc-master Github Actions
test-conda-python-3.8-pandas-latest Github Actions
test-conda-python-3.8-pandas-nightly Github Actions
test-conda-python-3.8-spark-v3.2.0 Github Actions
test-conda-python-3.9-dask-latest Github Actions
test-conda-python-3.9-dask-master Github Actions
test-conda-python-3.9-pandas-master Github Actions
test-conda-python-3.9-spark-master Github Actions

"Passing 'use_legacy_dataset=True' to get the legacy behaviour is "
"deprecated as of pyarrow 8.0.0, and the legacy implementation will "
"be removed in a future version.",
DeprecationWarning, stacklevel=2)
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we want to use DeprecationWarning or FutureWarning?

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We can probably directly raise a FutureWarning, but all the others here are still raising DeprecationWarnings. Will do a separate PR to change those all from deprecation to future warning.

@ursabot
Copy link
Copy Markdown

ursabot commented Mar 15, 2022

Benchmark runs are scheduled for baseline = 2e314cb and contender = 3bf0617. 3bf0617 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Finished ⬇️0.25% ⬆️0.0%] test-mac-arm
[Finished ⬇️0.36% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️1.66% ⬆️0.21%] ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

@jorisvandenbossche jorisvandenbossche deleted the ARROW-15870 branch March 15, 2022 17:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants