Skip to content

GH-33976: [Python] Expose pyarrow.acero as public submodule and add to reference docs#34760

Merged
jorisvandenbossche merged 6 commits intoapache:mainfrom
jorisvandenbossche:gh-33976-docs
Mar 29, 2023
Merged

GH-33976: [Python] Expose pyarrow.acero as public submodule and add to reference docs#34760
jorisvandenbossche merged 6 commits intoapache:mainfrom
jorisvandenbossche:gh-33976-docs

Conversation

@jorisvandenbossche
Copy link
Copy Markdown
Member

@jorisvandenbossche jorisvandenbossche commented Mar 28, 2023

Rationale for this change

Finalizing #33976 now the basic functionality for working with Acero has been added and this is used internally: publicly exposing the low-level building blocks.

What changes are included in this PR? (user facing)

A new pyarrow.acero module exposing the Declaration and ExecNodeOptions subclasses (from pyarrow._acero cython submodule).

Are these changes tested?

The functionality was already tested. The existing tests are updated to use the public import.

@github-actions
Copy link
Copy Markdown

Copy link
Copy Markdown
Member

@AlenkaF AlenkaF left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@jorisvandenbossche
Copy link
Copy Markdown
Member Author

Verified locally that the doc build is looking good with those changes.

@jorisvandenbossche jorisvandenbossche merged commit 928ca1a into apache:main Mar 29, 2023
@jorisvandenbossche jorisvandenbossche deleted the gh-33976-docs branch March 29, 2023 15:43
@ursabot
Copy link
Copy Markdown

ursabot commented Mar 29, 2023

Benchmark runs are scheduled for baseline = 24ba1cf and contender = 928ca1a. 928ca1a is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.68% ⬆️1.45%] test-mac-arm
[Finished ⬇️0.0% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.31% ⬆️0.0%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 928ca1a4 ec2-t3-xlarge-us-east-2
[Finished] 928ca1a4 test-mac-arm
[Finished] 928ca1a4 ursa-i9-9960x
[Finished] 928ca1a4 ursa-thinkcentre-m75q
[Finished] 24ba1cf7 ec2-t3-xlarge-us-east-2
[Failed] 24ba1cf7 test-mac-arm
[Finished] 24ba1cf7 ursa-i9-9960x
[Finished] 24ba1cf7 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

ArgusLi pushed a commit to Bit-Quill/arrow that referenced this pull request May 15, 2023
… add to reference docs (apache#34760)

### Rationale for this change

Finalizing apache#33976 now the basic functionality for working with Acero has been added and this is used internally: publicly exposing the low-level building blocks.

### What changes are included in this PR? (user facing)

A new `pyarrow.acero` module exposing the Declaration and ExecNodeOptions subclasses (from `pyarrow._acero` cython submodule).

### Are these changes tested?

The functionality was already tested. The existing tests are updated to use the public import.

* Issue: apache#33976

Authored-by: Joris Van den Bossche <jorisvandenbossche@gmail.com>
Signed-off-by: Joris Van den Bossche <jorisvandenbossche@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants