-
Notifications
You must be signed in to change notification settings - Fork 1.1k
Updated arrow-pyarrow to use pyo3 0.27, updated deprecated code warnings #8773
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
# Conflicts: # arrow-pyarrow/src/lib.rs
mbrobbel
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks @hntd187. Please note that this is a breaking change because we use pyo3 types in public items.
Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com>
Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com>
|
Now that main is open for breaking API changes, I have updated this PR and will merge it when CI passes |
|
Thanks again @hntd187 @mbrobbel and @kylebarron |
|
Somehow all the CI checks passed and yet clippy now fails on main after merging this PR I have a fix ready: |
# Which issue does this PR close? <!-- We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an issue to this PR using the GitHub syntax. --> - Closes #NNN. # Rationale for this change Clippy is failiing on main after merging cfba3cc - #8773 Example: https://github.com/apache/arrow-rs/actions/runs/20865325961/job/59954918027 ``` error: deref which would be done by auto-deref --> arrow-pyarrow/src/lib.rs:636:39 | 636 | Ok(Self(T::from_pyarrow_bound(&*value)?)) | ^^^^^^^ help: try: `&value` | = help: for further information visit https://rust-lang.github.io/rust-clippy/rust-1.91.0/index.html#explicit_auto_deref = note: `-D clippy::explicit-auto-deref` implied by `-D warnings` = help: to override `-D warnings` add `#[allow(clippy::explicit_auto_deref)]` ``` # What changes are included in this PR? Apply clippy fix # Are these changes tested? <!-- We typically require tests for all PRs in order to: 1. Prevent the code from being accidentally broken by subsequent changes 2. Serve as another way to document the expected behavior of the code If tests are not included in your PR, please explain why (for example, are they covered by existing tests)? --> # Are there any user-facing changes? <!-- If there are user-facing changes then we may require documentation to be updated before approving the PR. If there are any breaking changes to public APIs, please call them out. -->
…ngs (apache#8773) # Which issue does this PR close? No issue, I'm aware of. Just updates pyo3 to 0.27 so delta-rs can start looking at variant adoption. # Rationale for this change There is a long list of dependencies for arrow 57 to be supported in enough places such that delta-rs can start to reliably build against them. Updating pyo3 puts arrow in line with the other arrow based dependencies. # Are these changes tested? We typically require tests for all PRs in order to: Since this is a good amount of unsafe, and I'm on Windows (which I'd imagine is not the common path) I'd like to see the CI/CD run just to make sure everything looks good. If tests are not included in your PR, please explain why (for example, are they covered by existing tests)? # Are there any user-facing changes? Just that a dependency is now a later version --------- Co-authored-by: Matthijs Brobbel <m1brobbel@gmail.com> Co-authored-by: Andrew Lamb <andrew@nerdnetworks.org>
# Which issue does this PR close? <!-- We generally require a GitHub issue to be filed for all bug fixes and enhancements and this helps us generate change logs for our releases. You can link an issue to this PR using the GitHub syntax. --> - Closes #NNN. # Rationale for this change Clippy is failiing on main after merging apache@cfba3cc - apache#8773 Example: https://github.com/apache/arrow-rs/actions/runs/20865325961/job/59954918027 ``` error: deref which would be done by auto-deref --> arrow-pyarrow/src/lib.rs:636:39 | 636 | Ok(Self(T::from_pyarrow_bound(&*value)?)) | ^^^^^^^ help: try: `&value` | = help: for further information visit https://rust-lang.github.io/rust-clippy/rust-1.91.0/index.html#explicit_auto_deref = note: `-D clippy::explicit-auto-deref` implied by `-D warnings` = help: to override `-D warnings` add `#[allow(clippy::explicit_auto_deref)]` ``` # What changes are included in this PR? Apply clippy fix # Are these changes tested? <!-- We typically require tests for all PRs in order to: 1. Prevent the code from being accidentally broken by subsequent changes 2. Serve as another way to document the expected behavior of the code If tests are not included in your PR, please explain why (for example, are they covered by existing tests)? --> # Are there any user-facing changes? <!-- If there are user-facing changes then we may require documentation to be updated before approving the PR. If there are any breaking changes to public APIs, please call them out. -->
Which issue does this PR close?
No issue, I'm aware of. Just updates pyo3 to 0.27 so delta-rs can start looking at variant adoption.
Rationale for this change
There is a long list of dependencies for arrow 57 to be supported in enough places such that delta-rs can start to reliably build against them. Updating pyo3 puts arrow in line with the other arrow based dependencies.
Are these changes tested?
We typically require tests for all PRs in order to:
Since this is a good amount of unsafe, and I'm on Windows (which I'd imagine is not the common path) I'd like to see the CI/CD run just to make sure everything looks good.
If tests are not included in your PR, please explain why (for example, are they covered by existing tests)?
Are there any user-facing changes?
Just that a dependency is now a later version