-
Notifications
You must be signed in to change notification settings - Fork 4k
ARROW-16158: [C++][R] Rename ARROW_ENGINE to ARROW_SUBSTRAIT #12915
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ARROW-16158: [C++][R] Rename ARROW_ENGINE to ARROW_SUBSTRAIT #12915
Conversation
|
|
nealrichardson
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
R changes make sense to me, just one comment on the cmake
cpp/CMakeLists.txt
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Does the substrait integration actually require all of these things?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yes. In the future we could presumably add conditional-feature flags. For example, if a Substrait file says the format is Parquet and the consumer was built without Parquet then reject the plan as invalid. I created ARROW-16274 to track this.
r/NAMESPACE
Outdated
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Could you keep this list in alphabetical order?
|
@github-actions crossbow submit -g nightly |
|
Revision: ec22d466b469202d27df76f5445809b77e978174 Submitted crossbow builds: ursacomputing/crossbow @ actions-1897 |
kou
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
+1
(I think that https://github.com/apache/arrow/pull/12915/files/ec22d466b469202d27df76f5445809b77e978174#diff-bae2e9b731f293cf61d77c971d4152d31b9d49b0354817931e5a51c6c27ecf19 should be fixed before we merge this.)
212c4bd to
17031e3
Compare
|
I fixed the R namespace and rebased to resolve conflicts, this should be good to merge once CI finishes |
…e will have a standalone engine module but there is not enough to justify one in this release.
…lity since engine is not published yet. In the future we can move it back as visibility.h is not very public and no one should be using it anyways.
17031e3 to
3683962
Compare
|
@westonpace I don't know why but C++ on s390x test on Travis CI is failed since this commit: https://app.travis-ci.com/github/apache/arrow/builds Could you confirm it? https://app.travis-ci.com/github/apache/arrow/jobs/568028126 |
|
Benchmark runs are scheduled for baseline = 0b06870 and contender = d21f8b1. d21f8b1 is a master commit associated with this PR. Results will be available as each benchmark for each run completes. |
…ache#37451) Documents the `ARROW_SUBSTRAIT` flag added in apache#31565 / apache#12915 and adds a missing seimcolon to the docs entry for `ARROW_WITH_RE2`. * Closes: apache#37447 Authored-by: Ian Cook <ianmcook@gmail.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
…ache#37451) Documents the `ARROW_SUBSTRAIT` flag added in apache#31565 / apache#12915 and adds a missing seimcolon to the docs entry for `ARROW_WITH_RE2`. * Closes: apache#37447 Authored-by: Ian Cook <ianmcook@gmail.com> Signed-off-by: Sutou Kouhei <kou@clear-code.com>
At the moment there is not enough non-Substrait functionality to justify a dedicated engine module. In the future there likely will be and so I have some of the general structure around in the C++ (e.g.
ARROW_ENGINE_EXPORT) but removed any external facing references.