Skip to content

Conversation

@chaokunyang
Copy link
Collaborator

@chaokunyang chaokunyang commented Nov 26, 2025

Why?

add row format schema and remove arrow dependency can make c++ build for users more easy and remove the limitation that pyfory must pin pyarrow version

What does this PR do?

  • add row format schema for c++
  • use row format schema for row and encoder in c++
  • expose c++ row format schema to python
  • use row format schema for row and encoder in python
  • remove arrow c++ dependency
  • add arrow/row schema converter for compatibility
  • unpin pyarrow version

Related issues

Closes #2922

Closes #2920

#2929

Does this PR introduce any user-facing change?

  • Does this PR introduce any public API change?
  • Does this PR introduce any binary protocol compatibility change?

Benchmark

@chaokunyang chaokunyang merged commit 36f11fd into apache:main Nov 26, 2025
60 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[C++] Build a new type system for row format [C++] Implement cpp/fory/columnar in pure python, and remove arrow from row-format dependency

2 participants