Skip to content

Commit b9d1162

Browse files
zagtowestonpace
andauthored
GH-33830: Clarify handling of Null values in REE encoding (#33831)
* Closes: #33830 Lead-authored-by: Tobias Zagorni <tobias@zagorni.eu> Co-authored-by: zagto <tobias@zagorni.eu> Co-authored-by: Weston Pace <weston.pace@gmail.com> Signed-off-by: Matt Topol <zotthewizard@gmail.com>
1 parent 130dfcd commit b9d1162

1 file changed

Lines changed: 4 additions & 1 deletion

File tree

docs/source/format/Columnar.rst

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -815,6 +815,9 @@ A run must have have a length of at least 1. This means the values in the
815815
run ends array all are positive and in strictly ascending order. A run end cannot be
816816
null.
817817

818+
The REE parent has no validity bitmap, and it's null count field should always be 0.
819+
Null values are encoded as runs with the value null.
820+
818821
As an example, you could have the following data: ::
819822

820823
type: Float32
@@ -824,7 +827,7 @@ In Run-end-encoded form, this could appear as:
824827

825828
::
826829

827-
* Length: 7, Null count: 2
830+
* Length: 7, Null count: 0
828831
* Child Arrays:
829832

830833
* run_ends (Int32):

0 commit comments

Comments
 (0)