Skip to content

Conversation

@wesm
Copy link
Member

@wesm wesm commented Jul 18, 2019

A bunch of business logic had gotten copy-pasted to create parquet/arrow/record_writer.*. This bases ColumnReader/RecordReader off a common private base class and removes other code duplication.

I'm going to base explorations in ARROW-3772 on this

@wesm
Copy link
Member Author

wesm commented Jul 18, 2019

This change is refactoring only. Technically Parquet is review-then-commit so I'll wait for @xhochy or someone else to take a look before merging

@codecov-io
Copy link

Codecov Report

Merging #4906 into master will increase coverage by 0.56%.
The diff coverage is 89.64%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master    #4906      +/-   ##
==========================================
+ Coverage    88.5%   89.06%   +0.56%     
==========================================
  Files         909      717     -192     
  Lines      115568   100244   -15324     
  Branches     1418        0    -1418     
==========================================
- Hits       102279    89280   -12999     
+ Misses      12927    10964    -1963     
+ Partials      362        0     -362
Impacted Files Coverage Δ
cpp/src/parquet/arrow/reader.cc 85.52% <ø> (ø) ⬆️
cpp/src/parquet/arrow/test-util.h 100% <ø> (ø) ⬆️
cpp/src/parquet/column_reader.h 97.67% <100%> (+0.9%) ⬆️
cpp/src/parquet/column_reader.cc 89.48% <89.37%> (-2.03%) ⬇️
cpp/src/plasma/thirdparty/ae/ae.c 70.75% <0%> (-0.95%) ⬇️
go/arrow/ipc/writer.go
go/arrow/math/uint64_amd64.go
go/arrow/memory/memory_avx2_amd64.go
go/arrow/ipc/file_reader.go
js/src/builder/index.ts
... and 187 more

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 30ba931...5eb664f. Read the comment docs.

Copy link
Member

@xhochy xhochy left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1, LGTM

@wesm wesm closed this in 360db0d Jul 19, 2019
kszucs pushed a commit that referenced this pull request Jul 22, 2019
… duplication

A bunch of business logic had gotten copy-pasted to create parquet/arrow/record_writer.*. This bases ColumnReader/RecordReader off a common private base class and removes other code duplication.

I'm going to base explorations in ARROW-3772 on this

Closes #4906 from wesm/PARQUET-1468 and squashes the following commits:

5eb664f <Wes McKinney> Finish cleaning, compiles and tests pass
3df7c93 <Wes McKinney> Consolidate internal::RecordReader, ColumnReader files

Authored-by: Wes McKinney <wesm+git@apache.org>
Signed-off-by: Wes McKinney <wesm+git@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants