Skip to content

Replace read_pandas with ParquetDataset to support predicate pushdown#638

Merged
devin-petersohn merged 2 commits intomodin-project:masterfrom
ddutt:prdpushdown
May 25, 2019
Merged

Replace read_pandas with ParquetDataset to support predicate pushdown#638
devin-petersohn merged 2 commits intomodin-project:masterfrom
ddutt:prdpushdown

Conversation

@ddutt
Copy link
Copy Markdown
Contributor

@ddutt ddutt commented May 24, 2019

… on parquet

What do these changes do?

The change allows you to use predicate pushdown with parquet with the use of filters kwarg.

Related issue number

#636

  • passes flake8 modin
  • passes black --check modin
  • tests added and passing

@codecov
Copy link
Copy Markdown

codecov bot commented May 24, 2019

Codecov Report

Merging #638 into master will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master     #638   +/-   ##
=======================================
  Coverage   90.43%   90.43%           
=======================================
  Files          37       37           
  Lines        5552     5552           
=======================================
  Hits         5021     5021           
  Misses        531      531
Impacted Files Coverage Δ
modin/engines/ray/pandas_on_ray/io.py 100% <ø> (ø) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 11581d5...6812c32. Read the comment docs.

@williamma12 williamma12 mentioned this pull request May 24, 2019
3 tasks
Copy link
Copy Markdown
Collaborator

@devin-petersohn devin-petersohn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, thanks @ddutt!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants