-
Notifications
You must be signed in to change notification settings - Fork 4k
Closed
Labels
Description
This turned out to be my confusion in ARROW-13344: because the ScanNode takes a filter and projection, I wasn't creating a FilterNode because I assume that the filter is already applied--why else would I provide a filter to the ScanNode? But it turns out that if you don't Filter again, you get unfiltered results:
Table$create(
group=c(1, 2),
value=c(5, 6)
) %>%
filter(value > 5) %>%
group_by(group) %>%
summarize(sum(value)) %>%
collect()
# A tibble: 2 x 2
group `sum(value)`
<dbl> <dbl>
1 1 5
2 2 6Reporter: Neal Richardson / @nealrichardson
Related issues:
- [C++] ScanNode is not using the filter expression (is duplicated by)
- [R] Initial bindings for ExecPlan/ExecNode (relates to)
Note: This issue was originally created as ARROW-13498. Please see the migration documentation for further details.