Skip to content

Fix performance regression with early exit and distributed filter retrieval#14

Closed
shuangli999 wants to merge 1 commit into
tdcmeehan:dynmfil-p1from
shuangli999:dppshuang
Closed

Fix performance regression with early exit and distributed filter retrieval#14
shuangli999 wants to merge 1 commit into
tdcmeehan:dynmfil-p1from
shuangli999:dppshuang

Conversation

@shuangli999

Copy link
Copy Markdown

Problem Statement

  1. Workers waiting for timeout even when no filters would be generated, for whatever
    1.1 the filter is not built because it exceeds the size limit;
    1.2 the filtering ratio is 0%, so it ends up being no filter.
  2. During debug, found that distributed dynamic filters from coordinator not being properly retrieved and applied

overall result without the fix

image

And detail analyse is here
https://ibm.ent.box.com/notes/2207821900097

Overall result with the fix - section 0425 - fix verify
image

And detail comparison is here
https://ibm.ent.box.com/notes/2207821900097

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant