Skip to content

MB-65473: Refactor and Optimize Pre-Filtered Vector Search#63

Merged
abhinavdangeti merged 1 commit intomasterfrom
preFilterOpt
Mar 24, 2025
Merged

MB-65473: Refactor and Optimize Pre-Filtered Vector Search#63
abhinavdangeti merged 1 commit intomasterfrom
preFilterOpt

Conversation

@CascadingRadium
Copy link
Member

  • Add an interface EligibleDocumentSelector to allow for more flexible document selection.
  • Refactored redundant interfaces.

- Add an interface `EligibleDocumentSelector` to allow for more flexible document selection.
- Refactored redundant interfaces.
Copy link
Contributor

@metonymic-smokey metonymic-smokey left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work combining the VR related interface for both filtered and unfiltered kNN.

@abhinavdangeti abhinavdangeti merged commit c996b90 into master Mar 24, 2025
9 checks passed
@abhinavdangeti abhinavdangeti deleted the preFilterOpt branch March 24, 2025 22:22
@abhinavdangeti
Copy link
Member

v1.2.5

abhinavdangeti added a commit to blevesearch/bleve that referenced this pull request Apr 2, 2025
- Refactor pre-filtered vector search to enhance performance and reduce
memory footprint.
- Replace the current bitmap-based approach for calculating segment
local document numbers with a more direct method, where the local
document numbers are mapped directly to the segment ID during the
execution of the eligible collector.
- Requires: 
    - blevesearch/bleve_index_api#63
    - blevesearch/bleve_index_api#66
    - blevesearch/zapx#317
    - blevesearch/go-faiss#41
    - blevesearch/faiss#49

---------

Co-authored-by: Abhinav Dangeti <abhinav@couchbase.com>
CascadingRadium added a commit that referenced this pull request Apr 7, 2025
- Add an interface `EligibleDocumentSelector` to allow for more flexible
document selection.
- Refactored redundant interfaces.
CascadingRadium added a commit to blevesearch/bleve that referenced this pull request Apr 7, 2025
- Refactor pre-filtered vector search to enhance performance and reduce
memory footprint.
- Replace the current bitmap-based approach for calculating segment
local document numbers with a more direct method, where the local
document numbers are mapped directly to the segment ID during the
execution of the eligible collector.
- Requires:
    - blevesearch/bleve_index_api#63
    - blevesearch/bleve_index_api#66
    - blevesearch/zapx#317
    - blevesearch/go-faiss#41
    - blevesearch/faiss#49

---------

Co-authored-by: Abhinav Dangeti <abhinav@couchbase.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants