Skip to content

chore: bump localrecall to index-backed hybrid search#477

Merged
mudler merged 1 commit into
mainfrom
chore/bump-localrecall-10186
Jun 6, 2026
Merged

chore: bump localrecall to index-backed hybrid search#477
mudler merged 1 commit into
mainfrom
chore/bump-localrecall-10186

Conversation

@mudler

@mudler mudler commented Jun 5, 2026

Copy link
Copy Markdown
Owner

Pulls in mudler/LocalRecall#46, which rewrites the PostgreSQL hybrid search as an index-backed two-stage re-rank. Fixes the full sequential scan that blew past the statement timeout on large collections (mudler/LocalAI#10186).

Copilot AI review requested due to automatic review settings June 5, 2026 23:10

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the Go module dependency on github.com/mudler/localrecall to a newer pseudo-version that includes the index-backed, two-stage hybrid search re-rank implementation described in the PR description, addressing prior performance issues from sequential scans on large collections.

Changes:

  • Bump github.com/mudler/localrecall from v0.6.1-0.20260507074622-a7724fef6f81 to v0.6.3-0.20260605225344-15256b258302 in go.mod.
  • Update go.sum checksums to match the new localrecall version.

Reviewed changes

Copilot reviewed 1 out of 2 changed files in this pull request and generated no comments.

File Description
go.mod Updates the required github.com/mudler/localrecall version to the newer index-backed hybrid search implementation.
go.sum Refreshes module and go.mod checksums for the bumped localrecall version.

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@mudler mudler force-pushed the chore/bump-localrecall-10186 branch from 2281e0b to 0ec165c Compare June 5, 2026 23:38
Pulls in mudler/LocalRecall#46 (merged), which rewrites the PostgreSQL
hybrid search using the canonical Reciprocal Rank Fusion pattern
(index-backed candidate retrieval + FULL OUTER JOIN + weighted RRF). Fixes
the full sequential scan that blew past the statement timeout on large
collections (mudler/LocalAI#10186).

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
@mudler mudler force-pushed the chore/bump-localrecall-10186 branch from 0ec165c to 4b2bc28 Compare June 6, 2026 07:09
@mudler mudler merged commit 14aed1a into main Jun 6, 2026
1 of 2 checks passed
@mudler mudler deleted the chore/bump-localrecall-10186 branch June 6, 2026 07:12
mudler added a commit to mudler/LocalAI that referenced this pull request Jun 6, 2026
Bumps the agent stack to pull in the PostgreSQL hybrid-search fix:

- mudler/localrecall -> v0.6.3-...-9a3b3321a9cd (mudler/LocalRecall#46, merged)
- mudler/LocalAGI    -> ...-14aed1ae4336 (mudler/LocalAGI#477, merged)

localrecall's hybrid search previously sorted on a wrapped scalar
similarity expression, which blinded the planner into a full sequential
scan over every row and exceeded the statement timeout on large
collections, returning an empty result set. It now uses the canonical
Reciprocal Rank Fusion pattern (index-backed candidate retrieval + FULL
OUTER JOIN + weighted RRF).

Fixes #10186

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
mudler added a commit to mudler/LocalAI that referenced this pull request Jun 6, 2026
#10186) (#10192)

chore: bump LocalAGI and localrecall (index-backed RRF hybrid search)

Bumps the agent stack to pull in the PostgreSQL hybrid-search fix:

- mudler/localrecall -> v0.6.3-...-9a3b3321a9cd (mudler/LocalRecall#46, merged)
- mudler/LocalAGI    -> ...-14aed1ae4336 (mudler/LocalAGI#477, merged)

localrecall's hybrid search previously sorted on a wrapped scalar
similarity expression, which blinded the planner into a full sequential
scan over every row and exceeded the statement timeout on large
collections, returning an empty result set. It now uses the canonical
Reciprocal Rank Fusion pattern (index-backed candidate retrieval + FULL
OUTER JOIN + weighted RRF).

Fixes #10186

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants