Skip to content

Update vectors memory in total index info memory [MOD-10841]#6613

Merged
alonre24 merged 10 commits intomasterfrom
update_vectors_info
Aug 12, 2025
Merged

Update vectors memory in total index info memory [MOD-10841]#6613
alonre24 merged 10 commits intomasterfrom
update_vectors_info

Conversation

@alonre24
Copy link
Copy Markdown
Collaborator

@alonre24 alonre24 commented Aug 7, 2025

Describe the changes in the pull request

As this field is a "best-effort" and non-accurate, we aim to keep it as accurate as possible and add the vector index info, which can a large portion of the total index memory to it.

Mark if applicable

  • This PR introduces API changes
  • This PR introduces serialization changes

@codecov
Copy link
Copy Markdown

codecov bot commented Aug 7, 2025

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 87.42%. Comparing base (946e552) to head (edddaab).
⚠️ Report is 1 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #6613      +/-   ##
==========================================
- Coverage   87.47%   87.42%   -0.06%     
==========================================
  Files         282      282              
  Lines       44842    44844       +2     
  Branches     7747     7747              
==========================================
- Hits        39226    39205      -21     
- Misses       5498     5521      +23     
  Partials      118      118              
Flag Coverage Δ
flow 84.46% <90.00%> (-0.18%) ⬇️
unit 49.25% <30.00%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@alonre24 alonre24 requested a review from meiravgri August 12, 2025 12:16
@alonre24 alonre24 enabled auto-merge August 12, 2025 13:58
@alonre24 alonre24 added this pull request to the merge queue Aug 12, 2025
Merged via the queue into master with commit 870e099 Aug 12, 2025
17 checks passed
@alonre24 alonre24 deleted the update_vectors_info branch August 12, 2025 15:51
@redisearch-backport-pull-request
Copy link
Copy Markdown
Contributor

Backport failed for 2.8, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin 2.8
git worktree add -d .worktree/backport-6613-to-2.8 origin/2.8
cd .worktree/backport-6613-to-2.8
git switch --create backport-6613-to-2.8
git cherry-pick -x c987ba93f96a8a5e67804ed56434c536eb7d5ba8 ae2d02520414f6447b60fdcf4394a51620c4fb2a c4e3f3822e871ba07ab54545d3605c7a9622689a b45b0cf6f427897dd4d820a47c6b4514691bfe28 e87e6e7b5d5d25a377a34370c0161e977fc204e0 05d991556335b15e17283e341838d601bb082e76 edddaab546183f59e7fa28d97af90b94746c6ea7

@redisearch-backport-pull-request
Copy link
Copy Markdown
Contributor

Backport failed for 2.6, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin 2.6
git worktree add -d .worktree/backport-6613-to-2.6 origin/2.6
cd .worktree/backport-6613-to-2.6
git switch --create backport-6613-to-2.6
git cherry-pick -x c987ba93f96a8a5e67804ed56434c536eb7d5ba8 ae2d02520414f6447b60fdcf4394a51620c4fb2a c4e3f3822e871ba07ab54545d3605c7a9622689a b45b0cf6f427897dd4d820a47c6b4514691bfe28 e87e6e7b5d5d25a377a34370c0161e977fc204e0 05d991556335b15e17283e341838d601bb082e76 edddaab546183f59e7fa28d97af90b94746c6ea7

@redisearch-backport-pull-request
Copy link
Copy Markdown
Contributor

Backport failed for 2.10, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin 2.10
git worktree add -d .worktree/backport-6613-to-2.10 origin/2.10
cd .worktree/backport-6613-to-2.10
git switch --create backport-6613-to-2.10
git cherry-pick -x c987ba93f96a8a5e67804ed56434c536eb7d5ba8 ae2d02520414f6447b60fdcf4394a51620c4fb2a c4e3f3822e871ba07ab54545d3605c7a9622689a b45b0cf6f427897dd4d820a47c6b4514691bfe28 e87e6e7b5d5d25a377a34370c0161e977fc204e0 05d991556335b15e17283e341838d601bb082e76 edddaab546183f59e7fa28d97af90b94746c6ea7

@redisearch-backport-pull-request
Copy link
Copy Markdown
Contributor

Backport failed for 8.2, because it was unable to cherry-pick the commit(s).

Please cherry-pick the changes locally and resolve any conflicts.

git fetch origin 8.2
git worktree add -d .worktree/backport-6613-to-8.2 origin/8.2
cd .worktree/backport-6613-to-8.2
git switch --create backport-6613-to-8.2
git cherry-pick -x c987ba93f96a8a5e67804ed56434c536eb7d5ba8 ae2d02520414f6447b60fdcf4394a51620c4fb2a c4e3f3822e871ba07ab54545d3605c7a9622689a b45b0cf6f427897dd4d820a47c6b4514691bfe28 e87e6e7b5d5d25a377a34370c0161e977fc204e0 05d991556335b15e17283e341838d601bb082e76 edddaab546183f59e7fa28d97af90b94746c6ea7

@alonre24 alonre24 changed the title Update vectors memory in total index info memory Update vectors memory in total index info memory [MOD-10841] Aug 13, 2025
alonre24 added a commit that referenced this pull request Aug 13, 2025
* account for vector index in total memory info

* Add svs-vamana to info telemetry

* revert vamana (split to other PR)

* revert manually

* move vector overhead to index memory usage function (WIP)

* remove leftover

* fix vector overhead usage

(cherry picked from commit 870e099)
github-merge-queue bot pushed a commit that referenced this pull request Aug 15, 2025
…6641)

Update vectors memory in total index info memory (#6613)

* account for vector index in total memory info

* Add svs-vamana to info telemetry

* revert vamana (split to other PR)

* revert manually

* move vector overhead to index memory usage function (WIP)

* remove leftover

* fix vector overhead usage

(cherry picked from commit 870e099)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants