Skip to content

in ram single mmap file#7971

Merged
timvisee merged 11 commits intodevfrom
in-ram-single-mmap-file
Jan 23, 2026
Merged

in ram single mmap file#7971
timvisee merged 11 commits intodevfrom
in-ram-single-mmap-file

Conversation

@generall
Copy link
Member

  • WIP: introduce new vector store type
  • handling of InRamMmap
  • fmt
  • feature-flag
  • fmt

Copy link
Contributor

@ffuugoo ffuugoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same everywhere, pls.

@qdrant qdrant deleted a comment from coderabbitai bot Jan 22, 2026
Co-authored-by: Roman Titov <ffuugoo@users.noreply.github.com>
@timvisee timvisee force-pushed the in-ram-single-mmap-file branch from a9ec179 to e7eeb03 Compare January 22, 2026 15:25
coderabbitai[bot]

This comment was marked as resolved.

@qdrant qdrant deleted a comment from coderabbitai bot Jan 22, 2026
@ffuugoo
Copy link
Contributor

ffuugoo commented Jan 22, 2026

I have a proposal how to make this sane, because right now it's completely unreadable.

match (vector_config.storage_type, vector_storage.multivector_config) {
    (VectorStorageType::Mmap, None) => open_mmap_vector_storage(..., true),
    (VectorStorageType::InRamMmap, None) => open_mmap_vector_storage(..., true),
    (VectorStorageType::Mmap, Some(multivector)) => open_appendable_memmap_multi_vector_storage(..., false),
    (VectorStorageType::InRamMmap, Some(multivector)) => open_appendable_memmap_multi_vector_storage(..., true),
    // etc...
}

Co-authored-by: Tim Visée <tim+github@visee.me>
@coderabbitai

This comment was marked as resolved.

coderabbitai[bot]

This comment was marked as resolved.

Copy link
Contributor

@ffuugoo ffuugoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, we can fix cosmetic stuff later

coderabbitai[bot]

This comment was marked as resolved.

Copy link
Contributor

@ffuugoo ffuugoo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image

@timvisee
Copy link
Member

Since this is feature flagged it should be safe to merge. Doing so now.

@timvisee timvisee merged commit f1fb912 into dev Jan 23, 2026
15 checks passed
@timvisee timvisee deleted the in-ram-single-mmap-file branch January 23, 2026 10:12
generall added a commit that referenced this pull request Feb 9, 2026
* WIP: introduce new vector store type

* handling of InRamMmap

* fmt

* feature-flag

* fmt

* Use if else

Co-authored-by: Roman Titov <ffuugoo@users.noreply.github.com>

* Update lib/common/common/src/flags.rs

Co-authored-by: Tim Visée <tim+github@visee.me>

* also choose madvise for single-file in-ram-mmap

* simplify generics

* gpu fix

* fix bug

---------

Co-authored-by: Tim Visée <tim+github@visee.me>
Co-authored-by: Roman Titov <ffuugoo@users.noreply.github.com>
@timvisee timvisee mentioned this pull request Feb 17, 2026
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants