feat: add hierarchy flag to LSM vector index configuration#3130
Conversation
Summary of ChangesHello @robfrank, I'm Gemini Code Assist1! I'm currently reviewing this pull request and will post my feedback shortly. In the meantime, here's a summary to help you and other reviewers quickly get up to speed! This pull request enhances the LSM vector index by introducing a new Highlights
🧠 New Feature in Public Preview: You can now enable Memory to help Gemini Code Assist learn from your team's feedback. This makes future code reviews more consistent and personalized to your project's style. Click here to enable Memory in your admin console. Using Gemini Code AssistThe full guide for Gemini Code Assist can be found on our documentation page, here are some quick tips. Invoking Gemini You can request assistance from Gemini at any point by creating a comment using either
Customization To customize Gemini Code Assist for GitHub experience, repository maintainers can create a configuration file and/or provide a custom code review style guide (such as PEP-8 for Python) by creating and adding files to a Limitations & Feedback Gemini Code Assist may make mistakes. Please leave feedback on any instances where its feedback is incorrect or counter productive. You can react with 👍 and 👎 on @gemini-code-assist comments. If you're interested in giving your feedback about your experience with Gemini Code Assist for Github and other Google products, sign up here. You can also get AI-powered code generation, chat, as well as code reviews directly in the IDE at no cost with the Gemini Code Assist IDE Extension. Footnotes
|
🧪 CI InsightsHere's what we observed from your CI run for 2dc7bec. 🟢 All jobs passed!But CI Insights is watching 👀 |
|
@tae898 I've added the flag. It was set to false as default value. What value is better as default one, in your opinion? |
There was a problem hiding this comment.
Code Review
This pull request introduces an addHierarchy flag to the LSM vector index configuration, which controls the creation of hierarchical HNSW graphs. The changes are correctly propagated through the metadata and builder classes, and new tests are included to validate the functionality. My review identified a potential NullPointerException in a new builder method and an inconsistent default value for the new flag across different builder classes. Addressing these points will improve the robustness and predictability of the new feature.
engine/src/main/java/com/arcadedb/schema/TypeLSMVectorIndexBuilder.java
Outdated
Show resolved
Hide resolved
engine/src/main/java/com/arcadedb/schema/BucketLSMVectorIndexBuilder.java
Outdated
Show resolved
Hide resolved
…lder.java Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
…uilder.java Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
| public int graphBuildCacheSize = -1; // -1 = use global default | ||
| public int mutationsBeforeRebuild = -1; // -1 = use global default | ||
| public boolean storeVectorsInGraph = false; // Phase 2: Store vectors inline in graph file | ||
| public boolean addHierarchy = true; |
There was a problem hiding this comment.
Shouldn't be false by default? Or this is always the reccommended seting?
There was a problem hiding this comment.
It was false, I've asked to @tae898 in the previous comment. Mybe true is better? I don't know :)
There was a problem hiding this comment.
didn't jvector set this true by defualt?
Setting the addHierarchy parameter to true, build a multi-layer index. This approach has proven more robust in highly challenging scenarios. https://github.com/datastax/jvector
I mean ofc I do wanna try both tho and compare.
Coverage summary from CodacySee diff coverage on Codacy
Coverage variation details
Coverage variation is the difference between the coverage for the head and common ancestor commits of the pull request branch: Diff coverage details
Diff coverage is the percentage of lines that are covered by tests out of the coverable lines that the pull request added or modified: See your quality gate settings Change summary preferences |
* feat: add hierarchy flag to LSM vector index configuration * Update engine/src/main/java/com/arcadedb/schema/TypeLSMVectorIndexBuilder.java Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * Update engine/src/main/java/com/arcadedb/schema/BucketLSMVectorIndexBuilder.java Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> * fix: disable hierarchy flag in vector index metadata --------- Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com> (cherry picked from commit aa82f86)
No description provided.