Skip to content

Define bulk operations for vector square distance#139198

Merged
thecoop merged 15 commits intoelastic:mainfrom
thecoop:vectors-bulk-square-distance
Dec 18, 2025
Merged

Define bulk operations for vector square distance#139198
thecoop merged 15 commits intoelastic:mainfrom
thecoop:vectors-bulk-square-distance

Conversation

@thecoop
Copy link
Copy Markdown
Member

@thecoop thecoop commented Dec 8, 2025

Implement native bulk operations for square distance calculations.

The native implementations don't do anything exciting at the moment, but despite that, they still show a speed improvement of 1.5x-2x over the Lucene implementation for AVX2 and Neon, and 4x for AVX512

@thecoop thecoop force-pushed the vectors-bulk-square-distance branch from cd33e04 to 25b2484 Compare December 8, 2025 15:56
Copy link
Copy Markdown
Contributor

@ldematte ldematte left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Some comments, probably due to some copy/paste

@thecoop thecoop marked this pull request as ready for review December 17, 2025 16:59
@thecoop thecoop requested a review from a team as a code owner December 17, 2025 16:59
@elasticsearchmachine elasticsearchmachine added the Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch label Dec 17, 2025
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-search-relevance (Team:Search Relevance)

@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Hi @thecoop, I've created a changelog YAML for you.

Copy link
Copy Markdown
Contributor

@ldematte ldematte left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@thecoop thecoop merged commit 3f35464 into elastic:main Dec 18, 2025
35 checks passed
@thecoop thecoop deleted the vectors-bulk-square-distance branch December 18, 2025 15:13
szybia added a commit to szybia/elasticsearch that referenced this pull request Dec 19, 2025
* upstream/main: (253 commits)
  Adds ST_SIMPLIFY geo spatial function (elastic#136309)
  Take control of max clause count verification in Lucene searcher (elastic#139752)
  [ML] Unmute Inference Test (elastic#139765)
  Parameterize the vector operation benchmark tests (elastic#139735)
  Fix node reduction pushdown tests for release tests (elastic#139548)
  Fix flakiness in TSDataGenerationHelper (elastic#139759)
  CPS: Copy existing resolved index expressions when constructing a new `SearchRequest` from an existing one (elastic#139596)
  Add release notes for v9.1.9 release (elastic#139674)
  Add lucene query for wildcards on high cardinality keyword fields. (elastic#139746)
  Suppress Tika entitlement warnings from AWT (elastic#139711)
  Check field storage when synthetic source is enabled, in tests (elastic#139715)
  Refactor VectorSimilarityType to know about its corresponding Function (elastic#139678)
  Merge fixes from patch branch back into main (elastic#139721)
  Define native bulk operations for vector square distance (elastic#139198)
  Use LongUpDownCounter for Linked Project Error Metrics (elastic#139657)
  ESQL: Add javadoc that explains version-aware planning (elastic#139706)
  Add helper to pick node for reindex relocation (elastic#139081)
  Fix auth serialization randomized version test (elastic#139182)
  ES|QL - Add parsing, preanalysis and analysis timing information to profile (elastic#139540)
  Mute org.elasticsearch.persistent.ClusterPersistentTasksCustomMetadataTests testMinVersionSerialization elastic#139741
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

>enhancement :Search Relevance/Vectors Vector search Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants