Skip to content

Parametrize + test VectorScorerOSQBenchmark#140354

Merged
ldematte merged 6 commits intoelastic:mainfrom
ldematte:more-osq-benchmarks
Jan 9, 2026
Merged

Parametrize + test VectorScorerOSQBenchmark#140354
ldematte merged 6 commits intoelastic:mainfrom
ldematte:more-osq-benchmarks

Conversation

@ldematte
Copy link
Copy Markdown
Contributor

@ldematte ldematte commented Jan 8, 2026

Parametrize VectorScorerOSQBenchmark and add tests for it

@ldematte ldematte added >test Issues or PRs that are addressing/adding tests :Search Relevance/Vectors Vector search labels Jan 8, 2026
@elasticsearchmachine elasticsearchmachine added Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch v9.4.0 labels Jan 8, 2026
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-search-relevance (Team:Search Relevance)


public enum VectorImplementation {
SCALAR,
VECTORIZED
Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I decided to keep this as a separate VectorImplementation class, as the OSQ scorers do not have the SCALAR/LUCENE/NATIVE distinction (only vectorized/non vectorized), and probably they never will (we probably will just replace the Panama vectorized code with native). But I'll revisit this in case we make changes.

@ldematte ldematte requested a review from thecoop January 8, 2026 11:13
Copy link
Copy Markdown
Member

@thecoop thecoop left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One tweak, but otherwise LGTM

@ldematte ldematte enabled auto-merge (squash) January 9, 2026 09:04
@ldematte ldematte merged commit 8741678 into elastic:main Jan 9, 2026
35 checks passed
szybia added a commit to szybia/elasticsearch that referenced this pull request Jan 9, 2026
* upstream/main: (76 commits)
  [Inference API] Get _services skips EIS authorization call if CCM is not configured (elastic#139964)
  Improve TSDB codec benchmarks with full encoder and compression metrics (elastic#140299)
  ESQL: Consolidate test `BlockLoaderContext`s (elastic#140403)
  ESQL: Improve Lookup Join performance with CachedDirectoryReader (elastic#139314)
  ES|QL: Add more examples for the match operator (elastic#139815)
  ESQL: Add timezone to add and sub operators, and ConfigurationAware planning support (elastic#140101)
  ESQL: Updated ToIp tests and generated documentation for map parameters (elastic#139994)
  Disable _delete_by_query and _update_by_query for CCS/stateful (elastic#140301)
  Remove unused method ElasticInferenceService.translateToChunkedResults (elastic#140442)
  logging hot threads on large queue of the management threadpool (elastic#140251)
  Search functions docs cleanup (elastic#140435)
  Unmute 350_point_in_time/point-in-time with index filter (elastic#140443)
  Remove unused methods (elastic#140222)
  Add CPS and `project_routing` support for `_mvt` (elastic#140053)
  Streamline `ShardDeleteResults` collection (elastic#140363)
  Fix Docker build to use --load for single-platform images (elastic#140402)
  Parametrize + test VectorScorerOSQBenchmark (elastic#140354)
  `RecyclerBytesStreamOutput` using absolute offsets (elastic#140303)
  Define bulk float native methods for vector scoring (elastic#139885)
  Make `TimeSeriesAggregate` `TimestampAware` (elastic#140270)
  ...
@felixbarny
Copy link
Copy Markdown
Member

I got a randomized test failure from these tests on my PR:

org.junit.internal.ArrayComparisonFailure: bulk scoring, scalar VS vectorized: arrays first differed at element [323]; expected:<568.4302> but was:<568.4109>
> java.lang.AssertionError: expected:<568.4302> but was:<568.4109>

Maybe the delta is too narrow?

jimczi pushed a commit to jimczi/elasticsearch that referenced this pull request Jan 12, 2026
Parametrize VectorScorerOSQBenchmark and add tests for it
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Search Relevance/Vectors Vector search Team:Search Relevance Meta label for the Search Relevance team in Elasticsearch >test Issues or PRs that are addressing/adding tests v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants