Skip to content

Adjust index versions for skippers for time series#139670

Merged
martijnvg merged 2 commits intoelastic:patch/serverless-fixfrom
jordan-powers:time-series-fixes
Dec 17, 2025
Merged

Adjust index versions for skippers for time series#139670
martijnvg merged 2 commits intoelastic:patch/serverless-fixfrom
jordan-powers:time-series-fixes

Conversation

@jordan-powers
Copy link
Copy Markdown
Contributor

I suspect this will solve the problem currently in QA.
Unfortunately we don't have good BWC testing for time_series indices in serverless, so I can't prove it.

@jordan-powers jordan-powers self-assigned this Dec 17, 2025
@jordan-powers jordan-powers added >non-issue :StorageEngine/Mapping The storage related side of mappings labels Dec 17, 2025
@elasticsearchmachine elasticsearchmachine added serverless-linked Added by automation, don't add manually Team:StorageEngine labels Dec 17, 2025
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-storage-engine (Team:StorageEngine)

Copy link
Copy Markdown
Member

@martijnvg martijnvg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think this looks good. Let's wait for PR CI to complete.

I cherry-picked Jordan's PR that allows tsdb rolling upgrade tests to also test again serverless. If this passes this is a good indication that this actually addresses the problem.

IndexVersion iv = SETTING_INDEX_VERSION_CREATED.get(s);
if (MODE.get(s) == IndexMode.TIME_SERIES) {
if (iv.onOrAfter(IndexVersions.SKIPPERS_ENABLED_BY_DEFAULT)) {
if (DOC_VALUES_SKIPPER && iv.onOrAfter(IndexVersions.SKIPPERS_ENABLED_BY_DEFAULT)) {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This makes sense given that SKIPPERS_ENABLED_BY_DEFAULT was enabled when skippers were still behind feature flag.

if (DOC_VALUES_SKIPPER && iv.onOrAfter(IndexVersions.SKIPPERS_ENABLED_BY_DEFAULT)) {
return "true";
}
if (iv.onOrAfter(IndexVersions.STATELESS_SKIPPERS_ENABLED_FOR_TSDB)) {
Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think because of the broken if (DiscoveryNode.isStateless(s)) { check before, this should be correct. We need to use new STATELESS_SKIPPERS_ENABLED_FOR_TSDB to mark when skippers should be used.

@martijnvg martijnvg self-assigned this Dec 17, 2025
@martijnvg martijnvg merged commit 7ea9a47 into elastic:patch/serverless-fix Dec 17, 2025
35 checks passed
jordan-powers added a commit that referenced this pull request Dec 18, 2025
jordan-powers added a commit to jordan-powers/elasticsearch that referenced this pull request Dec 18, 2025
elasticsearchmachine pushed a commit that referenced this pull request Dec 18, 2025
szybia added a commit to szybia/elasticsearch that referenced this pull request Jan 7, 2026
* upstream/main:
  Add hook for blocking termination (elastic#133555)
  Delegate to ES93ScalarQuantizedVectorsFormat rather than copying behaviour (elastic#139834)
  Refactor compound block types (elastic#140219)
  Flush the rate buffer when the slice index changes (elastic#138856)
  Log linked project connection errors at debug during shutdown (elastic#140239)
  Periodic FIPS 140-3 buildkite pipelines (elastic#139909)
  ES|QL - Remove TERM function (elastic#139953)
  Fix name of started time field in shutdown status (elastic#139910)
  Drop `project_routing` from query params (elastic#140272)
  Fix flaky test: AllocationDecidersTests (elastic#140271)
  Add List Reindex API (elastic#140184)
  Expose _tier metadata attribute in ESQL (elastic#139894)
  Tweak TSDBRestEsqlIT#testTimeSeriesQuerying(...) (elastic#140210)
  Fix an OOM error when creating to many chained synonym graph token filter. (elastic#140026)
  Suppress Azure SDK error logs (elastic#139730)
  Rewritten integer sorts need to use SortedNumericSortField (elastic#139538) (elastic#139700)
  Adjust index versions for skippers for time series (elastic#139670)
  Fix host.name skippers index version range (elastic#139636)
  Remove BWC shim for a broken commit
  Fix index.mapping.use_doc_values_skipper defaults in serverless (elastic#139532)
sidosera pushed a commit to sidosera/elasticsearch that referenced this pull request Jan 7, 2026
sidosera pushed a commit to sidosera/elasticsearch that referenced this pull request Jan 7, 2026
@jordan-powers jordan-powers deleted the time-series-fixes branch January 15, 2026 16:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

>non-issue serverless-linked Added by automation, don't add manually :StorageEngine/Mapping The storage related side of mappings Team:StorageEngine v9.3.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants