Skip to content

[8.0] Disable deprecation log indexing until templates are loaded backport(#80406)#80529

Merged
pgomulka merged 1 commit intoelastic:8.0from
pgomulka:bp/8.0_delay_deprecation_indexing
Nov 10, 2021
Merged

[8.0] Disable deprecation log indexing until templates are loaded backport(#80406)#80529
pgomulka merged 1 commit intoelastic:8.0from
pgomulka:bp/8.0_delay_deprecation_indexing

Conversation

@pgomulka
Copy link
Copy Markdown
Contributor

@pgomulka pgomulka commented Nov 9, 2021

Deprecation log indexing relies on index templates to be present in
cluster state in order to create a data stream.
If a very early deprecation is emitted after node is started up and
templates are not loaded yet this can result in regular index with
default settings and mappings to be created.
To prevent this a bulk processor used for indexing deprecation logs
delays flushing until templates are loaded.

closes #80265

  • Have you signed the contributor license agreement?
  • Have you followed the contributor guidelines?
  • If submitting code, have you built your formula locally prior to submission with gradle check?
  • If submitting code, is your pull request against master? Unless there is a good reason otherwise, we prefer pull requests against master and will backport as needed.
  • If submitting code, have you checked that your submission is for an OS and architecture that we support?
  • If you are submitting this code for a class then read our policy for that.

…80406)

Deprecation log indexing relies on index templates to be present in
cluster state in order to create a data stream.
If a very early deprecation is emitted after node is started up and
templates are not loaded yet this can result in regular index with
default settings and mappings to be created.
To prevent this a bulk processor used for indexing deprecation logs
delays flushing until templates are loaded.

closes elastic#80265
@pgomulka pgomulka added :Core/Infra/Logging Log management and logging utilities backport :Data Management/Other labels Nov 9, 2021
@pgomulka pgomulka self-assigned this Nov 9, 2021
@elasticmachine elasticmachine added Team:Data Management (obsolete) DO NOT USE. This team no longer exists. Team:Core/Infra Meta label for core/infra team labels Nov 9, 2021
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-core-infra (Team:Core/Infra)

@pgomulka pgomulka changed the title Disable deprecation log indexing until templates are loaded (#80406) [8.0] Disable deprecation log indexing until templates are loaded backport(#80406) Nov 9, 2021
@pgomulka pgomulka merged commit 9ae2496 into elastic:8.0 Nov 10, 2021
@pgomulka pgomulka added the >bug label Nov 10, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport >bug :Core/Infra/Logging Log management and logging utilities Team:Core/Infra Meta label for core/infra team Team:Data Management (obsolete) DO NOT USE. This team no longer exists. v8.0.0-rc2

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants