Skip to content

[7.16] Disable deprecation log indexing until templates are loaded backport(#80406)#80345

Merged
pgomulka merged 2 commits intoelastic:7.16from
pgomulka:bulk_processor_flush_delay
Nov 10, 2021
Merged

[7.16] Disable deprecation log indexing until templates are loaded backport(#80406)#80345
pgomulka merged 2 commits intoelastic:7.16from
pgomulka:bulk_processor_flush_delay

Conversation

@pgomulka
Copy link
Copy Markdown
Contributor

@pgomulka pgomulka commented Nov 4, 2021

Deprecation log indexing relies on index templates to be present in
cluster state in order to create a data stream.
If a very early deprecation is emitted after node is started up and
templates are not loaded yet this can result in regular index with
default settings and mappings to be created.
To prevent this a bulk processor used for indexing deprecation logs
delays flushing until templates are loaded.

closes #80265

@pgomulka pgomulka added the WIP label Nov 4, 2021
@pgomulka pgomulka self-assigned this Nov 4, 2021
@pgomulka pgomulka changed the base branch from master to 7.16 November 4, 2021 14:30
@pgomulka pgomulka removed the v8.1.0 label Nov 4, 2021
…80406)

Deprecation log indexing relies on index templates to be present in
cluster state in order to create a data stream.
If a very early deprecation is emitted after node is started up and
templates are not loaded yet this can result in regular index with
default settings and mappings to be created.
To prevent this a bulk processor used for indexing deprecation logs
delays flushing until templates are loaded.

closes elastic#80265
@pgomulka pgomulka force-pushed the bulk_processor_flush_delay branch from 7402ef2 to 388490d Compare November 9, 2021 13:32
@pgomulka pgomulka changed the title WIP Bulk processor flush delay [7.16] Disable deprecation log indexing until templates are loaded backport(#80406) Nov 9, 2021
@pgomulka pgomulka added :Core/Infra/Logging Log management and logging utilities :Data Management/Other backport v7.16.0 and removed WIP labels Nov 9, 2021
@pgomulka pgomulka marked this pull request as ready for review November 9, 2021 13:33
@elasticmachine elasticmachine added Team:Core/Infra Meta label for core/infra team Team:Data Management (obsolete) DO NOT USE. This team no longer exists. labels Nov 9, 2021
@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-core-infra (Team:Core/Infra)

@elasticmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-data-management (Team:Data Management)

@pgomulka pgomulka merged commit 8651d94 into elastic:7.16 Nov 10, 2021
@pgomulka pgomulka added the >bug label Nov 10, 2021
@pgomulka pgomulka deleted the bulk_processor_flush_delay branch July 25, 2022 13:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport >bug :Core/Infra/Logging Log management and logging utilities Team:Core/Infra Meta label for core/infra team Team:Data Management (obsolete) DO NOT USE. This team no longer exists. v7.16.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants