Skip to content

[O11y][Prometheus] Revert changes of TSDB performance and storage reduction#10766

Merged
harnish-crest-data merged 7 commits intoelastic:mainfrom
chavdaharnish:revert-tsdb-from-prometheus
Aug 22, 2024
Merged

[O11y][Prometheus] Revert changes of TSDB performance and storage reduction#10766
harnish-crest-data merged 7 commits intoelastic:mainfrom
chavdaharnish:revert-tsdb-from-prometheus

Conversation

@harnish-crest-data
Copy link
Copy Markdown
Contributor

@harnish-crest-data harnish-crest-data commented Aug 12, 2024

  • Bugfix

Proposed commit message

  • Create a dimension field having fingerprint value applied on prometheus label values to avoid document drop.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Related issues

type: group
fields:
- name: labels.*
type: object
Copy link
Copy Markdown
Contributor

@agithomas agithomas Aug 19, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let us not do this rollback change.
Introducing labels_fingerprint would suffice

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What we have presently (as below), must be retained.

- name: prometheus
  type: group
  fields:
    - name: labels.*
      type: keyword
      dimension: true
      description: |
        Prometheus metric labels

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated, thanks!

type: group
fields:
- name: labels.*
type: object
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As mentioned above, let us not do this mapping changes.

Introducing labels_fingerprint is sufficient.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated, thanks!

@andrewkroh andrewkroh added the bugfix Pull request that fixes a bug issue label Aug 19, 2024
@harnish-crest-data harnish-crest-data self-assigned this Aug 20, 2024
harnish-crest-data and others added 2 commits August 20, 2024 10:48
Co-authored-by: Agi K Thomas <101976829+agithomas@users.noreply.github.com>
@harnish-crest-data harnish-crest-data marked this pull request as ready for review August 20, 2024 05:49
@harnish-crest-data harnish-crest-data requested review from a team as code owners August 20, 2024 05:49
@andrewkroh andrewkroh added Team:Cloudnative-Monitoring Cloud Native Monitoring team [elastic/obs-cloudnative-monitoring] Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations] labels Aug 20, 2024
@agithomas agithomas changed the title [Don't merge][O11y][Prometheus] Revert changes of TSDB performance and storage reduction [O11y][Prometheus] Revert changes of TSDB performance and storage reduction Aug 20, 2024
Copy link
Copy Markdown
Contributor

@agithomas agithomas left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@elasticmachine
Copy link
Copy Markdown

💚 Build Succeeded

History

cc @harnish-elastic

@elastic-sonarqube
Copy link
Copy Markdown

@harnish-crest-data harnish-crest-data merged commit aeeb35c into elastic:main Aug 22, 2024
@elasticmachine
Copy link
Copy Markdown

Package prometheus - 1.18.1 containing this change is available at https://epr.elastic.co/search?package=prometheus

harnish-crest-data added a commit to chavdaharnish/integrations that referenced this pull request Feb 4, 2025
…uction (elastic#10766)

* Revert changes of TSDB performance and storage reduction

* update changelog.yml

* elastic-package check

* Update packages/prometheus/changelog.yml

Co-authored-by: Agi K Thomas <101976829+agithomas@users.noreply.github.com>

* address review comments

* generate system tests

* address review comments

---------

Co-authored-by: Agi K Thomas <101976829+agithomas@users.noreply.github.com>
harnish-crest-data added a commit to chavdaharnish/integrations that referenced this pull request Feb 5, 2025
…uction (elastic#10766)

* Revert changes of TSDB performance and storage reduction

* update changelog.yml

* elastic-package check

* Update packages/prometheus/changelog.yml

Co-authored-by: Agi K Thomas <101976829+agithomas@users.noreply.github.com>

* address review comments

* generate system tests

* address review comments

---------

Co-authored-by: Agi K Thomas <101976829+agithomas@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bugfix Pull request that fixes a bug issue Integration:prometheus Prometheus Team:Cloudnative-Monitoring Cloud Native Monitoring team [elastic/obs-cloudnative-monitoring] Team:Obs-InfraObs Observability Infrastructure Monitoring team [elastic/obs-infraobs-integrations]

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants