Skip to content

fix: send raw metrics also during polling interval#7198

Merged
zroubalik merged 2 commits intokedacore:mainfrom
zroubalik:raw
Oct 27, 2025
Merged

fix: send raw metrics also during polling interval#7198
zroubalik merged 2 commits intokedacore:mainfrom
zroubalik:raw

Conversation

@zroubalik
Copy link
Member

@zroubalik zroubalik commented Oct 24, 2025

Fix for raw metrrics stream #7094

  • Fixed the behavior to send metrics also during polling interval
  • To support this better a new Environment Variable: RAW_METRICS_MODE with support for:
    • all or "" (empty): Send all raw metrics (both HPA and polling) - default
    • hpa: Send raw metrics only from HPA requests
    • pollinginterval: Send raw metrics only from polling interval
    • Unknown values default to all

Checklist

Fixes #7197

Relates to #7094

@zroubalik zroubalik requested a review from a team as a code owner October 24, 2025 13:04
@keda-automation keda-automation requested a review from a team October 24, 2025 13:04
@github-actions
Copy link

Thank you for your contribution! 🙏

Please understand that we will do our best to review your PR and give you feedback as soon as possible, but please bear with us if it takes a little longer as expected.

While you are waiting, make sure to:

  • Add an entry in our changelog in alphabetical order and link related issue
  • Update the documentation, if needed
  • Add unit & e2e tests for your changes
  • GitHub checks are passing
  • Is the DCO check failing? Here is how you can fix DCO issues

Once the initial tests are successful, a KEDA member will ensure that the e2e tests are run. Once the e2e tests have been successfully completed, the PR may be merged at a later date. Please be patient.

Learn more about our contribution guide.

Copy link
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

This PR fixes the raw metrics streaming feature to send metrics during polling intervals in addition to HPA requests. It introduces a new RAW_METRICS_MODE environment variable to control when raw metrics are sent.

  • Adds configurable raw metrics modes (all, HPA-only, or polling-interval-only)
  • Implements logic to send raw metrics during ScaledObject polling intervals
  • Refactors raw metrics configuration into a dedicated file

Reviewed Changes

Copilot reviewed 3 out of 3 changed files in this pull request and generated no comments.

File Description
pkg/scaling/scale_handler_raw_metrics.go Introduces raw metrics mode parsing and decision logic with new environment variable support
pkg/scaling/scale_handler.go Updates raw metrics sending calls to use new mode-aware function and adds polling interval support
CHANGELOG.md Documents the fix for raw metrics streaming during polling intervals

Tip: Customize your code reviews with copilot-instructions.md. Create the file or learn how to get started.

@zroubalik
Copy link
Member Author

zroubalik commented Oct 24, 2025

/run-e2e internal
Update: You can check the progress here

Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
@zroubalik
Copy link
Member Author

zroubalik commented Oct 24, 2025

/run-e2e internal
Update: You can check the progress here

@rickbrouwer
Copy link
Member

I am a nit picker on commit messages regarding spelling errors 😇
Is it possible to change metrrics to metrics?

@zroubalik zroubalik changed the title fix: send raw metrrics also during polling interval fix: send raw metrics also during polling interval Oct 27, 2025
@zroubalik
Copy link
Member Author

I am a nit picker on commit messages regarding spelling errors 😇 Is it possible to change metrrics to metrics?

haha, thanks a lot!, fixed

@keda-automation keda-automation requested a review from a team October 27, 2025 09:10
…etter clarity

Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
@zroubalik
Copy link
Member Author

zroubalik commented Oct 27, 2025

/run-e2e internal
Update: You can check the progress here

@zroubalik zroubalik merged commit 7c9ced6 into kedacore:main Oct 27, 2025
24 checks passed
JorTurFer pushed a commit to JorTurFer/keda that referenced this pull request Oct 29, 2025
Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
JorTurFer pushed a commit to JorTurFer/keda that referenced this pull request Oct 29, 2025
Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>
JorTurFer added a commit that referenced this pull request Oct 29, 2025
* Fix incorrect 'unmatched input property' notification (#7176)

* Fix incorrect 'unmatched input property' notification

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* Remove redundant parsing

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* fix

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* use typedconfig once

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* static check

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* Update test

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* Update datadog_scaler_test.go

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* update schemas

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* fix test

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* update typedconfig

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* Update pkg/scalers/datadog_scaler.go

Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

---------

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

* fix: add missing error returns in kafka scaler error handling (#7182)

* fix: add missing error returns in kafka scaler error handling

Add missing error returns after error logging in getTopicPartitions
and getLagForPartition functions to prevent incorrect behavior
when errors occur.

- Add error return in getTopicPartitions when listCGOffsetResponse.Err > 0
- Add error return in getTopicPartitions when topicMetadata.Err > 0
- Add error return in getLagForPartition when block.Err > 0

Previously these functions only logged errors but continued execution,
which could lead to incorrect scaling behavior.

Signed-off-by: leeyeonwoo <rexrex1105@gmail.com>

* docs: update changelog for PR #7182

Signed-off-by: leeyeonwoo <rexrex1105@gmail.com>

---------

Signed-off-by: leeyeonwoo <rexrex1105@gmail.com>
Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

* Fix incorrect 'unmatched input property' notification (#7188)

* Fix incorrect 'unmatched input property' notification

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* add azure cloud

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

* fix

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>

---------

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>
Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

* fix: feature flag for unexpected scaler param check (#7191)

Signed-off-by: Jan Wozniak <wozniak.jan@gmail.com>
Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

* Update prometheus dependency version (#7194)

Updated prometheus dependency version to v0.54.0.

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>
Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

* fix: send raw metrics also during polling interval (#7198)

Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

* update changelog

Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

* .

Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

* fix changelog

Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>

---------

Signed-off-by: Rick Brouwer <rickbrouwer@gmail.com>
Signed-off-by: Jorge Turrado <jorge.turrado@mail.schwarz>
Signed-off-by: leeyeonwoo <rexrex1105@gmail.com>
Signed-off-by: Jan Wozniak <wozniak.jan@gmail.com>
Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
Co-authored-by: Rick Brouwer <rickbrouwer@gmail.com>
Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
Co-authored-by: leeyeonwoo <74847519+5iing@users.noreply.github.com>
Co-authored-by: Jan Wozniak <wozniak.jan@gmail.com>
Co-authored-by: Zbynek Roubalik <zroubalik@gmail.com>
alt-dima pushed a commit to alt-dima/keda that referenced this pull request Dec 13, 2025
Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
Signed-off-by: Dmitriy Altuhov <altuhovd@gmail.com>
tangobango5 pushed a commit to tangobango5/keda that referenced this pull request Dec 22, 2025
Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
tangobango5 pushed a commit to tangobango5/keda that referenced this pull request Feb 13, 2026
Signed-off-by: Zbynek Roubalik <zroubalik@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Raw metrics stream is missing metrics from SO pollingInterval

6 participants