[Metricbeat] Add memory PSI metrics for cgroupv2 by orestisfl · Pull Request #48054 · elastic/beats

orestisfl · 2025-12-11T15:39:30Z

Proposed commit message

Add memory pressure PSI metrics to the system.process.cgroup.memory
metricset, complementing the existing CPU and IO pressure metrics.

New fields added under system.process.cgroup.memory.pressure:

pressure.some.{10,60,300}.pct - Share of time with some tasks stalled
pressure.some.total - Total some pressure time
pressure.full.{10,60,300}.pct - Share of time with all tasks stalled
pressure.full.total - Total full pressure time

Closes #47604

Checklist

My code follows the style guidelines of this project
I have commented my code, particularly in hard-to-understand areas
I have made corresponding changes to the documentation
~~I have made corresponding change to the default configuration files~~
I have added tests that prove my fix is effective or that my feature works. Where relevant, I have used the stresstest.sh script to run them under stress conditions and race detector to verify their stability.
I have added an entry in ./changelog/fragments using the changelog tool.

How to test this PR locally

1. Build and Run Metricbeat

cd metricbeat
go build .

2. Create Test Configuration

metricbeat.modules:
- module: system
  period: 5s
  metricsets:
    - process
  processes: ['.*']
  process.cgroups.enabled: true

output.console:
  pretty: true

3. Run Metricbeat

./metricbeat -e -c /tmp/metricbeat-psi-test.yml

4. Verify Memory Pressure Fields

Look for system.process.cgroup.memory.pressure in the output:

"memory": {
  "pressure": {
    "some": {
      "10": { "pct": 0 },
      "60": { "pct": 0 },
      "300": { "pct": 0 },
      "total": 0
    },
    "full": {
      "10": { "pct": 0 },
      "60": { "pct": 0 },
      "300": { "pct": 0 },
      "total": 0
    }
  }
}

5. Compare Before/After (Optional)

compare-psi-metrics.sh
Use the comparison script to compare output from main vs this PR:

compare-psi-metrics.sh
Usage: ./compare-psi-metrics.sh <main-output.ndjson> <pr-output.ndjson>

Related issues

Add memory pressure PSI metrics to the system.process.cgroup.memory metricset, complementing the existing CPU and IO pressure metrics. New fields added under system.process.cgroup.memory.pressure: - pressure.some.{10,60,300}.pct - Share of time with some tasks stalled - pressure.some.total - Total some pressure time - pressure.full.{10,60,300}.pct - Share of time with all tasks stalled - pressure.full.total - Total full pressure time Closes elastic#47604

github-actions · 2025-12-11T15:39:41Z

🤖 GitHub comments

Just comment with:

run docs-build : Re-trigger the docs validation. (use unformatted text in the comment!)

mergify · 2025-12-11T15:40:11Z

This pull request does not have a backport label.
If this is a bug or security fix, could you label this PR @orestisfl? 🙏.
For such, you'll need to label your PR with:

The upcoming major version of the Elastic Stack
The upcoming minor version of the Elastic Stack (if you're not pushing a breaking change)

To fixup this pull request, you need to add the backport labels for the needed
branches, such as:

backport-8./d is the label to automatically backport to the 8./d branch. /d is the digit
backport-active-all is the label that automatically backports to all active branches.
backport-active-8 is the label that automatically backports to all active minor branches for the 8 major.
backport-active-9 is the label that automatically backports to all active minor branches for the 9 major.

github-actions · 2025-12-11T15:41:14Z

🔍 Preview links for changed docs

elasticmachine · 2025-12-16T12:50:37Z

Pinging @elastic/elastic-agent-data-plane (Team:Elastic-Agent-Data-Plane)

colleenmcginnis

Starting with v9.0, there is no longer a new documentation set published with every minor release: the same page stays valid over time and shows version-related evolutions (ref). As a result, we add version information in the fields.yml and it adds version badges to the generated Markdown file. Read more in Contributing to the docs.

Based on the backport labels, I assumed these changes are targeting 9.3.0, but feel free to adjust as needed. After applying the suggestions you'll have to regenerate the docs.

metricbeat/module/system/process/_meta/fields.yml

Co-authored-by: Colleen McGinnis <colleen.j.mcginnis@gmail.com>

colleenmcginnis · 2025-12-16T17:09:54Z

You'll have to regenerate the docs (make update) to get the check-docs check to pass.

colleenmcginnis

✨

github-actions · 2026-02-24T09:59:56Z

@Mergifyio backport 8.19 9.2 9.3

mergify · 2026-02-24T10:00:08Z

backport 8.19 9.2 9.3

✅ Backports have been created

Details

#49055 [8.19](backport #48054) [Metricbeat] Add memory PSI metrics for cgroupv2 has been created for branch 8.19 but encountered conflicts

Cherry-pick of c3f35a9 has failed:

On branch mergify/bp/8.19/pr-48054
Your branch is up to date with 'origin/8.19'.

You are currently cherry-picking commit c3f35a907.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	new file:   changelog/fragments/1765878935-metricbeat-cgroup-memory-pressure.yaml
	modified:   metricbeat/module/system/process/_meta/data.json
	modified:   metricbeat/module/system/process/_meta/fields.yml
	modified:   metricbeat/module/system/process/process_test.go

Unmerged paths:
  (use "git add/rm <file>..." as appropriate to mark resolution)
	both modified:   NOTICE.txt
	deleted by us:   docs/reference/metricbeat/exported-fields-system.md
	deleted by us:   docs/reference/metricbeat/metricbeat-metricset-system-process.md
	both modified:   go.mod
	both modified:   go.sum
	both modified:   metricbeat/module/system/fields.go

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

#49056 [9.2](backport #48054) [Metricbeat] Add memory PSI metrics for cgroupv2 has been created for branch 9.2 but encountered conflicts

Cherry-pick of c3f35a9 has failed:

On branch mergify/bp/9.2/pr-48054
Your branch is up to date with 'origin/9.2'.

You are currently cherry-picking commit c3f35a907.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	new file:   changelog/fragments/1765878935-metricbeat-cgroup-memory-pressure.yaml
	modified:   docs/reference/metricbeat/exported-fields-system.md
	modified:   docs/reference/metricbeat/metricbeat-metricset-system-process.md
	modified:   metricbeat/module/system/fields.go
	modified:   metricbeat/module/system/process/_meta/data.json
	modified:   metricbeat/module/system/process/_meta/fields.yml
	modified:   metricbeat/module/system/process/process_test.go

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   NOTICE.txt
	both modified:   go.mod
	both modified:   go.sum

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

#49057 [9.3](backport #48054) [Metricbeat] Add memory PSI metrics for cgroupv2 has been created for branch 9.3 but encountered conflicts

Cherry-pick of c3f35a9 has failed:

On branch mergify/bp/9.3/pr-48054
Your branch is up to date with 'origin/9.3'.

You are currently cherry-picking commit c3f35a907.
  (fix conflicts and run "git cherry-pick --continue")
  (use "git cherry-pick --skip" to skip this patch)
  (use "git cherry-pick --abort" to cancel the cherry-pick operation)

Changes to be committed:
	new file:   changelog/fragments/1765878935-metricbeat-cgroup-memory-pressure.yaml

Unmerged paths:
  (use "git add <file>..." to mark resolution)
	both modified:   NOTICE.txt
	both modified:   go.mod
	both modified:   go.sum

To fix up this pull request, you can check it out locally. See documentation: https://docs.github.com/en/pull-requests/collaborating-with-pull-requests/reviewing-changes-in-pull-requests/checking-out-pull-requests-locally

## Proposed commit message Add memory pressure PSI metrics to the system.process.cgroup.memory metricset, complementing the existing CPU and IO pressure metrics. New fields added under system.process.cgroup.memory.pressure: - pressure.some.{10,60,300}.pct - Share of time with some tasks stalled - pressure.some.total - Total some pressure time - pressure.full.{10,60,300}.pct - Share of time with all tasks stalled - pressure.full.total - Total full pressure time Closes #47604 ## How to test this PR locally ### 1. Build and Run Metricbeat ```bash cd metricbeat go build . ``` ### 2. Create Test Configuration ```yaml metricbeat.modules: - module: system period: 5s metricsets: - process processes: ['.*'] process.cgroups.enabled: true output.console: pretty: true ``` ### 3. Run Metricbeat ```bash ./metricbeat -e -c /tmp/metricbeat-psi-test.yml ``` ### 4. Verify Memory Pressure Fields Look for `system.process.cgroup.memory.pressure` in the output: ```json "memory": { "pressure": { "some": { "10": { "pct": 0 }, "60": { "pct": 0 }, "300": { "pct": 0 }, "total": 0 }, "full": { "10": { "pct": 0 }, "60": { "pct": 0 }, "300": { "pct": 0 }, "total": 0 } } } ``` ### 5. Compare Before/After (Optional) [compare-psi-metrics.sh](https://github.com/user-attachments/files/24191696/compare-psi-metrics.sh) Use the comparison script to compare output from main vs this PR: ``` compare-psi-metrics.sh Usage: ./compare-psi-metrics.sh <main-output.ndjson> <pr-output.ndjson> ``` ## Related issues - Requires elastic/elastic-agent-system-metrics#274 - Closes #47604 (cherry picked from commit c3f35a9) # Conflicts: # NOTICE.txt # docs/reference/metricbeat/exported-fields-system.md # docs/reference/metricbeat/metricbeat-metricset-system-process.md # go.mod # go.sum # metricbeat/module/system/fields.go

rdner · 2026-02-24T10:00:54Z

I'm adding backports due to failures on other backports like #48858

E           ['system.process.cgroup.memory.pressure.full.10.pct', 'system.process.cgroup.memory.pressure.full.60.pct', 'system.process.cgroup.memory.pressure.full.300.pct', 'system.process.cgroup.memory.pressure.full.total', 'system.process.cgroup.memory.pressure.some.300.pct', 'system.process.cgroup.memory.pressure.some.total', 'system.process.cgroup.memory.pressure.some.10.pct', 'system.process.cgroup.memory.pressure.some.60.pct', 'system.process.memory.swap']
E           
E           not documented in event:

## Proposed commit message Add memory pressure PSI metrics to the system.process.cgroup.memory metricset, complementing the existing CPU and IO pressure metrics. New fields added under system.process.cgroup.memory.pressure: - pressure.some.{10,60,300}.pct - Share of time with some tasks stalled - pressure.some.total - Total some pressure time - pressure.full.{10,60,300}.pct - Share of time with all tasks stalled - pressure.full.total - Total full pressure time Closes #47604 ## How to test this PR locally ### 1. Build and Run Metricbeat ```bash cd metricbeat go build . ``` ### 2. Create Test Configuration ```yaml metricbeat.modules: - module: system period: 5s metricsets: - process processes: ['.*'] process.cgroups.enabled: true output.console: pretty: true ``` ### 3. Run Metricbeat ```bash ./metricbeat -e -c /tmp/metricbeat-psi-test.yml ``` ### 4. Verify Memory Pressure Fields Look for `system.process.cgroup.memory.pressure` in the output: ```json "memory": { "pressure": { "some": { "10": { "pct": 0 }, "60": { "pct": 0 }, "300": { "pct": 0 }, "total": 0 }, "full": { "10": { "pct": 0 }, "60": { "pct": 0 }, "300": { "pct": 0 }, "total": 0 } } } ``` ### 5. Compare Before/After (Optional) [compare-psi-metrics.sh](https://github.com/user-attachments/files/24191696/compare-psi-metrics.sh) Use the comparison script to compare output from main vs this PR: ``` compare-psi-metrics.sh Usage: ./compare-psi-metrics.sh <main-output.ndjson> <pr-output.ndjson> ``` ## Related issues - Requires elastic/elastic-agent-system-metrics#274 - Closes #47604 (cherry picked from commit c3f35a9) # Conflicts: # NOTICE.txt # go.mod # go.sum

…v2 (#49056) * [Metricbeat] Add memory PSI metrics for cgroupv2 (#48054) ## Proposed commit message Add memory pressure PSI metrics to the system.process.cgroup.memory metricset, complementing the existing CPU and IO pressure metrics. New fields added under system.process.cgroup.memory.pressure: - pressure.some.{10,60,300}.pct - Share of time with some tasks stalled - pressure.some.total - Total some pressure time - pressure.full.{10,60,300}.pct - Share of time with all tasks stalled - pressure.full.total - Total full pressure time Closes #47604 ## How to test this PR locally ### 1. Build and Run Metricbeat ```bash cd metricbeat go build . ``` ### 2. Create Test Configuration ```yaml metricbeat.modules: - module: system period: 5s metricsets: - process processes: ['.*'] process.cgroups.enabled: true output.console: pretty: true ``` ### 3. Run Metricbeat ```bash ./metricbeat -e -c /tmp/metricbeat-psi-test.yml ``` ### 4. Verify Memory Pressure Fields Look for `system.process.cgroup.memory.pressure` in the output: ```json "memory": { "pressure": { "some": { "10": { "pct": 0 }, "60": { "pct": 0 }, "300": { "pct": 0 }, "total": 0 }, "full": { "10": { "pct": 0 }, "60": { "pct": 0 }, "300": { "pct": 0 }, "total": 0 } } } ``` ### 5. Compare Before/After (Optional) [compare-psi-metrics.sh](https://github.com/user-attachments/files/24191696/compare-psi-metrics.sh) Use the comparison script to compare output from main vs this PR: ``` compare-psi-metrics.sh Usage: ./compare-psi-metrics.sh <main-output.ndjson> <pr-output.ndjson> ``` ## Related issues - Requires elastic/elastic-agent-system-metrics#274 - Closes #47604 (cherry picked from commit c3f35a9) # Conflicts: # NOTICE.txt # go.mod # go.sum * Resolve conflicts --------- Co-authored-by: Orestis Floros <orestis.floros@elastic.co> Co-authored-by: Denis Rechkunov <denis.rechkunov@elastic.co>

…pv2 (#49055) * [Metricbeat] Add memory PSI metrics for cgroupv2 (#48054) ## Proposed commit message Add memory pressure PSI metrics to the system.process.cgroup.memory metricset, complementing the existing CPU and IO pressure metrics. New fields added under system.process.cgroup.memory.pressure: - pressure.some.{10,60,300}.pct - Share of time with some tasks stalled - pressure.some.total - Total some pressure time - pressure.full.{10,60,300}.pct - Share of time with all tasks stalled - pressure.full.total - Total full pressure time Closes #47604 ## How to test this PR locally ### 1. Build and Run Metricbeat ```bash cd metricbeat go build . ``` ### 2. Create Test Configuration ```yaml metricbeat.modules: - module: system period: 5s metricsets: - process processes: ['.*'] process.cgroups.enabled: true output.console: pretty: true ``` ### 3. Run Metricbeat ```bash ./metricbeat -e -c /tmp/metricbeat-psi-test.yml ``` ### 4. Verify Memory Pressure Fields Look for `system.process.cgroup.memory.pressure` in the output: ```json "memory": { "pressure": { "some": { "10": { "pct": 0 }, "60": { "pct": 0 }, "300": { "pct": 0 }, "total": 0 }, "full": { "10": { "pct": 0 }, "60": { "pct": 0 }, "300": { "pct": 0 }, "total": 0 } } } ``` ### 5. Compare Before/After (Optional) [compare-psi-metrics.sh](https://github.com/user-attachments/files/24191696/compare-psi-metrics.sh) Use the comparison script to compare output from main vs this PR: ``` compare-psi-metrics.sh Usage: ./compare-psi-metrics.sh <main-output.ndjson> <pr-output.ndjson> ``` ## Related issues - Requires elastic/elastic-agent-system-metrics#274 - Closes #47604 (cherry picked from commit c3f35a9) # Conflicts: # NOTICE.txt # docs/reference/metricbeat/exported-fields-system.md # docs/reference/metricbeat/metricbeat-metricset-system-process.md # go.mod # go.sum # metricbeat/module/system/fields.go * Resolve conflicts --------- Co-authored-by: Orestis Floros <orestis.floros@elastic.co> Co-authored-by: Denis Rechkunov <denis.rechkunov@elastic.co>

botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Dec 11, 2025

orestisfl changed the title ~~[Metricbeat][System module] Add memory pressure stall information (PS…~~ [Metricbeat] Add PSI metrics for cgroupv2 Dec 11, 2025

orestisfl self-assigned this Dec 11, 2025

orestisfl added enhancement Team:Elastic-Agent-Data-Plane Label for the Agent Data Plane team and removed needs_team Indicates that the issue/PR needs a Team:* label labels Dec 11, 2025

orestisfl changed the title ~~[Metricbeat] Add PSI metrics for cgroupv2~~ [Metricbeat] Add memory PSI metrics for cgroupv2 Dec 11, 2025

orestisfl added 10 commits December 15, 2025 18:53

Add tests

23825b4

Merge branch 'main' into metricbeat-cgroup-memory-pressure

3c3adf2

CI

3c3803e

Fix fail for / cgroup

435246d

Stricter check

0a22c6c

More fixes

5716055

Merge branch 'main' into metricbeat-cgroup-memory-pressure

87d1f8e

Changelog

64c734d

bump github.com/elastic/elastic-agent-system-metrics to release

df1ee72

make check

4c87121

orestisfl added the backport-skip Skip notification from the automated backport with mergify label Dec 16, 2025

orestisfl marked this pull request as ready for review December 16, 2025 12:50

orestisfl requested review from a team as code owners December 16, 2025 12:50

orestisfl requested review from AndersonQ and faec December 16, 2025 12:50

pierrehilbert removed the request for review from faec December 16, 2025 12:59

pierrehilbert requested review from colleenmcginnis and rdner December 16, 2025 12:59

pierrehilbert added the Team:Docs Label for the Observability docs team label Dec 16, 2025

rdner approved these changes Dec 16, 2025

View reviewed changes

colleenmcginnis reviewed Dec 16, 2025

View reviewed changes

Apply suggestions from code review

6a74267

Co-authored-by: Colleen McGinnis <colleen.j.mcginnis@gmail.com>

orestisfl requested a review from colleenmcginnis December 16, 2025 17:00

make update

382d289

cmacknz approved these changes Dec 16, 2025

View reviewed changes

colleenmcginnis approved these changes Dec 16, 2025

View reviewed changes

orestisfl enabled auto-merge (squash) December 16, 2025 17:27

orestisfl merged commit c3f35a9 into elastic:main Dec 16, 2025
213 checks passed

orestisfl deleted the metricbeat-cgroup-memory-pressure branch December 16, 2025 19:21

stefans-elastic mentioned this pull request Jan 21, 2026

[metricbeat][system] add swap field to system.process.memory metricset #48334

Merged

6 tasks

rdner added the backport-active-all Automated backport with mergify to all the active branches label Feb 24, 2026

mergify bot mentioned this pull request Feb 24, 2026

[8.19](backport #48054) [Metricbeat] Add memory PSI metrics for cgroupv2 #49055

Merged

5 tasks

mergify bot mentioned this pull request Feb 24, 2026

[9.2](backport #48054) [Metricbeat] Add memory PSI metrics for cgroupv2 #49056

Merged

5 tasks

mergify bot mentioned this pull request Feb 24, 2026

[9.3](backport #48054) [Metricbeat] Add memory PSI metrics for cgroupv2 #49057

Closed

5 tasks

Conversation

orestisfl commented Dec 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Proposed commit message

Checklist

How to test this PR locally

1. Build and Run Metricbeat

2. Create Test Configuration

3. Run Metricbeat

4. Verify Memory Pressure Fields

5. Compare Before/After (Optional)

Related issues

Uh oh!

github-actions bot commented Dec 11, 2025

🤖 GitHub comments

Uh oh!

mergify bot commented Dec 11, 2025

Uh oh!

github-actions bot commented Dec 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔍 Preview links for changed docs

Uh oh!

elasticmachine commented Dec 16, 2025

Uh oh!

colleenmcginnis left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

colleenmcginnis commented Dec 16, 2025

Uh oh!

colleenmcginnis left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

github-actions bot commented Feb 24, 2026

Uh oh!

mergify bot commented Feb 24, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

✅ Backports have been created

Uh oh!

rdner commented Feb 24, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

orestisfl commented Dec 11, 2025 •

edited

Loading

github-actions bot commented Dec 11, 2025 •

edited

Loading

mergify bot commented Feb 24, 2026 •

edited

Loading