Skip to content

[8.x](backport #41555) Journald support for System module#41670

Merged
pierrehilbert merged 1 commit into8.xfrom
mergify/bp/8.x/pr-41555
Nov 19, 2024
Merged

[8.x](backport #41555) Journald support for System module#41670
pierrehilbert merged 1 commit into8.xfrom
mergify/bp/8.x/pr-41555

Conversation

@mergify
Copy link
Copy Markdown
Contributor

@mergify mergify bot commented Nov 18, 2024

Proposed commit message

This commit adds journald support for the System module, both filesets now have a use_journald variable
that can be set to force using Journald to ingest syslog and auth logs.

The ingest pipelines are updated, now there is an entrypoint pipeline that selects the correct one according to the field
input.type.

System tests are also added.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

## Disruptive User Impact

Author's Checklist

  • Ensure the journald input is ingesting data correctly

How to test this PR locally

  1. Package Filebeat from this PR
  2. Configure the ES output and Kibana credentials
  3. Enable the system module (./filebeat modules enable system), set var.use_journald: true for both filesets (edit modules.d/system.yml)
  4. Setup the assets: ./filebeat setup --modules system (this requires Kibana credentials correctly set)
  5. Run Filebeat as root
  6. Look at the logs in the filebeat-* data view, filter by event.dataset: system.syslog or event.dataset: system.auth, ensure the logs are correctly ingested
  7. Look at the system module dashboards, ensure they're working/show data.

Related issues

## Use cases

Screenshots

Dashboards, journald and logs side by side

2024-11-08_10-54
2024-11-08_10-54_1
2024-11-08_10-55
2024-11-08_10-55_1

Events, journald and logs side by side

2024-11-08_10-59

~~## Logs~~
This is an automatic backport of pull request #41555 done by [Mergify](https://mergify.com).

This commit adds journald support for the System module, both filesets now have a `use_journald` variable
that can be set to force using Journald to ingest syslog and auth logs.

The ingest pipelines are updated, now there is an entrypoint pipeline that selects the correct one according to the field
`input.type`.

System tests are also added.

(cherry picked from commit f4b80fd)
@mergify mergify bot requested a review from a team as a code owner November 18, 2024 19:42
@mergify mergify bot added the backport label Nov 18, 2024
@mergify mergify bot requested review from AndersonQ and rdner and removed request for a team November 18, 2024 19:42
@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Nov 18, 2024
@botelastic
Copy link
Copy Markdown

botelastic bot commented Nov 18, 2024

This pull request doesn't have a Team:<team> label.

@pierrehilbert pierrehilbert merged commit 415b208 into 8.x Nov 19, 2024
@pierrehilbert pierrehilbert deleted the mergify/bp/8.x/pr-41555 branch November 19, 2024 07:38
@khushijain21 khushijain21 mentioned this pull request Jun 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport needs_team Indicates that the issue/PR needs a Team:* label

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants