Skip to content

system: fix handling of tags in syslog datastream#8600

Merged
efd6 merged 1 commit intoelastic:mainfrom
efd6:s8345-system
Nov 29, 2023
Merged

system: fix handling of tags in syslog datastream#8600
efd6 merged 1 commit intoelastic:mainfrom
efd6:s8345-system

Conversation

@efd6
Copy link
Copy Markdown
Contributor

@efd6 efd6 commented Nov 28, 2023

Proposed commit message

In the case that the user has configured no tags, but has configured preserve original event, no tags configuration fields is included in the rendered configuration. This results in the preserve_original_event being added as a sub-array to the add_locale filebeat processor and apparently not failing, but not informing ingest to retain the event. It is not possible to test the fix here due to this absence of policy failure.

Also fix exclude_files pattern in syslog and auth.

Note: this was tested manually.

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all data streams collect metrics or logs.
  • I have added an entry to my package's changelog.yml file.
  • I have verified that Kibana version constraints are current according to guidelines.

Author's Checklist

  • [ ]

How to test this PR locally

Related issues

Screenshots

@efd6 efd6 added bug Something isn't working, use only for issues Team:Security-External Integrations Integration:system System labels Nov 28, 2023
@efd6 efd6 self-assigned this Nov 28, 2023
In the case that the user has configured no tags, but has configured
preserve original event, no tags configuration fields is included in the
rendered configuration. This results in the preserve_original_event
being added as a sub-array to the add_locale filebeat processor and
apparently not failing, but not informing ingest to retain the event. It
is not possible to test the fix here due to this absence of policy
failure.

Also fix exclude_files pattern in syslog and auth.
@elasticmachine
Copy link
Copy Markdown

elasticmachine commented Nov 28, 2023

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview preview

Expand to view the summary

Build stats

  • Start Time: 2023-11-28T21:46:34.221+0000

  • Duration: 19 min 34 sec

Test stats 🧪

Test Results
Failed 0
Passed 158
Skipped 0
Total 158

🤖 GitHub comments

Expand to view the GitHub comments

To re-run your PR in the CI, just comment with:

  • /test : Re-trigger the build.

@elasticmachine
Copy link
Copy Markdown

🌐 Coverage report

Name Metrics % (covered/total) Diff
Packages 100.0% (3/3) 💚
Files 100.0% (4/4) 💚
Classes 100.0% (4/4) 💚
Methods 67.857% (57/84)
Lines 98.424% (2997/3045)
Conditionals 100.0% (0/0) 💚

@efd6 efd6 marked this pull request as ready for review November 28, 2023 22:08
@efd6 efd6 requested review from a team as code owners November 28, 2023 22:08
@elasticmachine
Copy link
Copy Markdown

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

Copy link
Copy Markdown
Contributor

@muthu-mps muthu-mps left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@efd6 efd6 merged commit c005959 into elastic:main Nov 29, 2023
@ishleenk17
Copy link
Copy Markdown
Member

@efd6 : I think this would resolve the parsing of .gz files. Customer wants to make this configurable since they have other type of files they want to exclude.
I'll raise a PR where we can take this exclude_files as input from the customer.

@elasticmachine
Copy link
Copy Markdown

Package system - 1.49.1 containing this change is available at https://epr.elastic.co/search?package=system

1 similar comment
@elasticmachine
Copy link
Copy Markdown

Package system - 1.49.1 containing this change is available at https://epr.elastic.co/search?package=system

@efd6 efd6 deleted the s8345-system branch February 5, 2025 22:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug Something isn't working, use only for issues Integration:system System

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants