[Filebeat] Add support for Cloudtrail digest files#21086
Merged
leehinman merged 3 commits intoelastic:masterfrom Sep 15, 2020
Merged
[Filebeat] Add support for Cloudtrail digest files#21086leehinman merged 3 commits intoelastic:masterfrom
leehinman merged 3 commits intoelastic:masterfrom
Conversation
- allow file matching with file_selectors in s3 input - update cloudtrail pipeline - update cloudtrail config to use file_selectors - add cloudtrail digest fields Closes elastic#20943
Contributor
|
Pinging @elastic/siem (Team:SIEM) |
| type FileSelectorCfg struct { | ||
| RegexString string `config:"regex"` | ||
| Regex *regexp.Regexp `config:",ignore"` | ||
| ExpandEventListFromField string `config:"expand_event_list_from_field"` |
Contributor
There was a problem hiding this comment.
This looks good! One question: what happens if file_selectors are specified and also the global expand_event_list_from_field is given, which one takes priority? Maybe we should clarify this in the documentation 😄
kaiyan-sheng
approved these changes
Sep 14, 2020
Contributor
kaiyan-sheng
left a comment
There was a problem hiding this comment.
Thanks for adding this! It looks good overall besides we are missing a changelog entry here.
Contributor
💔 Tests Failed
Expand to view the summary
Build stats
Test stats 🧪
Test errorsExpand to view the tests failures
Steps errorsExpand to view the steps failures
Log outputExpand to view the last 100 lines of log output
|
- Add changelog - update docs - add insight section
kaiyan-sheng
approved these changes
Sep 14, 2020
Contributor
Author
|
jenkins run tests |
6 tasks
leehinman
added a commit
to leehinman/beats
that referenced
this pull request
Sep 15, 2020
* Add support for Cloudtrail digest files - allow file matching with file_selectors in s3 input - update cloudtrail pipeline - update cloudtrail config to use file_selectors - add cloudtrail digest fields - add cloudtrail insight fields Closes elastic#20943 (cherry picked from commit c9f7a99)
6 tasks
leehinman
added a commit
to leehinman/beats
that referenced
this pull request
Sep 15, 2020
* Add support for Cloudtrail digest files - allow file matching with file_selectors in s3 input - update cloudtrail pipeline - update cloudtrail config to use file_selectors - add cloudtrail digest fields - add cloudtrail insight fields Closes elastic#20943 (cherry picked from commit c9f7a99)
v1v
added a commit
to v1v/beats
that referenced
this pull request
Sep 18, 2020
…ne-2.0 * upstream/master: (44 commits) Update users.asciidoc (elastic#20802) (elastic#21108) Fix docker provider builder. (elastic#21118) [Elastic Agent] Add docker composable dynamic provider. (elastic#20842) Add new modules/filesets from rsa2elk for 7.10 (elastic#20820) Fix broken links to external websites (elastic#21061) [docs] typo in the command line (elastic#20799) [Filebeat] add panos type and sub_type (elastic#20912) Move the `compute_vm_scalset` to a light metricset and map the cloud metadata (elastic#21038) [Filebeat] Add support for Cloudtrail digest files (elastic#21086) Add metrics collection from cost explorer into aws/billing metricset (elastic#20527) Add vendoring to Google Cloud Functions again (elastic#21070) [Elastic Agent] Add fleet.host.id for sending to endpoint. (elastic#21042) Do not need Google credentials before using it (elastic#21072) [Filebeat][New Module] Zoom webhook module (elastic#20414) Add support for GMT timezone offset in decode_cef (elastic#20993) Filebeat: Fix random error on harvester close (elastic#21048) Add ingress controller dashboards (elastic#21052) Fix loggers in composable module. (elastic#21047) [Ingest Manager] Increase kibana client timeout to 5 minutes (elastic#21037) Add changelog. (elastic#21041) ...
leweafan
pushed a commit
to leweafan/beats
that referenced
this pull request
Apr 28, 2023
…lastic#21089) * Add support for Cloudtrail digest files - allow file matching with file_selectors in s3 input - update cloudtrail pipeline - update cloudtrail config to use file_selectors - add cloudtrail digest fields - add cloudtrail insight fields Closes elastic#20943 (cherry picked from commit 6e3cb57)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Adds support for Cloudtrail Digest Logs and Cloudtrail Insight logs.
Also adds options to ignore cloudtrail, cloudtrail-digest or
cloudtrail-insight logs if necessary.
Why is it important?
logs.
Checklist
CHANGELOG.next.asciidocorCHANGELOG-developer.next.asciidoc.How to test this PR locally
Related issues