Skip to content

Support AWS logs with cloudwatch input #2318

@kaiyan-sheng

Description

@kaiyan-sheng

Update: This is done in aws package version 1.10.0 and promoted to production. Kibana version limitation is: >=.15.0 or >= 8.0.0.

In aws package, we have several data streams that collect logs from AWS services. These data streams are currently only supporting aws-s3 input. This issue is to add support for aws-cloudwatch input so users can decide if they want service logs to send to S3 bucket w/o SQS notification setup or simply send them to a CloudWatch log group.

  • cloudtrail
  • cloudwatch_logs
  • ec2_logs
  • elb_logs
  • s3access
  • vpcflow
  • WAF
  • Network Firewall

I want to summarize all the log data streams we have in AWS package here with the supported inputs:

Data Stream Names aws-s3 input aws-cloudwatch input httpjson input
cloudtrail Y Y(enabled: false) Y(enabled: false)
cloudwatch_logs Y(enabled: false) Y N
ec2_logs Y(enabled: false) Y N
elb_logs Y Y(enabled: false) N
s3access Y N N
vpcflow Y(enabled: false) Y N
WAF Y Y(enabled: false) N
Network Firewall Y Y(enabled: false) N

Note: (enabled: false) means in Kibana when adding the integration, this option/toggle is not enabled by default.

Metadata

Metadata

Assignees

Type

No type
No fields configured for issues without a type.

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions