Skip to content

Cherry-pick #25041 to 7.x: Add awsfargate module to collect container logs from Amazon ECS on Fargate#25161

Merged
kaiyan-sheng merged 2 commits intoelastic:7.xfrom
kaiyan-sheng:backport_25041_7.x
Apr 20, 2021
Merged

Cherry-pick #25041 to 7.x: Add awsfargate module to collect container logs from Amazon ECS on Fargate#25161
kaiyan-sheng merged 2 commits intoelastic:7.xfrom
kaiyan-sheng:backport_25041_7.x

Conversation

@kaiyan-sheng
Copy link
Copy Markdown
Contributor

@kaiyan-sheng kaiyan-sheng commented Apr 20, 2021

Cherry-pick of PR #25041 to 7.x branch. Original message:

What does this PR do?

This PR is to add support for collecting logs from AWS Fargate with awsfargate module.

Checklist

  • My code follows the style guidelines of this project
  • I have commented my code, particularly in hard-to-understand areas
  • I have made corresponding changes to the documentation
  • I have made corresponding change to the default configuration files
  • I have added tests that prove my fix is effective or that my feature works
  • I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

How to test this PR locally

Step1: Follow steps in Metricbeat documentation to create some containers running using Fargate.

Step2: Check CloudWatch to get the log group ARN where your fargate logs are sent to.

Step3: Enable awsfargate module using ./filebeat modules enable awsfargate.

Step4: Modify awsfargate.yml with credentials and the log group ARN. For example:

- module: awsfargate
  log:
    enabled: true
    var.credential_profile_name: elastic-beats
    var.log_group_arn: arn:aws:logs:us-east-1:1234567890:log-group:/ecs/metricbeat-awsfargate:*

Step5: Start Filebeat and you should be able to see logs getting ingested into ES.

Related issues

@botelastic botelastic bot added the needs_team Indicates that the issue/PR needs a Team:* label label Apr 20, 2021
@elasticmachine
Copy link
Copy Markdown
Contributor

Pinging @elastic/integrations (Team:Integrations)

@botelastic botelastic bot removed the needs_team Indicates that the issue/PR needs a Team:* label label Apr 20, 2021
@kaiyan-sheng kaiyan-sheng self-assigned this Apr 20, 2021
@elasticmachine
Copy link
Copy Markdown
Contributor

elasticmachine commented Apr 20, 2021

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #25161 updated

  • Start Time: 2021-04-20T07:32:30.471+0000

  • Duration: 48 min 44 sec

  • Commit: 5c0eb2e

Test stats 🧪

Test Results
Failed 0
Passed 13498
Skipped 2285
Total 15783

Trends 🧪

Image of Build Times

Image of Tests

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test Results
Failed 0
Passed 13498
Skipped 2285
Total 15783

@kaiyan-sheng kaiyan-sheng merged commit aec3196 into elastic:7.x Apr 20, 2021
@kaiyan-sheng kaiyan-sheng deleted the backport_25041_7.x branch April 20, 2021 08:58
@zube zube bot removed the [zube]: Done label Jul 19, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

backport Team:Integrations Label for the Integrations team

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants