Skip to content

Reduce log noise #5273

@gavinclarkeuk

Description

@gavinclarkeuk

Is your feature request related to a problem? Please describe.

The Info level logging seems incredibly noisy, especially on certain resources. We are just using the AWS plugin, but we see ~170k logs per sync. These are almost entirely made up of "Table resolver started/finished" and "Fetch table finished" logs.

If these logged just once for each table that would be ok, but depending on the table they can log multiple times. the worst offender by far is the aws_ecr_repository_image_scan_findings table - which is responsible for a whopping ~120k of the logs we're seeing.

Describe the solution you'd like

Either consolidate the generic "Table resolver started/finished" and "Fetch table finished" info logs into a single log statement for each table, or reduce the logs to debug level (turned off by default).

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions