Skip to content

[processors.execd] Make the buffer size configurable #8142

@M0rdecay

Description

@M0rdecay

Feature Request

Opening a feature request kicks off a discussion.

Proposal:

Add the size of the buffer used in the cmdReadOut function to the processor parameters

Current behavior:

The buffer size is currently not configurable. For this reason, an attempt to get a large metric from an external processor fails with an error:

E! [processors.execd] Error reading stdout: bufio.Scanner: token too long

Desired behavior:

The buffer size can be adjusted so that the processor can handle large metrics.

Use case:

To work with XML, I have made a wrapper for the parser and work with it as with an external processor. The processor is written following the example from the README.
When processing large documents (~7 thousand lines), receiving data back from the processor fails. The reason is as follows - as a result of parsing, the processor can return a metric of 70-80 KiB.

Also, if this error occurs, the processor stops working and does not process the following metrics, which could fit in the default buffer.

Metadata

Metadata

Assignees

No one assigned

    Labels

    feature requestRequests for new plugin and for new features to existing plugins

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions