Skip to content
This repository was archived by the owner on Sep 21, 2023. It is now read-only.
This repository was archived by the owner on Sep 21, 2023. It is now read-only.

Expose go-elasticsearch BulkIndexer output performance metrics #153

@cmacknz

Description

@cmacknz

With the switch to the go-elasticsearch client we should expose the Elasticsearch client, transport, and BulkIndexer metrics as part of the shipper metrics.

We should capture and expose at least the following metrics as part of the shipper HTTP stats endpoint:

We should also ideally expose metrics for:

  • The number of times a BulkIndexer flushed because the byte threshold was hit.
  • The number of times a BulkIndexer flushed because the timeout expired.

These two metrics may give us a good idea of if additional workers or indexers are needed. Frequently flushing because the byte threshold is hit may indicate the shipper could benefit from additional workers.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions