Skip to content

[Filebeat][Checkpoint module] field [@timestamp] already exists #19938

@Bernhard-Fluehmann

Description

@Bernhard-Fluehmann

One of a customer reported the following error when using the filebeat checkpoint module:
error.message: field [@timestamp] already exists

This seems to be related to how the ingest pipeline sets the timestamps, especially when the log contains a checkpoint.time field. Since none of the logs of test/checkpoint.log contains this field, the problem may not appear in the unit tests.

https://github.com/RealStuff/beats/tree/checkpoint-fix contains a fix for the problem.
Basically it renames the @timestamp field created by filebeat to event.created. In addition, rename processors were replaced by date processors to create the final @timestamp field.

Please let me know what you think about this fix. If you find it usable, I will create a pull request.

For confirmed bugs, please report:

  • Version: 7.8
  • Operating System: CentOS
  • Discuss Forum URL:
  • Steps to Reproduce: Send checkpoint log containing time field to filebeat checkpoint module.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions