Skip to content

Add content format detector processor #5731

@kkondaka

Description

@kkondaka

Is your feature request related to a problem? Please describe.
The event data received may have fields which can be of different format. For example, OTEL logs data contains "Body" field which is a string. The value of this field may contain JSON data or plain text or XML or CSV or Key-Value etc. Need a way to detect the format of the data in a given field
Describe the solution you'd like
Add a new processor format_detector which looks at the content of a given source field and detects the format and stores the format as a string in the event data or metadata

processor:
   - format_detector:
         source:
         # one of the following 2 is a must
         target_key:  (optional)
         target_metadata_key: (optional)
         (other config options as needed)

Describe alternatives you've considered (Optional)
A clear and concise description of any alternative solutions or features you've considered.

Additional context
Add any other context or screenshots about the feature request here.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions