Feature Request

Adding the option to read the whole file before parsing for inputs.directory_monitor.

Proposal:

Adding an option to read the whole file before parsing.

  ## Read whole file before parsing.
  # read_whole_file = false

Current behaviour:

Currently, this input parses the file one line at a time.

Desired behaviour:

Use case:

This fill resolves the issues of parsing CSV files that have metadata before the header line or have multi-lined headers.
This would also add the support for parsing XML files (needs testing to see the current behaviour of this input plug-in).