Describe the enhancement:
While testing Kafka output in Filebeat, the documents were not published to Kafka because of compression: gzip was not supported on Azure Event Hub for Kafka.
It was necessary to raise the logging to debug in order to get an hint to what was happening:
2020-10-02T14:34:55.443Z DEBUG [kafka] kafka/client.go:291 Kafka publish failed with: kafka server: The requested operation is not supported by the message format version.
2020-10-02T14:34:55.443Z DEBUG [kafka] kafka/client.go:172
Describe a specific use case for the enhancement or feature:
I do not know if this might get too verbose (I let the maintainers decide if this should be handled at higher level), but I would change the severity of:
|
r.client.log.Debugf("Kafka publish failed with: %+v", err) |
Describe the enhancement:
While testing Kafka output in Filebeat, the documents were not published to Kafka because of
compression: gzipwas not supported on Azure Event Hub for Kafka.It was necessary to raise the logging to debug in order to get an hint to what was happening:
Describe a specific use case for the enhancement or feature:
I do not know if this might get too verbose (I let the maintainers decide if this should be handled at higher level), but I would change the severity of:
beats/libbeat/outputs/kafka/client.go
Line 292 in bb89344