- Version: metricbeat-7.5.1
- Operating System: Kubernetes, GKE, Elastic Docker container
if the diskio metricset is enabled, the following ERROR shows in the logs a few seconds after startup. It persists during the runtime and often increases its frequency
2020-01-14T18:32:53.571Z ERROR elasticsearch/client.go:404 Failed to encode event: unsupported float value: NaN
Full logfile: metricbeat.log
There are other INFO errors too, but I'm not sure if they are related:
020-01-14T16:01:02.010Z INFO module/wrapper.go:252 Error fetching data for metricset kubernetes.system: error doing HTTP request to fetch 'system' Metricset data: error making http request: Get http://localhost:10255/stats/summary: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2020-01-14T16:01:02.067Z INFO module/wrapper.go:252 Error fetching data for metricset kubernetes.volume: error doing HTTP request to fetch 'volume' Metricset data: error making http request: Get http://localhost:10255/stats/summary: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2020-01-14T16:01:02.068Z INFO module/wrapper.go:252 Error fetching data for metricset kubernetes.pod: error doing HTTP request to fetch 'pod' Metricset data: error making http request: Get http://localhost:10255/stats/summary: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2020-01-14T16:01:02.136Z INFO module/wrapper.go:252 Error fetching data for metricset kubernetes.container: error doing HTTP request to fetch 'container' Metricset data: error making http request: Get http://localhost:10255/stats/summary: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
2020-01-14T16:01:02.136Z INFO module/wrapper.go:252 Error fetching data for metricset kubernetes.node: error doing HTTP request to fetch 'node' Metricset data: error making http request: Get http://localhost:10255/stats/summary: net/http: request canceled (Client.Timeout exceeded while awaiting headers)
202
metricbeat.yml
metricbeat.config.modules:
path: ${path.config}/modules.d/*.yml
reload.enabled: false
processors:
- add_cloud_metadata: ~
- add_docker_metadata: ~
output.elasticsearch:
hosts: '${ELASTICSEARCH_HOSTS:elasticsearch:9200}'
username: '${ELASTICSEARCH_USERNAME:}'
password: '${ELASTICSEARCH_PASSWORD:}'
modules.d
- module: docker
metricsets:
- container
- cpu
- diskio
- event
- healthcheck
- info
- memory
- network
hosts: ["unix:///var/run/docker.sock"]
period: 10s- module: kubernetes
metricsets:
- node
- system
- pod
- container
- volume
period: 10s
host: ${NODE_NAME}
hosts: ["localhost:10255"]
add_metadata: true
- module: kubernetes
metricsets:
- proxy
period: 10s
host: ${NODE_NAME}
hosts: ["localhost:10249"]- module: system
period: 10s
metricsets:
- cpu
- load
- memory
- network
- process
- process_summary
- core
- diskio
- socket
processes: ['.*']
process.include_top_n:
by_cpu: 5 # include top 5 processes by CPU
by_memory: 5 # include top 5 processes by memory
- module: system
period: 1m
metricsets:
- filesystem
- fsstat
processors:
- drop_event.when.regexp:
system.filesystem.mount_point: '^/(sys|cgroup|proc|dev|etc|host|lib)($|/)'
if the diskio metricset is enabled, the following ERROR shows in the logs a few seconds after startup. It persists during the runtime and often increases its frequency
2020-01-14T18:32:53.571Z ERROR elasticsearch/client.go:404 Failed to encode event: unsupported float value: NaNFull logfile: metricbeat.log
There are other INFO errors too, but I'm not sure if they are related:
metricbeat.yml
modules.d