Skip to content

After upgrade to 1.15.3 => [inputs.vsphere] Error in plugin: while collecting vm: ServerFaultCode: XML document element count exceeds configured maximum 500000 #8169

@BenoitPoulet

Description

@BenoitPoulet

Relevant telegraf.conf:

[[inputs.vsphere]]
  interval = "300s"
  vcenters = [ "https://1/sdk", "https://2/sdk" ]
  username = "yy"
  password = "xx"
    max_query_objects = 64
    max_query_metrics = 64
   collect_concurrency = 5
   discover_concurrency = 2
    object_discovery_interval = "1800s"
    timeout = "120s"
    insecure_skip_verify = true

  [inputs.vsphere.tags]
    tag1 = "vsphere"

System info:

Debian 9.13
Telegraf 1.15.3

Steps to reproduce:

  1. Have a Telegraf 1.14.3 running fine with this config
  2. Upgrade Telegraf to 1.15.3
  3. Errors in the log files, one of the Vcenter data are no longer inserted into the DB

Additional info:

The Vcenter who is impacted has the version : 6.5.0.13000

Roll back to version 1.14.3 solved the problem.

Debug log :

2020-09-22T16:20:35Z E! [inputs.vsphere] Error in plugin: while collecting cluster: ServerFaultCode: This operation is restricted by the administrator - 'vpxd.stats.maxQueryMetrics'. Contact your system administrator.
2020-09-22T16:20:35Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2020-09-22T16:20:36Z D! [inputs.vsphere] Query for cluster returned metrics for 21 objects
2020-09-22T16:20:36Z D! [inputs.vsphere] CollectChunk for cluster returned 63 metrics
2020-09-22T16:20:36Z D! [inputs.vsphere] CollectChunk for cluster returned 63 metrics
2020-09-22T16:20:36Z D! [inputs.vsphere] Query for cluster has 1 QuerySpecs
2020-09-22T16:20:36Z D! [inputs.vsphere] CollectChunk for vm returned 0 metrics
2020-09-22T16:20:36Z E! [inputs.vsphere] Error in plugin: while collecting vm: ServerFaultCode: XML document element count exceeds configured maximum 500000

while parsing property "counterId" of static type int

while parsing serialized DataObject of type vim.PerformanceManager.MetricId
at line 2, column 11453111

while parsing property "metricId" of static type ArrayOfPerfMetricId

while parsing serialized DataObject of type vim.PerformanceManager.QuerySpec
at line 2, column 11452458

while parsing call information for method QueryPerf
at line 2, column 66

while parsing SOAP body
at line 2, column 60

while parsing SOAP envelope
at line 2, column 0

while parsing HTTP request for method queryStats
on object of type vim.PerformanceManager
at line 1, column 0
2020-09-22T16:20:36Z D! [inputs.vsphere] Latest sample for vm set to 0001-01-01 00:00:00 +0000 UTC
2020-09-22T16:20:36Z D! [inputs.vsphere] Query for cluster returned metrics for 1 objects
2020-09-22T16:20:36Z D! [inputs.vsphere] CollectChunk for cluster returned 27 metrics

Metadata

Metadata

Assignees

No one assigned

    Labels

    area/vspherebugunexpected problem or unintended behavior

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions