I'm working on ingesting GCP related data into an Elastic Cloud cluster.
I'm using the GCP Metricbeat module to ingest all relevant metric data as their is no Elastic Agent equivalent atm.
The GKE overview dashboard has some issues. Main one is that the field gcp.labels.resource.node_name gets not populated in my case. Also the namespace visualization has a query inside that is filtering to an explicit cluster name
Please include configurations and logs if available.
Metricbeat configuration:
# Module: gcp
# Docs: https://www.elastic.co/guide/en/beats/metricbeat/7.16/metricbeat-module-gcp.html
- module: gcp
metricsets:
- compute
- pubsub
- loadbalancing
- storage
#region: "us-"
project_id: "***"
credentials_file_path: "***"
exclude_labels: false
period: 1m
- module: gcp
metricsets:
- metrics
project_id: "***"
credentials_file_path: "***"
exclude_labels: false
period: 1m
metrics:
- aligner: ALIGN_NONE
service: compute
metric_types:
- "instance/cpu/reserved_cores"
- "instance/cpu/usage_time"
- "instance/cpu/utilization"
- "instance/uptime"
- module: gcp
metricsets:
- metrics
project_id: "***"
credentials_file_path: "***"
exclude_labels: false
period: 1m
metrics:
- aligner: ALIGN_NONE
service: gke
service_metric_prefix: kubernetes.io/
metric_types:
- "container/cpu/core_usage_time"
- module: gcp
metricsets:
- billing
period: 24h
project_id: "***"
credentials_file_path: "***"
dataset_id: "dataset id"
table_pattern: "table pattern"
cost_type: "regular"
For confirmed bugs, please report:
- Version: 7.16.2
- Operating System: Elastic Cloud and GCP
- Discuss Forum URL: https://elastic.slack.com/archives/CEFAY0599/p1641984148008700
- Steps to Reproduce:
1.) Create a new cluster
2.) Configure metricbeat to load as much data as possible from GCP module into ES. Use GCP project that has GKE enabled.
3.) Setup Metricbeat
4.) Open the GKE Overview dashboard
I'm working on ingesting GCP related data into an Elastic Cloud cluster.
I'm using the GCP Metricbeat module to ingest all relevant metric data as their is no Elastic Agent equivalent atm.
The GKE overview dashboard has some issues. Main one is that the field
gcp.labels.resource.node_namegets not populated in my case. Also the namespace visualization has a query inside that is filtering to an explicit cluster namePlease include configurations and logs if available.
Metricbeat configuration:
For confirmed bugs, please report:
1.) Create a new cluster
2.) Configure metricbeat to load as much data as possible from GCP module into ES. Use GCP project that has GKE enabled.
3.) Setup Metricbeat
4.) Open the GKE Overview dashboard