Make it possible to fetch logs from the Elastic Stack with Metricbeat. This is a meta issue to track the ongoing work. * [x] Kibana * [x] Kibana `stats` metricset: https://github.com/elastic/beats/pull/6746 * [x] Add xpack config to all metricsets * [x] Add xpack structure to `stats` metricset for `kibana_stats` docs: https://github.com/elastic/beats/pull/7525 * [x] Add xpack structure to `stats` metricset for `kibana_settings` docs: https://github.com/elastic/beats/pull/7664 * [x] Verify parity in documents indexed internally by Kibana (current mechanism) with documents indexed by Metricbeat (new mechanism): https://github.com/elastic/elastic-stack-testing/issues/25 * [x] Document how users can switch over from Kibana internal collection to Metricbeat for collecting+shipping metrics for X-Pack Monitoring: https://github.com/elastic/stack-docs/issues/86 * [x] Elasticsearch * [x] Ads `index_summary` metricset: https://github.com/elastic/beats/pull/6918 * [x] Add `shard` metricset: https://github.com/elastic/beats/pull/7006 * [x] Add `ml job` metricset: https://github.com/elastic/beats/pull/7196 * [x] Add `index_recovery` metricset: https://github.com/elastic/beats/pull/7225 * [x] Add `cluster_stats` metricset: elastic/beats#7638 * [x] Add `ccr_stats` metricset: elastic/beats#8335 * [x] Add xpack config to all metricsets * [x] Add xpack structure to `index` metricset: https://github.com/elastic/beats/pull/8260 * [x] Add xpack structure to `index_summary` metricset: https://github.com/elastic/beats/pull/7102 * [x] Add xpack structure to `shard` metricset: https://github.com/elastic/beats/pull/7097 * [x] Add xpack structure to `ml_job` metricset: https://github.com/elastic/beats/pull/8129 * [x] Add xpack structure to `index_recovery` metricset: elastic/beats#8106 * [x] Add xpack structure to `cluster_stats` metricset: https://github.com/elastic/beats/pull/7810 * [x] Add xpack structure to `ccr_stats` metricset: elastic/beats#8336 * [x] Create new `xpack.monitoring.elasticsearch.collection.enabled` setting: https://github.com/elastic/elasticsearch/pull/33474 * [x] Verify parity in documents indexed internally by Elasticsearch (current mechanism) with documents indexed by Metricbeat (new mechanism) * [x] Document how users can switch over from Elasticsearch internal collection to Metricbeat for collecting+shipping metrics for X-Pack Monitoring * [x] Logstash * [x] Enhance `node` metricset for `logstash_state` documents: https://github.com/elastic/beats/pull/11506 * [x] Enhance `node_stats` metricset for `logstash_stats` documents: https://github.com/elastic/beats/pull/11511 * [x] Verify parity in documents indexed internally by Logstash (current mechanism) with documents indexed by Metricbeat (new mechanism): https://github.com/elastic/elastic-stack-testing/pull/250 * [x] Document how users can switch over from Logstash internal collection to Metricbeat for collecting+shipping metrics for X-Pack Monitoring: https://github.com/elastic/logstash/issues/10920 * [x] Beats including APM-Server * [x] Make `GET /` Beats API return instance UUID: https://github.com/elastic/beats/pull/12180 * [x] Add `stats` metricset with xpack structure: https://github.com/elastic/beats/pull/12181 * [x] Add `state` metricset with xpack structure * [x] Verify parity in documents indexed internally by Beats (current mechanism) with documents indexed by Metricbeat (new mechanism): https://github.com/elastic/elastic-stack-testing/pull/249 * [x] Document how users can switch over from Beats internal collection to Metricbeat for collecting+shipping metrics for X-Pack Monitoring: https://github.com/elastic/beats/issues/12647 * [x] Common * [x] Implement date base index naming for index: https://github.com/elastic/beats/pull/7586 * [x] Assure that all metricsets (non-xpack path) report `service.name`
Make it possible to fetch logs from the Elastic Stack with Metricbeat.
This is a meta issue to track the ongoing work.
statsmetricset: [Kibana Module] Add additional metric fields #6746statsmetricset forkibana_statsdocs: Create (X-Pack Monitoring) stats metricset for Kibana module #7525statsmetricset forkibana_settingsdocs: Report kibana_settings to X-Pack Monitoring #7664index_summarymetricset: Elasticsearch index summary metricset #6918shardmetricset: Add basic shard metricset to Elasticsearch #7006ml jobmetricset: Add ml_job metricset to Elasticsearch module #7196index_recoverymetricset: Add basic index recovery metricset #7225cluster_statsmetricset: Adding cluster_stats metricset for elasticsearch module #7638ccr_statsmetricset: Adding elasticsearch/ccr metricset #8335indexmetricset: Adding x-pack code forelasticsearch/indexmetricset #8260index_summarymetricset: Add xpack data structure for Elasticsearch index_summary metricset #7102shardmetricset: Add x-pack data for Elasticsearch shard metricset #7097ml_jobmetricset: Adding xpack code for ES ML job metricset #8129index_recoverymetricset: Adding xpack code for ES index recovery metricset #8106cluster_statsmetricset: Adding xpack code for ES cluster stats metricset #7810ccr_statsmetricset: Adding x-pack monitoring code for elasticsearch/ccr metricset #8336xpack.monitoring.elasticsearch.collection.enabledsetting: Implement xpack.monitoring.elasticsearch.collection.enabled setting elasticsearch#33474nodemetricset forlogstash_statedocuments: Extend logstash.node metricset for logstash_state stack monitoring data #11506node_statsmetricset forlogstash_statsdocuments: Extend logstash.node_stats metricset for logstash_stats stack monitoring data #11511GET /Beats API return instance UUID: Set beat ID in registries after loading meta file #12180statsmetricset with xpack structure: Adding beat module with stats metricset #12181statemetricset with xpack structureservice.name