With the introduction of hidden indices, it looks like they are not included in the monitoring index_stats documents collected by Metricbeat. It looks we need to add expand_wildcards=hidden to this api call.
We should also add an additional field for hidden indices that indicates they are hidden, so the UI can filter it. I'm suggesting this to be index_stats.hidden: <boolean>. The challenge here is the API doesn't return this state, but it's rather available in /*/_settings so I'm not sure the right solution moving forward. Happy to discuss
Related to elastic/elasticsearch#56949
With the introduction of hidden indices, it looks like they are not included in the monitoring
index_statsdocuments collected by Metricbeat. It looks we need to addexpand_wildcards=hiddento this api call.We should also add an additional field for hidden indices that indicates they are hidden, so the UI can filter it. I'm suggesting this to be
index_stats.hidden: <boolean>. The challenge here is the API doesn't return this state, but it's rather available in/*/_settingsso I'm not sure the right solution moving forward. Happy to discussRelated to elastic/elasticsearch#56949