[Ingest Manager] Send datastreams fields#20402
Conversation
|
Pinging @elastic/ingest-management (Team:Ingest Management) |
blakerouse
left a comment
There was a problem hiding this comment.
Missed some in the monitoring.
| "target": "datastream", | ||
| "fields": map[string]interface{}{ | ||
| "type": "logs", | ||
| "dataset": "elastic.agent", |
There was a problem hiding this comment.
This is wrong, should be fmt.Sprintf("elastic.agent.%s", name)
| }, | ||
| }, | ||
| { | ||
| "add_fields": map[string]interface{}{ |
There was a problem hiding this comment.
You missed adding it to getMonitoringMetricbeatConfig
There was a problem hiding this comment.
thanks, i totally missed that
blakerouse
left a comment
There was a problem hiding this comment.
Thanks for the fixes. Looks good!
|
@michalpristas did not test it locally but remember sometimes the processors for the monitoring data went missing. Just double checking. |
|
@michalpristas Just saw that this PR is against master. Most importantly we will need the change in 7.9. 7.10 will be only datastreams so not a direct backport. Perhaps better to point it to 7.9 directly? |
[Ingest Manager] Send datastreams fields (elastic#20402)
…ne-2.0 * upstream/master: [docs] Promote ingest management to beta (elastic#20295) Upgrade elasticsearch client library used in tests (elastic#20405) Disable logging when pulling on python integration tests (elastic#20397) Remove pillow from testing requirements.txt (elastic#20407) [Filebeat][ATP Module]Setting user agent field required by the API (elastic#20440) [Ingest Manager] Send datastreams fields (elastic#20402) Add event.ingested to all Filebeat modules (elastic#20386) [Elastic Agent] Fix agent control socket path to always be less than 107 characters (elastic#20426) Improve cgroup_regex docs with examples (elastic#20425) Makes `metrics` config option required in app_insights (elastic#20406) Ensure install scripts only install if needed (elastic#20349) Update container name for the azure filesets (elastic#19899) Group same timestamp metrics values in app_insights metricset (elastic#20403) add_process_metadata processor adds container id even if process metadata not accessible (elastic#19767) Support "cluster" scope in Metricbeat elasticsearch module (elastic#18547) [Filebeat][SophosXG Module] Renaming module and fileset (elastic#20396) Update Suricata dashboards (elastic#20394) [Elastic Agent] Improve version, restart, enroll CLI commands (elastic#20359) Prepare home directories for docker images in a different stage (elastic#20356)
…allation * upstream/master: (23 commits) [docs] Promote ingest management to beta (elastic#20295) Upgrade elasticsearch client library used in tests (elastic#20405) Disable logging when pulling on python integration tests (elastic#20397) Remove pillow from testing requirements.txt (elastic#20407) [Filebeat][ATP Module]Setting user agent field required by the API (elastic#20440) [Ingest Manager] Send datastreams fields (elastic#20402) Add event.ingested to all Filebeat modules (elastic#20386) [Elastic Agent] Fix agent control socket path to always be less than 107 characters (elastic#20426) Improve cgroup_regex docs with examples (elastic#20425) Makes `metrics` config option required in app_insights (elastic#20406) Ensure install scripts only install if needed (elastic#20349) Update container name for the azure filesets (elastic#19899) Group same timestamp metrics values in app_insights metricset (elastic#20403) add_process_metadata processor adds container id even if process metadata not accessible (elastic#19767) Support "cluster" scope in Metricbeat elasticsearch module (elastic#18547) [Filebeat][SophosXG Module] Renaming module and fileset (elastic#20396) Update Suricata dashboards (elastic#20394) [Elastic Agent] Improve version, restart, enroll CLI commands (elastic#20359) Prepare home directories for docker images in a different stage (elastic#20356) New multiline mode in Filebeat: while_pattern (elastic#19662) ...
[Ingest Manager] Send datastreams fields (elastic#20402)
What does this PR do?
Adds
datastream.*fields as for request described here elastic/integrations#213 and elastic/elasticsearch#60592Why is it important?
Desciben in an issue here elastic/integrations#213 and elastic/elasticsearch#60592
Checklist
CHANGELOG.next.asciidocorCHANGELOG-developer.next.asciidoc.cc @ruflin