Skip to content

Conflicts in Azure Fleet Integrations #1594

@phil-51

Description

@phil-51

Hi

I think there is an issue with the current Azure logs integration for Fleet (Azure logs integration v0.8.5). I am working with this to try and pull in various logs from Azure and have noticed field conflicts in my logs-* index pattern. These are all Elastic generated indicies.

Steps taken to investigate so far:

The index patterns page tells me that there are 2 conflicts; client.ip and error.message.

Using dev tools, I ran
GET /logs-*/_mapping/field/client.ip

This returned lots but picking out 2 key bits here, note that 2 indicies, both Azure default ones have client.ip field listed and one shows type IP and the other shows type keyword. It seems that the following have client.ip set to keyword:

platformlogs
auditlogs
But the following are correct and have it set as type IP:

signinlogs
activitylogs

".ds-logs-azure.platformlogs-default-2021.09.02-000001" : {
"mappings" : {
"client.ip" : {
"full_name" : "client.ip",
"mapping" : {
"ip" : {
"type" : "keyword",
"ignore_above" : 1024
}
}
}
}
},
".ds-logs-elastic_agent.filebeat-default-2021.06.15-000008" : {
"mappings" : { }
},
".ds-logs-elastic_agent.metricbeat-default-2021.08.30-000009" : {
"mappings" : { }
},
".ds-logs-azure.activitylogs-default-2021.09.02-000001" : {
"mappings" : {
"client.ip" : {
"full_name" : "client.ip",
"mapping" : {
"ip" : {
"type" : "ip"
}

There are also conflicts on the error.message field which sometimes shows as type text and other times keyword. I can get more details on this if needed but just wanted to start by verifying if I am correct and this is a bug

This was originally raised on the discuss forums https://discuss.elastic.co/t/conflicts-in-azure-fleet-integrations/283236

Metadata

Metadata

Assignees

No one assigned

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions