-
Notifications
You must be signed in to change notification settings - Fork 190
[BUG] Incorrect value of quotted nested fields aggregations in JSON export #2529
Description
What is the bug?
When quoting the field passed to an aggregation and when this field is a nested field, a SQL query with the JSON format return an incorrect value (0 or null) for the aggregation instead of the actual result.
How can one reproduce the bug?
Given an index with documents with a nested (field_nested.c2) and a non-nested field (field_float), using the following two queries to perform some basic aggregations:
SELECT sum(`field_float`) AS `SUM(field_float)`, sum(`field_nested.c2`) AS `SUM(field_nested.c2)` FROM data1 LIMIT 5000;SELECT sum(field_float) AS `SUM(field_float)`, sum(field_nested.c2) AS `SUM(field_nested.c2)` FROM data1 LIMIT 5000;
We expect the same result. But when requesting JSON documents, the first query produce wrong values:
First query result:
{
"took": 1,
"timed_out": false,
"_shards": {
"total": 1,
"successful": 1,
"skipped": 0,
"failed": 0
},
"hits": {
"total": {
"value": 3,
"relation": "eq"
},
"max_score": null,
"hits": []
},
"aggregations": {
"SUM(field_nested.c2)": {
"value": 0
},
"SUM(field_float)": {
"value": 0.6000000163912773
}
}
} Second query result:
{
"took": 1,
"timed_out": false,
"_shards": {
"total": 1,
"successful": 1,
"skipped": 0,
"failed": 0
},
"hits": {
"total": {
"value": 3,
"relation": "eq"
},
"max_score": null,
"hits": []
},
"aggregations": {
"SUM(field_nested.c2)": {
"value": 6
},
"SUM(field_float)": {
"value": 0.6000000163912773
}
}
} Note how aggregations."SUM(field_nested.c2)".value is 0 in the first example and 6 it the second.
What is the expected behavior?
Quoted and non-quoted nested fields in aggregations should return the same (correct) value.
What is your host/environment?
- OS: Debian
- Version 11
- OpenSearch 2.12.0
Do you have any additional context?
- For the bug to happen, the field must be nested and quoted;
- Only the JSON format is affected, the output of other formats has the expected value;
- Some aggregations (e.g.
sumas in the example above) always return0, but other (e.g.avg) always returnnullinstead of the actual value.