New field mapping flag - allow_multiple_values#80289
New field mapping flag - allow_multiple_values#80289markharwood wants to merge 6 commits intoelastic:masterfrom
Conversation
a625553 to
9f94ff6
Compare
7860ea2 to
b92ba2f
Compare
7684af6 to
0c17862
Compare
ee523c3 to
2b4de3a
Compare
|
@markharwood will the feature to be merged soon? |
We're gathering interest in this change. While there are advantages to this feature there have been some reservations which are:
Can you say anything about your interest in this feature? |
2b4de3a to
102709d
Compare
|
Pinging @elastic/es-search (Team:Search) |
1 similar comment
|
Pinging @elastic/es-search (Team:Search) |
about this PR: #80685, I also add a single value parameter, when your PR merged, I will change my logic. It can resolve |
102709d to
2085e6f
Compare
When false documents that presents arrays instead of single values are rejected.
…or fields geo point/shape, histogram, dense_vector text and join. At some point some of these fields may later offer user control over `allow_multiple_values` but is complicated in that some of them take arrays for the single value eg. a point or vector. What we’d have to control is that arrays are accepted bu arrays of arrays are not. That’s more than enough complexity for one PR so for now we reject the allow_multiple_values setting.
|
This PR was never completed, closing. |
|
My 2 cents, we use elasticsearch as data store with Apache Spark as data engine (with Kafka / S3 parquet files). This work like a charm, but we miss a real data integrity with elasticsearch, anyone can add a bad document with an array instead of a concrete string, the document will be accepted but will break all our data pipeline (also there is no way to find the bad document ....). I think "validation" is a good thing, we can put data on elasticsearch with so many ways:
It's always a good thing to have guarantee about what the data is. Also, there is a big gap between validation about what the data is (concrete or array), and enum. As reference: https://discuss.elastic.co/t/mapping-how-to-disable-array-of-string/315782 |
When set to false documents that present arrays instead of single values are rejected at ingest time.
TODO - docs
Closes #58523