Skip to content

Format doc_value fields#22354

Closed
jpountz wants to merge 7 commits intoelastic:5.xfrom
jpountz:fix/format_doc_values_fields_backport
Closed

Format doc_value fields#22354
jpountz wants to merge 7 commits intoelastic:5.xfrom
jpountz:fix/format_doc_values_fields_backport

Conversation

@jpountz
Copy link
Copy Markdown
Contributor

@jpountz jpountz commented Dec 27, 2016

Backport of #22146

Note to reviewers: the diff between this change and #22146 is contained in the 2nd commit.

@jpountz jpountz changed the title Fix/format doc values fields backport Format doc_value fields Dec 27, 2016
@jimczi
Copy link
Copy Markdown
Contributor

jimczi commented Dec 30, 2016

LGTM
You can maybe add a small note in the docs regarding the new use_field_mapping option ?

Copy link
Copy Markdown
Member

@nik9000 nik9000 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Same comment and Jim. It looks like you'd documented use_field_mapping in the breaking changes doc which didn't survive the backport proposal.

@jpountz jpountz force-pushed the fix/format_doc_values_fields_backport branch from 4e9b1ab to c20df6a Compare January 31, 2017 17:08
jpountz added 5 commits April 21, 2017 09:34
Currently `docvalues_fields` return the values of the fields as they are stored
in doc values. I don't like that it exposes implementation details, but there
are also user-facing issues like the fact it cannot work with binary fields.
This change will also make it easier for users to reindex if they do not store
the source, since `docvalues_fields` will return data is such a format that it
can be put in an indexing request with the same mappings.

The hard part of the change is backward compatibility, since it is breaking.
The approach taken here is that 5.x will keep exposing the internal
representation, with a special format name called `use_field_format` which
will format the field depending on how it is mapped. This will become the
default in 6.0, and this hardcoded format name will be removed in 7.0 to ease
the transition from 5.x to 6.x.
@jpountz jpountz force-pushed the fix/format_doc_values_fields_backport branch from c20df6a to 43c14e2 Compare April 21, 2017 08:18
@martijnvg martijnvg closed this Aug 2, 2017
@javanna
Copy link
Copy Markdown
Contributor

javanna commented Aug 3, 2017

what happened to this PR? seems like it stayed opened for months despite it had LGTMs, and then it was closed without further commenting.

@javanna
Copy link
Copy Markdown
Contributor

javanna commented Aug 3, 2017

I think it got closed because it was opened against 5.x, which was deleted.

@jpountz
Copy link
Copy Markdown
Contributor Author

jpountz commented Aug 3, 2017

Right. This PR requires sync with the Kibana team since it is going to be a breaking change for them and I never took the time to do it. I'll try to do it during the 6.x series.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants