Skip to content

REST tests fetching fields with synthetic _source#89888

Merged
elasticsearchmachine merged 2 commits intoelastic:mainfrom
nik9000:synthetic_source_fields_2
Sep 8, 2022
Merged

REST tests fetching fields with synthetic _source#89888
elasticsearchmachine merged 2 commits intoelastic:mainfrom
nik9000:synthetic_source_fields_2

Conversation

@nik9000
Copy link
Copy Markdown
Member

@nik9000 nik9000 commented Sep 7, 2022

This adds some paranoid REST layer tests for fetching field values with synthetic _source. Mostly, everything just works. But there are a few cases that work with regular source and not synthetic. This PR just adds those tests and asserts that those actions fail with a TODO that they should pass. We'll fix them in follow up changes. One by one by one.

The failures are:

  • keyword fields without doc values try to load from the non-existent stored _source.
  • text fields for loaded via the field API try to load from the non-existent stored _source.
  • match_only_text field access in scripts tries to load from the non-existent stored _source. All script access regardless of how.

image

@nik9000 nik9000 added >test Issues or PRs that are addressing/adding tests :StorageEngine/TSDB You know, for Metrics v8.5.0 labels Sep 7, 2022
@nik9000 nik9000 requested a review from jdconrad September 7, 2022 18:28
@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Sep 7, 2022
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-analytics-geo (Team:Analytics)

@nik9000 nik9000 mentioned this pull request Sep 7, 2022
50 tasks
@nik9000 nik9000 requested a review from romseygeek September 7, 2022 18:30
This adds some paranoid REST layer tests for fetching field values with
synthetic _source. Mostly, everything just works. But there are a few
cases that work with regular source and not synthetic. This PR just adds
those tests and asserts that those actions fail with a `TODO` that they
should pass. We'll fix them in follow up changes. One by one by one.

The failures are:
* `keyword` fields without doc values try to load from the non-existent
  stored `_source`.
* `text` fields for loaded via the `field` API try to load from the
  non-existent stored `_source`.
* `match_only_text` field access in scripts tries to load from the
  non-existent stored `_source`. All script access regardless of how.
Copy link
Copy Markdown
Contributor

@jdconrad jdconrad left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good to me. Thank you for the additional scripting coverage of synthetic source.

@nik9000 nik9000 added the auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) label Sep 8, 2022
@elasticsearchmachine elasticsearchmachine merged commit 4c242a7 into elastic:main Sep 8, 2022
@nik9000 nik9000 deleted the synthetic_source_fields_2 branch September 8, 2022 15:24
weizijun added a commit to weizijun/elasticsearch that referenced this pull request Sep 9, 2022
* main: (34 commits)
  Make sure ivy repo directory exists before downloading artifacts
  Use 'file://' scheme for local repository URL
  Use DRA artifacts for release build CI jobs
  Log unsuccessful attempts to get credentials from web identity tokens (elastic#88241)
  Script: Write Field API path manipulation (elastic#89889)
  Fetch health info action (elastic#89820)
  Fix memory leak in TransportDeleteExpiredDataAction (elastic#89935)
  [ML] Performance improvements for categorization jobs (elastic#89824)
  [DOCS] Revert changes for ES_JAVA_OPTS (elastic#89931)
  Fix deadlock bug exposed by a test (elastic#89934)
  [Downsampling] Remove `FieldValueFetcher` validator (elastic#89497)
  Fix segment stats in tsdb (elastic#89754)
  Synthetic _source: support dense_vector (elastic#89840)
  REST tests fetching fields with synthetic _source (elastic#89888)
  Do not deserialize back BytesTransportRequest to clone a request in MockTransportService (elastic#89926)
  Add SDK request logging to debug failures of S3BlobStoreRepositoryTests#testRequestStats (elastic#89912)
  Fix SnapshotStatusApisIT.testGetSnapshotsWithSnapshotInProgress (elastic#89925)
  Document synthetic source for text and keyword (elastic#89893)
  Fix CloneSnapshotIT.testRemoveFailedCloneFromCSWithQueuedSnapshotInProgress (elastic#89914)
  Add missing index.mapping.total_fields.limit setting to the target index (elastic#89875)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

auto-merge-without-approval Automatically merge pull request when CI checks pass (NB doesn't wait for reviews!) :StorageEngine/TSDB You know, for Metrics Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) >test Issues or PRs that are addressing/adding tests v8.5.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants