Skip to content

ESQL: DS: datasource file plugins should not return TEXT types#145334

Merged
bpintea merged 1 commit intoelastic:mainfrom
bpintea:esql/ds/rm_text
Mar 31, 2026
Merged

ESQL: DS: datasource file plugins should not return TEXT types#145334
bpintea merged 1 commit intoelastic:mainfrom
bpintea:esql/ds/rm_text

Conversation

@bpintea
Copy link
Copy Markdown
Contributor

@bpintea bpintea commented Mar 31, 2026

This updates CSV, ORC and Parquet file plugins to no longer return TEXT type, but just KEYWORD.

This change also adds a small consolidation around fixtures: S3 now delegates to existing infra, already used by GCP and Azure.

@bpintea bpintea changed the title ESQL: DS: datasource file types should not return TEXT types ESQL: DS: datasource file plugins should not return TEXT types Mar 31, 2026
@bpintea bpintea marked this pull request as ready for review March 31, 2026 16:07
@elasticsearchmachine elasticsearchmachine added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label Mar 31, 2026
@elasticsearchmachine
Copy link
Copy Markdown
Collaborator

Pinging @elastic/es-analytical-engine (Team:Analytics)

Copy link
Copy Markdown
Contributor

@swallez swallez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Code changes LGTM. Changes to the tests are harder to understand but seem sensible.

@bpintea
Copy link
Copy Markdown
Contributor Author

bpintea commented Mar 31, 2026

Thanks, @swallez!

@bpintea bpintea merged commit bd8579e into elastic:main Mar 31, 2026
35 checks passed
@bpintea bpintea deleted the esql/ds/rm_text branch March 31, 2026 16:45
Copy link
Copy Markdown
Contributor

@quackaplop quackaplop left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh thank you for flagging this! LGTM

szybia added a commit to szybia/elasticsearch that referenced this pull request Mar 31, 2026
…rics

* upstream/main: (21 commits)
  Mute org.elasticsearch.xpack.esql.qa.mixed.MixedClusterEsqlSpecIT test {csv-spec:external-basic.topSnippetsFunction} elastic#145353
  Mute org.elasticsearch.xpack.esql.qa.mixed.MixedClusterEsqlSpecIT test {csv-spec:external-basic.scoreFunction} elastic#145352
  [DiskBBQ] Fix bug in NeighborQueue#popRawAndAddRaw (elastic#145324)
  Fix dense_vector default index options when using BFLOAT16 (elastic#145202)
  Use checked exceptions in entitlement constructor rules (elastic#145234)
  ESQL: DS: datasource file plugins should not return TEXT types (elastic#145334)
  Plumb DLM error store through to DlmFrozenTransition classes (elastic#145243)
  Make Settings.Builder.remove() fluent (elastic#145294)
  Add FLS tests for METRICS_INFO and TS_INFO (elastic#145211)
  Fix flaky SecurityFeatureResetTests (elastic#145063)
  [DOCS] Fix conflict markers in ESQL processing command list (elastic#145338)
  Skip certain metric assertions on Windows (elastic#144933)
  [ES|QL] Add schema reconciliation for multi-file external sources (elastic#145220)
  Simplify DiskBBQ dynamic visit ratio to linear (elastic#142784)
  ESQL: Disallow unmapped_fields=load with partial non-KEYWORD (elastic#144109)
  [Transform] Track Linked Projects (elastic#144399)
  Fix bulk scoring to process last batch instead of falling through to scalar tail (elastic#145316)
  Clean up TickerScheduleEngineTests (elastic#145303)
  [CI] ShardBulkInferenceActionFilterIT testRestart - Ensuring that secrets-inference index is available after full restart and unmuting test (elastic#145317)
  Add CRUD doc to the DistributedArchitectureGuide (elastic#144710)
  ...
ncordon pushed a commit to ncordon/elasticsearch that referenced this pull request Apr 1, 2026
…ic#145334)

This updates CSV, ORC and Parquet file plugins to no longer return TEXT type, but just KEYWORD.

This change also adds a small consolidation around fixtures: S3 now delegates to existing infra, already used by GCP and Azure.
mromaios pushed a commit to mromaios/elasticsearch that referenced this pull request Apr 9, 2026
…ic#145334)

This updates CSV, ORC and Parquet file plugins to no longer return TEXT type, but just KEYWORD.

This change also adds a small consolidation around fixtures: S3 now delegates to existing infra, already used by GCP and Azure.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

:Analytics/ES|QL AKA ESQL ES|QL|DS ES|QL datasources >non-issue Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) v9.4.0

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants