[Lens API] ESQL schema for XY separately for Agent and some small token optimizations by mbondyra · Pull Request #256885 · elastic/kibana

mbondyra · 2026-03-10T11:52:17Z

Summary

Right now we send the entire schema to the agent, which ends up being confusing for it—first, because it includes parts that aren’t actually supported (like reference layers or multilayer charts), and second, because in practice we can only use the ESQL data layer anyway.

So I extracted just the ESQL-relevant part of the schema (which also saves ~8k input tokens on each visualization creation). It’s a small change on your side, and it’s only used by the agent.

Checklist

Check the PR satisfies following conditions.

Reviewers should verify this PR satisfies this list as well.

Any text added follows EUI's writing guidelines, uses sentence case text and includes i18n support
Documentation was added for features that require explanation or tutorials
Unit or functional tests were updated or added to match the most common scenarios
If a plugin configuration key changed, check if it needs to be allowlisted in the cloud and added to the docker list
This was checked for breaking HTTP API changes, and any breaking changes have been approved by the breaking-change committee. The release_note:breaking label should be applied in these situations.
Flaky Test Runner was used on any tests changed
The PR description includes the appropriate Release Notes section, and the correct release_note:* label is applied per the guidelines
Review the backport guidelines and apply applicable backport:* labels.

Identify risks

Does this PR introduce any risks? For example, consider risks like hard to test bugs, performance regression, potential of data loss.

Describe the risk, its severity, and mitigation for each identified risk. Invite stakeholders and evaluate how to proceed before merging.

See some risk examples
...

src/platform/packages/shared/kbn-lens-embeddable-utils/config_builder/schema/charts/xy.ts

…builder/schema/charts/xy.ts Co-authored-by: Marco Vettorello <vettorello.marco@gmail.com>

mbondyra · 2026-03-10T15:25:29Z

...tform/packages/shared/agent-builder/agent-builder-genai-utils/tools/visualization/prompts.ts

 }
 \`\`\`

-${additionalContext}`,


there was an ugly undefined sent to the agent here.

mbondyra · 2026-03-10T15:26:05Z

...tform/packages/shared/agent-builder/agent-builder-genai-utils/tools/visualization/schemas.ts

+const USEFUL_DESCRIPTION_RE =
+  /(\d|default|e\.g\.|i\.e\.|example|must|between|minimum|maximum|at least|at most|up to|pixels|millisecond|factor|typical|legacy|truncat)/i;
+
+const trimSchemaDescriptions = (node: unknown): unknown => {


most of the descriptions are very redundant and we can save around 1.5k tokens just getting rid of them.

...platform/plugins/shared/agent_builder_platform/server/skills/visualization_creation_skill.ts

mbondyra · 2026-03-10T15:29:14Z

src/platform/packages/shared/kbn-lens-embeddable-utils/config_builder/schema/charts/xy.ts

 );

+// TODO: temporary ESQL schema for XY chart to not feed agent with heavy schema for DSL that is not used in agent
+export const xyStateSchemaESQL = schema.object(


Schema before:

Schema after:

elasticmachine · 2026-03-11T09:32:51Z

💛 Build succeeded, but was flaky

Buildkite Build
Commit: c81727f

Failed CI Steps

FTR Configs #124

Test Failures

[job] [logs] FTR Configs #124 / Alerting improving alert severity should correctly set severity_improving and previous_action_group data in alert document

Metrics [docs]

Async chunks

Total size of all lazy-loaded chunks that will be downloaded as the user navigates the app

id	before	after	diff
`lens`	2.0MB	2.0MB	+210.0B

History

…e_fix * commit '565f7545c422192218b803874fbdf93e8d8f08ee': (27 commits) [Lens API] ESQL schema for XY separately for Agent and some small token optimizations (elastic#256885) Fix "Accessing resource attributes before async attributes settled" telemetry error (elastic#256880) [Security Solution][Attacks/Alerts][Attacks page][Table section] Preserver "Sort by" state on Attacks page (elastic#256717) (elastic#256795) [APM] Improve redirect with default date range guard (elastic#256887) [Security Solution][Attacks/Alerts][Attacks page][Table section] Add assignees avatars to the group component (elastic#250126) (elastic#256901) [Docs] add xpack.alerting.rules.maxScheduledPerMinute setting description (elastic#257041) [SO] Fix non-deterministic ordering in nested find API integration tests (elastic#256447) [Write-restricted dashboards] Update user profile retrieval for getShouldAddAccessControl (elastic#255065) [One Workflow] Add Scout API test scaffold and execution tests (elastic#256300) [Fleet] add use_apm if dynamic_signal_types are enabled (elastic#256429) [Fleet] ignore data streams starting with `.` in Fleet API (elastic#256625) [ES|QL] METRICS_INFO support: columns_after & summary (elastic#256758) [Agent Builder] Agent plugins: initial installation support (elastic#256478) [Streams] Add field descriptions and documentation-only field overrides (elastic#255136) [api-docs] 2026-03-11 Daily api_docs build (elastic#257023) [Security Solution] fix alerts page infinite loading state due to data view error (elastic#256983) [Logging] Add `service.*` global fields (elastic#256878) [Canvas] Apply embeddable transforms to embeddable elements (elastic#252191) [table_list_view_table] stabilize jest test (elastic#254991) [Obs AI] get_index_info: add unit tests (elastic#256802) ...

…en optimizations (#256885) ## Summary Right now we send the entire schema to the agent, which ends up being confusing for it—first, because it includes parts that aren’t actually supported (like reference layers or multilayer charts), and second, because in practice we can only use the ESQL data layer anyway. So I extracted just the ESQL-relevant part of the schema (which also saves ~8k input tokens on each visualization creation). It’s a small change on your side, and it’s only used by the agent. ### Checklist Check the PR satisfies following conditions. Reviewers should verify this PR satisfies this list as well. - [ ] Any text added follows [EUI's writing guidelines](https://elastic.github.io/eui/#/guidelines/writing), uses sentence case text and includes [i18n support](https://github.com/elastic/kibana/blob/main/src/platform/packages/shared/kbn-i18n/README.md) - [ ] [Documentation](https://www.elastic.co/guide/en/kibana/master/development-documentation.html) was added for features that require explanation or tutorials - [ ] [Unit or functional tests](https://www.elastic.co/guide/en/kibana/master/development-tests.html) were updated or added to match the most common scenarios - [ ] If a plugin configuration key changed, check if it needs to be allowlisted in the cloud and added to the [docker list](https://github.com/elastic/kibana/blob/main/src/dev/build/tasks/os_packages/docker_generator/resources/base/bin/kibana-docker) - [ ] This was checked for breaking HTTP API changes, and any breaking changes have been approved by the breaking-change committee. The `release_note:breaking` label should be applied in these situations. - [ ] [Flaky Test Runner](https://ci-stats.kibana.dev/trigger_flaky_test_runner/1) was used on any tests changed - [ ] The PR description includes the appropriate Release Notes section, and the correct `release_note:*` label is applied per the [guidelines](https://www.elastic.co/guide/en/kibana/master/contributing.html#kibana-release-notes-process) - [ ] Review the [backport guidelines](https://docs.google.com/document/d/1VyN5k91e5OVumlc0Gb9RPa3h1ewuPE705nRtioPiTvY/edit?usp=sharing) and apply applicable `backport:*` labels. ### Identify risks Does this PR introduce any risks? For example, consider risks like hard to test bugs, performance regression, potential of data loss. Describe the risk, its severity, and mitigation for each identified risk. Invite stakeholders and evaluate how to proceed before merging. - [ ] [See some risk examples](https://github.com/elastic/kibana/blob/main/RISK_MATRIX.mdx) - [ ] ... --------- Co-authored-by: Marco Vettorello <vettorello.marco@gmail.com>

[Lens API] ESQL schema for XY separately

b07ad26

mbondyra marked this pull request as ready for review March 10, 2026 11:56

mbondyra requested review from a team as code owners March 10, 2026 11:56

mbondyra added release_note:skip Skip the PR/issue when compiling release notes backport:skip This PR does not require backporting labels Mar 10, 2026

joemcelroy approved these changes Mar 10, 2026

View reviewed changes

markov00 approved these changes Mar 10, 2026

View reviewed changes

src/platform/packages/shared/kbn-lens-embeddable-utils/config_builder/schema/charts/xy.ts Outdated Show resolved Hide resolved

mbondyra and others added 4 commits March 10, 2026 14:27

Update src/platform/packages/shared/kbn-lens-embeddable-utils/config_…

d601c40

…builder/schema/charts/xy.ts Co-authored-by: Marco Vettorello <vettorello.marco@gmail.com>

Merge branch 'main' into esqlXYSchema

c5591be

get all indices and choose the most appropriate one

e22ca1b

strip redundant descriptions

1d1a296

mbondyra commented Mar 10, 2026

View reviewed changes

...platform/plugins/shared/agent_builder_platform/server/skills/visualization_creation_skill.ts Outdated Show resolved Hide resolved

mbondyra commented Mar 10, 2026

View reviewed changes

mbondyra changed the title ~~[Lens API] ESQL schema for XY separately~~ [Lens API] ESQL schema for XY separately Mar 10, 2026

mbondyra changed the title ~~[Lens API] ESQL schema for XY separately~~ [Lens API] ESQL schema for XY separately for Agent and some small token optimizations Mar 10, 2026

mbondyra and others added 3 commits March 10, 2026 16:53

test

238a712

Update visualization_creation_skill.ts

5190e11

Merge branch 'main' into esqlXYSchema

c81727f

mbondyra merged commit 8ed3d5a into elastic:main Mar 11, 2026
18 checks passed

mbondyra deleted the esqlXYSchema branch March 11, 2026 09:44

kibanamachine added the v9.4.0 label Mar 11, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[Lens API] ESQL schema for XY separately for Agent and some small token optimizations#256885

[Lens API] ESQL schema for XY separately for Agent and some small token optimizations#256885
mbondyra merged 8 commits intoelastic:mainfrom
mbondyra:esqlXYSchema

mbondyra commented Mar 10, 2026 •

edited

Loading

Uh oh!

Uh oh!

mbondyra Mar 10, 2026

Uh oh!

mbondyra Mar 10, 2026

Uh oh!

Uh oh!

mbondyra Mar 10, 2026

Uh oh!

elasticmachine commented Mar 11, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

Conversation

mbondyra commented Mar 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

Checklist

Identify risks

Uh oh!

Uh oh!

mbondyra Mar 10, 2026

Choose a reason for hiding this comment

Uh oh!

mbondyra Mar 10, 2026

Choose a reason for hiding this comment

Uh oh!

Uh oh!

mbondyra Mar 10, 2026

Choose a reason for hiding this comment

Uh oh!

elasticmachine commented Mar 11, 2026

💛 Build succeeded, but was flaky

Failed CI Steps

Test Failures

Metrics [docs]

Async chunks

History

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

mbondyra commented Mar 10, 2026 •

edited

Loading