[Inference] Run EIS locally by dgieselaar · Pull Request #215475 · elastic/kibana

dgieselaar · 2025-03-21T11:54:37Z

Make sure you're connected to Infra Vault using oidc:
$ VAULT_ADDR={...} vault login -method oidc
Run the eis script:
$ node scripts/eis.js

2a. After it's started, run ES with:
$ yarn es snapshot --license trial -E xpack.inference.elastic.url=http://localhost:8443
2b. The command will output credentials for a preconfigured EIS connector. Paste it into kibana(.dev).yml.

Start Kibana as usual.
Run:
yarn run ts-node --transpile-only x-pack/solutions/observability/packages/kbn-genai-cli/recipes/hello_world.ts

This should output:

 ~/dev/kibana  eis-connector-cli *219  yarn run ts-node --transpile-only x-pack/solutions/observability/packages/kbn-genai-cli/recipes/hello_world.ts
yarn run v1.22.22
$ /Users/dariogieselaar/dev/kibana/node_modules/.bin/ts-node --transpile-only x-pack/solutions/observability/packages/kbn-genai-cli/recipes/hello_world.ts 
 info Discovered kibana running at: http://elastic:changeme@127.0.0.1:5601/kbn
 info {
        id: 'extract_personal_details',
        content: '',
        output: { name: 'Sarah', age: 29, city: 'San Francisco' }
      }
✨  Done in 5.47s.

… eis-connector-cli

jedrazb · 2025-04-09T13:04:08Z

Hey especially running gateway in docker I found that host.docker.internal is more robust than localhost

That's the magic command to start ES for me (I see you are handling certs here so no need to disable it?)

yarn es serverless --projectType es -E xpack.inference.elastic.url=https://host.docker.internal:8443

dgieselaar · 2025-04-17T05:56:22Z

@jedrazb I'm creating certs, but I couldn't get it to work E2E (iirc, it works with curl, but Java has some additional stuff that makes it hard to configure). This is why I have nginx in front. We run ES locally, so host.docker.internal doesn't make sense here I think (maybe Serverless starts a Docker container though?)

viduni94

Tested. Works well for me.
Thanks @dgieselaar

dgieselaar · 2025-04-22T18:42:12Z

@elasticmachine merge upstream

elasticmachine · 2025-04-22T19:42:12Z

💚 Build Succeeded

Buildkite Build
Commit: 19fc661
Kibana Serverless Image: docker.elastic.co/kibana-ci/kibana-serverless:pr-215475-19fc66179a15

Metrics [docs]

Public APIs missing comments

Total count of every public API that lacks a comment. Target amount is 0. Run node scripts/build_api_docs --plugin [yourplugin] --stats comments for more detailed information.

id	before	after	diff
`@kbn/inference-cli`	13	15	+2
`@kbn/inference-langchain`	49	48	-1
`@kbn/kibana-api-cli`	19	21	+2
total			+3

Unknown metric groups

API count

id	before	after	diff
`@kbn/inference-cli`	13	15	+2
`@kbn/inference-langchain`	50	49	-1
`@kbn/kibana-api-cli`	19	21	+2
total			+3

ESLint disabled in files

id	before	after	diff
`@kbn/inference-cli`	0	1	+1

Total ESLint disabled count

id	before	after	diff
`@kbn/inference-cli`	0	1	+1

History

💔 Build #294968 failed cd812f7
💚 Build #294777 succeeded 7c3e0de
💔 Build #294523 failed 2299490
💔 Build #288391 failed aac878d
💔 Build #288322 failed a696af4

kibanamachine · 2025-04-23T06:08:59Z

Starting backport for target branches: 8.19

https://github.com/elastic/kibana/actions/runs/14611185317

kibanamachine · 2025-04-23T06:15:33Z

💔 All backports failed

Status	Branch	Result
❌	8.19	Backport failed because of merge conflicts

Manual backport

To create the backport manually run:

node scripts/backport --pr 215475

Questions ?

Please refer to the Backport tool documentation

dgieselaar · 2025-04-23T06:52:55Z

💚 All backports created successfully

Status	Branch	Result
✅	8.19

Note: Successful backport PRs will be merged automatically after passing CI.

Questions ?

Please refer to the Backport tool documentation

1. Make sure you're connected to [Infra Vault](https://docs.elastic.dev/vault/infra-vault/home) using oidc: `$ VAULT_ADDR={...} vault login -method oidc` 2. Run the `eis` script: `$ node scripts/eis.js` 2a. After it's started, run ES with: `$ yarn es snapshot --license trial -E xpack.inference.elastic.url=http://localhost:8443` 2b. The command will output credentials for a preconfigured EIS connector. Paste it into kibana(.dev).yml. 3. Start Kibana as usual. 4. Run: `yarn run ts-node --transpile-only x-pack/solutions/observability/packages/kbn-genai-cli/recipes/hello_world.ts` This should output: ```  ~/dev/kibana  eis-connector-cli *219  yarn run ts-node --transpile-only x-pack/solutions/observability/packages/kbn-genai-cli/recipes/hello_world.ts yarn run v1.22.22 $ /Users/dariogieselaar/dev/kibana/node_modules/.bin/ts-node --transpile-only x-pack/solutions/observability/packages/kbn-genai-cli/recipes/hello_world.ts info Discovered kibana running at: http://elastic:changeme@127.0.0.1:5601/kbn info { id: 'extract_personal_details', content: '', output: { name: 'Sarah', age: 29, city: 'San Francisco' } } ✨ Done in 5.47s. ``` --------- Co-authored-by: kibanamachine <42973632+kibanamachine@users.noreply.github.com> Co-authored-by: Dima Arnautov <arnautov.dima@gmail.com> Co-authored-by: Elastic Machine <elasticmachine@users.noreply.github.com> (cherry picked from commit dd7ed50) # Conflicts: # x-pack/platform/plugins/shared/observability_ai_assistant/common/convert_messages_for_inference.ts

kibanamachine · 2025-04-25T06:48:42Z