-
Notifications
You must be signed in to change notification settings - Fork 8.5k
Expose Elasticsearch javascript client "asStream" option in data services plugin #70675
Copy link
Copy link
Closed as not planned
Closed as not planned
Copy link
Labels
Feature:MapsFeature:SearchQuerying infrastructure in KibanaQuerying infrastructure in KibanaTeam:DataDiscoveryDiscover, search (data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL. t//Discover, search (data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL. t//Team:PresentationPresentation Team for Dashboard, Input Controls, and Canvas t//Presentation Team for Dashboard, Input Controls, and Canvas t//enhancementNew value added to drive a business resultNew value added to drive a business resultimpact:mediumAddressing this issue will have a medium level of impact on the quality/strength of our product.Addressing this issue will have a medium level of impact on the quality/strength of our product.loe:largeLarge Level of EffortLarge Level of Effort
Description
Metadata
Metadata
Assignees
Labels
Feature:MapsFeature:SearchQuerying infrastructure in KibanaQuerying infrastructure in KibanaTeam:DataDiscoveryDiscover, search (data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL. t//Discover, search (data plugin and KQL), data views, saved searches. For ES|QL, use Team:ES|QL. t//Team:PresentationPresentation Team for Dashboard, Input Controls, and Canvas t//Presentation Team for Dashboard, Input Controls, and Canvas t//enhancementNew value added to drive a business resultNew value added to drive a business resultimpact:mediumAddressing this issue will have a medium level of impact on the quality/strength of our product.Addressing this issue will have a medium level of impact on the quality/strength of our product.loe:largeLarge Level of EffortLarge Level of Effort
Type
Fields
Give feedbackNo fields configured for issues without a type.
Kibana applications can often request large payloads from Elasticsearch. For example, Discover can return 500 documents with all fields. The maps application can request up to 10000 documents with geo_shape fields. These responses can be rather large when the requested features contain geo_shape fields with lots of vertices. In these cases, Kibana server memory can be a limitation.
Both Discover and Maps would benefit from having the Kibana server stream the response to the client instead of parsing and holding the entire response in memory on the server.
The elasticsearch javascript client provides an option to stream results,
asStream. It would be greatly beneficial to allow applications to enable this option when requesting data via thedataservices API to alleviate memory pressure on the kibana server.