Discover currently loads a maximum of documents defined by discover:sampleSize in Advanced settings. There's no way to go beyond this number unless changing this setting. The data table used by Discover, EuiDataGrid, also doesn't provide ways to allow the incremental loading of data. There's no quick way to change this limitation, but what could be done is to use the UI that's currently telling users, that they have reached the limit, to provide a link allowing them to load more. So behind the scenes, we could use search_after of ES search (https://www.elastic.co/guide/en/elasticsearch/reference/current/paginate-search-results.html#search-after) to append more documents to the current search result. So basically it could look like this:
Before:
After:
The drawback of this approach: All documents, in this case, would be kept in the Browsers Memory, with adding more and more documents, the browser / host system might become unresponsive.
Discover currently loads a maximum of documents defined by
discover:sampleSizein Advanced settings. There's no way to go beyond this number unless changing this setting. The data table used by Discover, EuiDataGrid, also doesn't provide ways to allow the incremental loading of data. There's no quick way to change this limitation, but what could be done is to use the UI that's currently telling users, that they have reached the limit, to provide a link allowing them to load more. So behind the scenes, we could usesearch_afterof ES search (https://www.elastic.co/guide/en/elasticsearch/reference/current/paginate-search-results.html#search-after) to append more documents to the current search result. So basically it could look like this:Before:
After:
The drawback of this approach: All documents, in this case, would be kept in the Browsers Memory, with adding more and more documents, the browser / host system might become unresponsive.