Skip to content

[Backport 2.8] Support for pagination in v2 engine of SELECT * FROM <table> queries#1685

Merged
Yury-Fridlyand merged 2 commits into2.8from
backport/backport-1666-to-2.8
May 30, 2023
Merged

[Backport 2.8] Support for pagination in v2 engine of SELECT * FROM <table> queries#1685
Yury-Fridlyand merged 2 commits into2.8from
backport/backport-1666-to-2.8

Conversation

@opensearch-trigger-bot
Copy link
Copy Markdown
Contributor

Backport 57ce303 from #1666

#1666)

v2 SQL engine can now paginate simple queries. Pagination is initiated by setting fetch_size property in the request JSON.

Pagination is implemented using the OpenSearch Scroll API. Please see pagination-v2.md for implementation details.
---------

Signed-off-by: MaxKsyunz <maxk@bitquilltech.com>
Signed-off-by: Yury-Fridlyand <yury.fridlyand@improving.com>
Signed-off-by: Max Ksyunz <maxk@bitquilltech.com>
Co-authored-by: Yury-Fridlyand <yury.fridlyand@improving.com>
Co-authored-by: GabeFernandez310 <Gabriel.Fernandez@improving.com>
Co-authored-by: Andrew Carbonetto <andrewc@bitquilltech.com>
(cherry picked from commit 57ce303)
@codecov
Copy link
Copy Markdown

codecov bot commented May 30, 2023

Codecov Report

Merging #1685 (43f7ef4) into 2.8 (5d0cb13) will increase coverage by 0.06%.
The diff coverage is 100.00%.

@@             Coverage Diff              @@
##                2.8    #1685      +/-   ##
============================================
+ Coverage     97.21%   97.28%   +0.06%     
- Complexity     4223     4332     +109     
============================================
  Files           374      388      +14     
  Lines         10570    10809     +239     
  Branches        739      761      +22     
============================================
+ Hits          10276    10515     +239     
  Misses          287      287              
  Partials          7        7              
Flag Coverage Δ
sql-engine 97.28% <100.00%> (+0.06%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
...ch/sql/planner/optimizer/LogicalPlanOptimizer.java 100.00% <ø> (ø)
...pensearch/sql/planner/physical/FilterOperator.java 100.00% <ø> (ø)
...pensearch/sql/planner/physical/NestedOperator.java 100.00% <ø> (ø)
...java/org/opensearch/sql/storage/StorageEngine.java 100.00% <ø> (ø)
...rc/main/java/org/opensearch/sql/storage/Table.java 100.00% <ø> (ø)
...ch/sql/opensearch/client/OpenSearchRestClient.java 100.00% <ø> (ø)
...ch/sql/opensearch/response/OpenSearchResponse.java 100.00% <ø> (ø)
...rch/sql/opensearch/setting/OpenSearchSettings.java 100.00% <ø> (ø)
...ql/opensearch/storage/OpenSearchStorageEngine.java 100.00% <ø> (ø)
...ge/script/aggregation/AggregationQueryBuilder.java 100.00% <ø> (ø)
... and 47 more

Somehow the import is required in 2.x but not 3.0

Signed-off-by: MaxKsyunz <maxk@bitquilltech.com>
@Yury-Fridlyand Yury-Fridlyand merged commit 8ea39ef into 2.8 May 30, 2023
@github-actions github-actions bot deleted the backport/backport-1666-to-2.8 branch May 30, 2023 22:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants