Skip to content

Refactor scroll by arguments#7296

Merged
generall merged 2 commits intoslow-requests-log-2from
refactor-scroll-by-arguments
Sep 24, 2025
Merged

Refactor scroll by arguments#7296
generall merged 2 commits intoslow-requests-log-2from
refactor-scroll-by-arguments

Conversation

@generall
Copy link
Member

@generall generall commented Sep 23, 2025

separate internal scroll operation from the one used by user

Previously, we had a single scroll_by function on a shard level, which were used by both: user requests and internal scrolls.

This PR creates one additional entry point for internal scroll requests, and switches all internal functions to it. In this way we can guarantee that:

  • we won't use rate limits for internal requests
  • we can log slow requests for internal/external operations separately

@generall generall requested a review from timvisee September 23, 2025 14:20
Copy link
Member

@timvisee timvisee left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I have to admit that I found it a bit hard to see how the code paths have changed, simply because all these methods have roughly the same name. But I don't see any problems when manually going over each path in the new branch, and am confident it works.

I did not find any limit+1 issues.

@timvisee timvisee changed the title refactor scroll by arguments Refactor scroll by arguments Sep 24, 2025
@generall generall merged commit 9789eff into slow-requests-log-2 Sep 24, 2025
15 checks passed
@generall generall deleted the refactor-scroll-by-arguments branch September 24, 2025 12:55
generall added a commit that referenced this pull request Oct 27, 2025
* separate internal scroll operation from the one used by user

* fmt
generall added a commit that referenced this pull request Oct 27, 2025
…ieve (#7291)

* reorder arguments of scroll_by

* add slow request log for scroll request

* add slow request log for facet request

* add slow request log for count request

* add slow request log for retrieve request

* Remove obsolete clone

* generic implementation of Loggable for Arc

* Refactor scroll by arguments (#7296)

* separate internal scroll operation from the one used by user

* fmt

---------

Co-authored-by: Tim Visée <tim+github@visee.me>
timvisee added a commit that referenced this pull request Nov 14, 2025
…ieve (#7291)

* reorder arguments of scroll_by

* add slow request log for scroll request

* add slow request log for facet request

* add slow request log for count request

* add slow request log for retrieve request

* Remove obsolete clone

* generic implementation of Loggable for Arc

* Refactor scroll by arguments (#7296)

* separate internal scroll operation from the one used by user

* fmt

---------

Co-authored-by: Tim Visée <tim+github@visee.me>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants