Skip to content

kvconnectorccl: allow secondary tenants to prefetch range lookups#92265

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
ajwerner:ajwerner/prefetch-tenant-range-lookup
Nov 22, 2022
Merged

kvconnectorccl: allow secondary tenants to prefetch range lookups#92265
craig[bot] merged 1 commit intocockroachdb:masterfrom
ajwerner:ajwerner/prefetch-tenant-range-lookup

Conversation

@ajwerner
Copy link
Copy Markdown
Contributor

This patch permits the tenant connector to request more than 0 ranges to be prefetched. In order to enable this, we add logic in the implementation of the RangeLookup RPC to filter any results which are not intended for this tenant.

Fixes #91433

Release note: None

@ajwerner ajwerner requested review from a team as code owners November 21, 2022 16:09
@ajwerner ajwerner requested a review from a team November 21, 2022 16:09
@ajwerner ajwerner requested review from a team as code owners November 21, 2022 16:09
@ajwerner ajwerner requested a review from nvb November 21, 2022 16:09
@ajwerner
Copy link
Copy Markdown
Contributor Author

@nvanbenschoten are you willing to be the victim here?

@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

This patch permits the tenant connector to request more than 0 ranges to be
prefetched. In order to enable this, we add logic in the implementation of the
RangeLookup RPC to filter any results which are not intended for this tenant.

Fixes cockroachdb#91433

Release note: None
@ajwerner ajwerner force-pushed the ajwerner/prefetch-tenant-range-lookup branch from 569d3a0 to 298b016 Compare November 21, 2022 17:16
@ajwerner
Copy link
Copy Markdown
Contributor Author

@knz maybe you'd be interested in reviewing this?

Copy link
Copy Markdown
Contributor

@knz knz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm: this is very good and helps much.

Could we trick this code to paper over #92072 by tweaking the reported EndKey when it's outside of the tenant's keyspace?

cc @ecwall you might find this interesting.

Reviewed 8 of 8 files at r1, all commit messages.
Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @nvanbenschoten)

@ajwerner
Copy link
Copy Markdown
Contributor Author

TFTR!

Could we trick this code to paper over #92072 by tweaking the reported EndKey when it's outside of the tenant's keyspace?

I'll leave that for a later change. I do think it's reasonable.

bors r+

@ajwerner
Copy link
Copy Markdown
Contributor Author

bors r+

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Nov 22, 2022

Build failed (retrying...):

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Nov 22, 2022

Build succeeded:

@craig craig bot merged commit 7ffaece into cockroachdb:master Nov 22, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

kv,server: enable some degree of range descriptor pre-fetching in secondary tenants

3 participants