Skip to content

[prototype] sql: add system.span_configurations for kv span configs#66402

Merged
irfansharif merged 1 commit intocockroachdb:multi-tenant-zcfgsfrom
irfansharif:210611.span-configurations-tbl
Jun 23, 2021
Merged

[prototype] sql: add system.span_configurations for kv span configs#66402
irfansharif merged 1 commit intocockroachdb:multi-tenant-zcfgsfrom
irfansharif:210611.span-configurations-tbl

Conversation

@irfansharif
Copy link
Copy Markdown
Contributor

Fixes #66390. It's not wired up to anything yet; we'll later use this
system-tenant only table to store KV span configs.

Release note (sql change): We've added a system.span_configurations
table. This will later be used to store authoritative zone configs that
KV has decided to apply.

@irfansharif irfansharif requested review from a team and adityamaru and removed request for a team and adityamaru June 12, 2021 03:18
@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@irfansharif irfansharif force-pushed the 210611.span-configurations-tbl branch from 4d6d8b4 to 1a9932a Compare June 21, 2021 19:41
@irfansharif irfansharif requested a review from a team as a code owner June 21, 2021 19:41
@irfansharif irfansharif requested review from arulajmani and removed request for a team June 21, 2021 19:41
Fixes cockroachdb#66390. It's not wired up to anything yet; we'll later use this
system-tenant only table to store KV span configs.

Release note (sql change): We've added a `system.span_configurations`
table. This will later be used to store authoritative zone configs that
KV has decided to apply.
@irfansharif irfansharif force-pushed the 210611.span-configurations-tbl branch from 1a9932a to 49eae54 Compare June 22, 2021 01:01
@irfansharif irfansharif requested a review from ajwerner June 22, 2021 20:59
Copy link
Copy Markdown
Collaborator

@arulajmani arulajmani left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

:lgtm:

@ajwerner did you have concerns about merging this to master or do we feel comfortable enough to do so after todays pod meeting?

Reviewed 32 of 32 files at r1.
Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @ajwerner)

@ajwerner
Copy link
Copy Markdown
Contributor

Wait, are we clear on the protocol yet? I feel like there's definitely details we want ironed out. I really don't want to see a table without the code that exercises it.

I'd much much prefer the interfaces for the layers merging first with an in-memory map that can be hooked into an in-memory cluster before the new SQL tables. I have a distinct fear of prototypes which are developed and hooked up to communicate through durable state in SQL tables. We should be hiding that all underneath some storage abstraction for the KV layer.

I'd also love more clarity on what the protobufs are going to look like that live in this table.

@ajwerner
Copy link
Copy Markdown
Contributor

Let me catch up on the RFC. I still think it'd be better to lead off this project by merging interfaces which can be used for testing the reconciliation layer and for testing the server side. What interface will kvserver hold on to? What interface on top of the Connector will the reconciliation job use?

Mostly though, I don't see much value in adding the tables without code to exercise them.

@irfansharif irfansharif changed the base branch from master to multi-tenant-zcfgs June 23, 2021 21:58
@irfansharif
Copy link
Copy Markdown
Contributor Author

irfansharif commented Jun 23, 2021

@ajwerner and I discussed internally around wanting to first spell out the interfaces and then back them up by these concrete implementations that actually write state, vs. coming up with these concrete implementations first and then finding out the abstract interfaces to wrap around them.

I think in the short term Arul and I are likely going to work on a short-lived branch to figure out what these interfaces are and how they should fit with the surrounding code, later we'll start merging the earlier revisions in this branch back to master. So we'll mark these PRs with the [prototype] prefix, have them land against the multi-tenant-zcfgs branch in this repo. It'll give us CI, give us a way to collect all the reviews in one place, etc. Once the interfaces are clearer, we'll send out equivalent PRs to master and just continue working there.

@irfansharif irfansharif changed the title sql: add system.span_configurations for kv span configs [prototype] sql: add system.span_configurations for kv span configs Jun 23, 2021
@irfansharif irfansharif merged commit b973f56 into cockroachdb:multi-tenant-zcfgs Jun 23, 2021
@irfansharif irfansharif deleted the 210611.span-configurations-tbl branch June 23, 2021 22:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

sql: introduce system.span_configurations for KV's span configs

4 participants