Skip to content

do not time out database init requests#3503

Merged
davepacheco merged 1 commit into
mainfrom
dap/init-timeout
Jul 6, 2023
Merged

do not time out database init requests#3503
davepacheco merged 1 commit into
mainfrom
dap/init-timeout

Conversation

@davepacheco

@davepacheco davepacheco commented Jul 5, 2023

Copy link
Copy Markdown
Collaborator

Per Clulow's Lament. See #3498 for details. I also updated the logging as mentioned there.

Fixes #3498.

@davepacheco davepacheco requested a review from smklein July 5, 2023 23:15
@davepacheco davepacheco marked this pull request as ready for review July 5, 2023 23:15

@smklein smklein left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm definitely okay to land this PR as-is, but out of curiosity: Is it expected that setting up CRDB should take so long?

I mean, I've definitely noticed the DB initialization taking a while -- it's what led me to making that "seed DB" optimization like a year ago -- but I dunno, might be worth a peek at some point to make sure CRDB is actually doing useful work during this time, rather than being bottlenecked by something silly.

@davepacheco davepacheco enabled auto-merge (squash) July 5, 2023 23:26
@davepacheco

Copy link
Copy Markdown
Collaborator Author

@internet-diglett's machine is relatively slow -- quad-core with spinning disks -- but I don't think that explains all of it. There may well be other room for improvement. I imagine part of the problem is that each SQL statement (i.e., creation of each table and index, of which I think there are now a couple dozen) happen serially, and each probably involves a Raft round-trip plus fsync to stable storage on multiple nodes. 70s still seems like a long time for this though.

@davepacheco

Copy link
Copy Markdown
Collaborator Author

Testing note: @internet-diglett and @jordanhendricks were both able to set up Omicron by removing the timeout(dur) line.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

RSS stuck after cockroachdb init took too long

2 participants