Skip to content

sql: re-enable txnidcache by default#77626

Merged
craig[bot] merged 1 commit intocockroachdb:masterfrom
Azhng:txnidcache-enable
Mar 14, 2022
Merged

sql: re-enable txnidcache by default#77626
craig[bot] merged 1 commit intocockroachdb:masterfrom
Azhng:txnidcache-enable

Conversation

@Azhng
Copy link
Copy Markdown
Contributor

@Azhng Azhng commented Mar 10, 2022

Previously, TxnID cache was disabled by default due to performance
issues. This has since been resolved in #77220.
This commit re-enables TxnID Cache by default.

Release justification: low risk high reward change.
Release note: None

@Azhng Azhng requested review from a team and ajwerner March 10, 2022 18:30
@cockroach-teamcity
Copy link
Copy Markdown
Member

This change is Reviewable

@ajwerner
Copy link
Copy Markdown
Contributor

are there any workloads we know to be affected by this?

@Azhng
Copy link
Copy Markdown
Contributor Author

Azhng commented Mar 10, 2022

Other than kv0/kv95, looking at the dashboard, I think all the YCSB workload were affected.

@Azhng
Copy link
Copy Markdown
Contributor Author

Azhng commented Mar 10, 2022

I have been using YCSB-A to do stability testing for the last week (#75110), and I haven't observed any significant performance drops .

I haven't tested other YCSB workloads yet.

Copy link
Copy Markdown
Contributor

@maryliag maryliag left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any other tests we should be doing before enabling this back?

Reviewed 4 of 4 files at r1, all commit messages.
Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @ajwerner)

Copy link
Copy Markdown
Contributor Author

@Azhng Azhng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

In terms of the tests we should run, two workload that have previously shown performance drops with TxnID Cache enabled are kv workload and ycsb workload.

  • Since #77220, we have recovered all of the kv performance drop due to the expensive copies.
  • The nightlies also have been running with the contention event store turned on, and we haven't seen any significant performance impact there on roachperf.
  • The YCSB-A workload that I have been running this week also have shown that, when both TxnID Cache and eventStore are enabled, there aren't any significant evidence of performance issue. (note: this is true even when running with an unstable binary with sub-optimal cluster settings, the YCSB-A throughput is still on-par with the baseline number, see #75110 for details.)

I think at this point, we could benefit a lot more from turning this on and keep this running in the nightly tests, and to learn more about its performance and stability.

Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @ajwerner)

Copy link
Copy Markdown
Contributor

@ajwerner ajwerner left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay, I'm in favor of enabling it and keeping an eye. However, if there are noticeable regressions in the benchmarks, let's file an issue and flip it off rapidly.

Reviewable status: :shipit: complete! 0 of 0 LGTMs obtained (waiting on @Azhng)

Previously, TxnID cache was disabled by default due to performance
issues. This has since been resolved in cockroachdb#77220.
This commit re-enables TxnID Cache by default.

Release justification: low risk high reward change.
Release note: None
@Azhng Azhng force-pushed the txnidcache-enable branch from e5be17a to b1f6722 Compare March 14, 2022 14:16
Copy link
Copy Markdown
Contributor

@maryliag maryliag left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 to Andrew's comment. Let's keep an eye on regressions after this merge
:lgtm:

Reviewable status: :shipit: complete! 1 of 0 LGTMs obtained (waiting on @maryliag)

@Azhng
Copy link
Copy Markdown
Contributor Author

Azhng commented Mar 14, 2022

TFTR!

bors r=maryliag,ajwerner

@craig
Copy link
Copy Markdown
Contributor

craig bot commented Mar 14, 2022

Build succeeded:

@craig craig bot merged commit 51cbdce into cockroachdb:master Mar 14, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants