Disagg: Reduce the number of threads created for handling disaggregated requests (#9335)#9685
Conversation
Signed-off-by: ti-chi-bot <ti-community-prow-bot@tidb.io>
|
[APPROVALNOTIFIER] This PR is NOT APPROVED This pull-request has been approved by: The full list of commands accepted by this bot can be found here. DetailsNeeds approval from an approver in each of these files:Approvers can indicate their approval by writing |
|
@ti-chi-bot: The following tests failed, say
Full PR test history. Your PR dashboard. DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here. |
|
This cherry pick PR is for a release branch and has not yet been approved by triage owners. To merge this cherry pick:
DetailsInstructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes-sigs/prow repository. |
This is an automated cherry-pick of #9335
What problem does this PR solve?
Issue Number: close #9334
Problem Summary:
In StorageDisaggregated, the call chain
buildReadTaskForWriteNode => buildReadTaskForWriteNodeTable => buildRNReadSegmentTaskwill create aDynamicThreadManagerin each functions.The total number of threads used in
StorageDisaggregatedis aboutrequest_count * batch_cop_tasks.size() * resp.tables().size() * table.segments().size().What is changed and how it works?
If the number of tasks is greater than the number of threads,
DynamicThreadManagerwill create new threads to handle these tasks, whileIOThreadPoolwill make these tasks queue up.Check List
Tests
Side effects
Documentation
Release note