-
-
Notifications
You must be signed in to change notification settings - Fork 4.9k
Closed
Labels
enhancementNew features or improvements of some kind, as opposed to a problem (bug)New features or improvements of some kind, as opposed to a problem (bug)frozen-due-to-ageIssues closed and untouched for a long time, together with being locked for discussionIssues closed and untouched for a long time, together with being locked for discussion
Milestone
Description
Currently we spawn a goroutine to pull a block, and that goroutine does the file write when it's done. The number of goroutines is limited by the puller max pending kib setting, but this can still be hundreds of goroutines if the requested blocks are small. This can result in hundreds of concurrent disk writes, in turn spawning hundreds of I/O bound threads.
We should have a couple of goroutines responsible for the writes to handle this separately from the pullers.
mohe2015 and drawkula
Metadata
Metadata
Assignees
Labels
enhancementNew features or improvements of some kind, as opposed to a problem (bug)New features or improvements of some kind, as opposed to a problem (bug)frozen-due-to-ageIssues closed and untouched for a long time, together with being locked for discussionIssues closed and untouched for a long time, together with being locked for discussion