Skip to content

perf: pipeline decompression and compression during compaction #599

@petermattis

Description

@petermattis

When looking at CPU profiles, block decompression during reads, and compressing writes, show up significantly. On the read side, it would be nice for that decompression to take place asynchronously via some sort of read-ahead mechanism. On the write side, it would be nice for the compression to take place asynchronously and not block further compaction work. There is a PR in RocksDB that adds a pipeline for the compression side. We should investigate doing something similar.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions