Skip to content

Improve bechmarks stability #679

@stloyd

Description

@stloyd

We need to increase the stability & reproducibility of results provided by benchmarks.

To achieve this we need:

  • replace faker usage with predefined "random" data setup,
  • reduce revolutions to lower value in all heavy benchmarks,
  • use aggregate report and have an eye at rstdev a value for giving info that benchmark is not stable enough (0-2% value are acceptable),

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

Done

Milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions