Skip to content

GH-39667: [C++] Ensure dataset benchmarks present a bytes/s or items/s metric#39766

Merged
pitrou merged 1 commit intoapache:mainfrom
pitrou:gh39667-dataset-benchmarks
Jan 24, 2024
Merged

GH-39667: [C++] Ensure dataset benchmarks present a bytes/s or items/s metric#39766
pitrou merged 1 commit intoapache:mainfrom
pitrou:gh39667-dataset-benchmarks

Conversation

@pitrou
Copy link
Copy Markdown
Member

@pitrou pitrou commented Jan 23, 2024

Rationale for this change

Some of our microbenchmarks only present an iteration time in (nano,micro...)seconds. That is usually tedious to read and difficult to interpret.

What changes are included in this PR?

Ensure that benchmarks present a items/seconds and/or a bytes/seconds metric where that makes sense.

Are these changes tested?

Manually.

Are there any user-facing changes?

No.

@pitrou pitrou requested a review from westonpace as a code owner January 23, 2024 17:27
@github-actions
Copy link
Copy Markdown

⚠️ GitHub issue #39667 has been automatically assigned in GitHub to PR creator.

@pitrou pitrou force-pushed the gh39667-dataset-benchmarks branch from b4db8b4 to 0cbc6f1 Compare January 23, 2024 17:35
Copy link
Copy Markdown
Member

@westonpace westonpace left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good. Fragments / second seems like the right thing to report here.

@github-actions github-actions bot added awaiting merge Awaiting merge and removed awaiting review Awaiting review labels Jan 23, 2024
@pitrou pitrou merged commit df83e50 into apache:main Jan 24, 2024
@pitrou pitrou removed the awaiting merge Awaiting merge label Jan 24, 2024
@pitrou pitrou deleted the gh39667-dataset-benchmarks branch January 24, 2024 10:23
@conbench-apache-arrow
Copy link
Copy Markdown

After merging your PR, Conbench analyzed the 6 benchmarking runs that have been run so far on merge-commit df83e50.

There were no benchmark performance regressions. 🎉

The full Conbench report has more details.

dgreiss pushed a commit to dgreiss/arrow that referenced this pull request Feb 19, 2024
…items/s metric (apache#39766)

### Rationale for this change

Some of our microbenchmarks only present an iteration time in (nano,micro...)seconds. That is usually tedious to read and difficult to interpret.

### What changes are included in this PR?

Ensure that benchmarks present a items/seconds and/or a bytes/seconds metric where that makes sense.

### Are these changes tested?

Manually.

### Are there any user-facing changes?

No.
* Closes: apache#39667

Authored-by: Antoine Pitrou <antoine@python.org>
Signed-off-by: Antoine Pitrou <antoine@python.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[C++] IO, filesystem and dataset benchmarks should present a items/s or bytes/s metric

2 participants