Skip to content

Command line option to skip benchmarks #2392

@nandanvasudevan

Description

@nandanvasudevan

Description
Enable or disable benchmarks with a command line option

Additional context
I don't always want to run benchmarks. In the current situation using any ifdefs or #defines, triggers a complete re-compilation which is really time-consuming and something I really want to avoid.
It would be really helpful if there was a command line option to disable benchmarks.

Possibilities with existing

Lets look at what the current options to achieve this are.

Using Tags

Right now, one plausible way is to keep benchmarks in a separate TEST_CASE with a tag that reads 'Benchmark' and then disallow running of that tag which is supported.
However, this will almost always lead to code duplication since the setup code will need to be repeated just for the benchmark.

Using Sections

By keeping a benchmark as a section in TEST_CASE and then running only these sections seems possible.
However, there is option to specify, run all except this section.
This wouldn't work.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions