Description
Enable or disable benchmarks with a command line option
Additional context
I don't always want to run benchmarks. In the current situation using any ifdefs or #defines, triggers a complete re-compilation which is really time-consuming and something I really want to avoid.
It would be really helpful if there was a command line option to disable benchmarks.
Possibilities with existing
Lets look at what the current options to achieve this are.
Using Tags
Right now, one plausible way is to keep benchmarks in a separate TEST_CASE with a tag that reads 'Benchmark' and then disallow running of that tag which is supported.
However, this will almost always lead to code duplication since the setup code will need to be repeated just for the benchmark.
Using Sections
By keeping a benchmark as a section in TEST_CASE and then running only these sections seems possible.
However, there is option to specify, run all except this section.
This wouldn't work.
Description
Enable or disable benchmarks with a command line option
Additional context
I don't always want to run benchmarks. In the current situation using any
ifdefs or#defines, triggers a complete re-compilation which is really time-consuming and something I really want to avoid.It would be really helpful if there was a command line option to disable benchmarks.
Possibilities with existing
Lets look at what the current options to achieve this are.
Using Tags
Right now, one plausible way is to keep benchmarks in a separate
TEST_CASEwith a tag that reads 'Benchmark' and then disallow running of that tag which is supported.However, this will almost always lead to code duplication since the setup code will need to be repeated just for the benchmark.
Using Sections
By keeping a benchmark as a section in
TEST_CASEand then running only these sections seems possible.However, there is option to specify, run all except this section.
This wouldn't work.