When running hyperfine -m on a command which exits with non-zero exit status (or even with the default -m), it seems like it would be nice to know which run number was reached. Specifically here's an intentionally broken program
⊙ cat fail_after_one_second.py julian@Airm
import sys
from pathlib import Path
from time import time
if time() - Path(__file__).stat().st_mtime > 1:
sys.exit(2)and if I run:
⊙ touch fail_after_one_second.py; hyperfine -m37 'python3 fail_after_one_second.py' julian@Airm
Benchmark 1: python3 fail_after_one_second.py
Error: Command terminated with non-zero exit code: 2. Use the '-i'/'--ignore-failure' option if you want to ignore this. Alternatively, use the '--show-output' option to debug what went wrong.
I don't see any information about what run count it was that failed.
(In particular in my case this is nice as a crude way of knowing just how flaky a flaky command is -- I want to know if it was the first execution that failed, or the 7th, or...)
When running
hyperfine -mon a command which exits with non-zero exit status (or even with the default-m), it seems like it would be nice to know which run number was reached. Specifically here's an intentionally broken programand if I run:
I don't see any information about what run count it was that failed.
(In particular in my case this is nice as a crude way of knowing just how flaky a flaky command is -- I want to know if it was the first execution that failed, or the 7th, or...)