Skip to content

test: Add test runner option --ignore-self-check-warnings#34392

Closed
maflcko wants to merge 1 commit intobitcoin:masterfrom
maflcko:2601-test-skip-warnings
Closed

test: Add test runner option --ignore-self-check-warnings#34392
maflcko wants to merge 1 commit intobitcoin:masterfrom
maflcko:2601-test-skip-warnings

Conversation

@maflcko
Copy link
Member

@maflcko maflcko commented Jan 23, 2026

This should make it easier to run all listed tests, when a dev has an additional local test, but does not want to add it to the test runner list.

Can be tested via:

$ touch ./test/functional/a.py
$ ./bld-cmake/test/functional/test_runner.py wallet_disable

(It should print an error message and the error message has instructions how to skip it)

@DrahtBot DrahtBot added the Tests label Jan 23, 2026
@DrahtBot
Copy link
Contributor

DrahtBot commented Jan 23, 2026

The following sections might be updated with supplementary metadata relevant to reviewers and maintainers.

Code Coverage & Benchmarks

For details see: https://corecheck.dev/bitcoin/bitcoin/pulls/34392.

Reviews

See the guideline for information on the review process.

Type Reviewers
ACK b-l-u-e

If your review is incorrectly listed, please copy-paste <!--meta-tag:bot-skip--> into the comment that the bot should ignore.

@b-l-u-e
Copy link
Contributor

b-l-u-e commented Jan 25, 2026

ACK facc35a

i tested with --ignore-self-check-warnings

before test exists early

Temporary test directory at /tmp/test_runner_₿_🏃_20260125_092010
WARNING! The following scripts are not being run: ['a.py']. Check the test lists in test_runner.py.

after

./build/test/functional/test_runner.py wallet_disable --ignore-self-check-warnings
Temporary test directory at /tmp/test_runner_₿_🏃_20260125_092409
WARNING! The following scripts are not being run: ['a.py']. Check the test lists in test_runner.py, or use --ignore-self-check-warnings to ignore the error.
Remaining jobs: [wallet_disable.py]
1/1 - wallet_disable.py passed, Duration: 0 s

TEST              | STATUS    | DURATION

wallet_disable.py | ✓ Passed  | 0 s

ALL               | ✓ Passed  | 0 s (accumulated) 
Runtime: 0 s

@maflcko maflcko marked this pull request as draft January 26, 2026 08:35
@maflcko
Copy link
Member Author

maflcko commented Jan 26, 2026

Put into draft for now. I maintain my point (#34279 (comment)) that it should be trivial and beneficial to just add the test to the list. It is a one-line change and a call to git commit. It shouldn't take more than a few seconds and only comes with upsides?

@b-l-u-e
Copy link
Contributor

b-l-u-e commented Jan 26, 2026

Put into draft for now. I maintain my point (#34279 (comment)) that it should be trivial and beneficial to just add the test to the list. It is a one-line change and a call to git commit. It shouldn't take more than a few seconds and only comes with upsides?

i feel like this helps devs who keep temporary local tests in their worktree and still be able to run the full suite withot having to edit test_runner.py or delete their working local files since default fail behavior remains and ci unchanged

@maflcko maflcko marked this pull request as ready for review January 26, 2026 11:34
@maflcko
Copy link
Member Author

maflcko commented Jan 26, 2026

i feel like this helps devs who keep temporary local tests

Fair enough. It helps for temporary tests that are meant to be thrown away soon. However, for any test meant to stay around longer than a month, properly integrating it in the list and into a git commit (and local git history) just seems better to me.

@sedited
Copy link
Contributor

sedited commented Jan 28, 2026

However, for any test meant to stay around longer than a month, properly integrating it in the list and into a git commit (and local git history) just seems better to me.

I'm also not sure why the functional tests should get a different treatment than say a unit test that needs to be integrated. Also seems easy enough to add the test to the runner on the fly with a simple out of tree patch.

@maflcko
Copy link
Member Author

maflcko commented Jan 28, 2026

Ok, closing for now. I don't care about this in any way, so I think whoever is bothered by this should open the pull request with the commit.

@maflcko maflcko closed this Jan 28, 2026
@maflcko maflcko deleted the 2601-test-skip-warnings branch January 28, 2026 12:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants