We recently have switched to using pytest (or tox) as the test runner, in favor of setup.py test. I don't know if there's a good reason not to use setup.py test integration with pytest. If someone is interested in taking this issue, here is the pytest page on setup.py integration.