[Do not merge] Run tests in parallel#116
[Do not merge] Run tests in parallel#116neerajprad wants to merge 1 commit intopyro-ppl:devfrom neerajprad:issue_114_parallelize_tests
Conversation
|
|
||
| script: | ||
| - PYTHONPATH=$PWD:$PYTHONPATH pytest -s --cov=pyro | ||
| - PYTHONPATH=$PWD:$PYTHONPATH pytest -s -n auto --cov=pyro |
There was a problem hiding this comment.
How many cores are available on travis? When I've done this in the past there were only a couple cores available, and they were probably just hyperthreads of a single core. An alternate way to parallelize is via a matrix, as we've done in Nimble.
There was a problem hiding this comment.
Yeah, I wanted to check that, and you are right that there are only 2 cores, so this won't be useful. Using a matrix will be a much better solution - that way, we can separate out the slow running integration tests too. Will check out Nimble, and change our config to use matrix. Thanks for the link!
|
Abandoning this PR; we do not seem to get any substantial speed up by using both the cores. We will use the build stages feature to parallelize tests as needed. |
Testing parallel test runs using pytest-xdist.