Improve test failure messages#89967
Conversation
|
Tagging subscribers to 'linkable-framework': @eerhardt, @vitek-karas, @LakshanF, @sbomer, @joperezr, @marek-safar Issue DetailsI've noticed that there are more coding error scenarios where a test will fail and the failure that is hit is the failed to resolve "test.exe" error. I don't fully have my head around which exceptions are being caught and logged but it seems like a lot more than there used to be. Suffice it to say, when the only output from a test failure is about failing to resolve test.exe, that isn't particularly helpful when what actually happened is you had a mistake in your code and an exception was thrown. With the linker now eating more exceptions and returning a non-zero exit code rather than throwing and crashing I think it's worth having the test framework fail with the messages from the linker if the exit code is non-zero. For the tests that expect a non zero exit code, I added
|
|
Tagging subscribers to this area: @agocke, @sbomer, @vitek-karas Issue DetailsI've noticed that there are more coding error scenarios where a test will fail and the failure that is hit is the failed to resolve "test.exe" error. I don't fully have my head around which exceptions are being caught and logged but it seems like a lot more than there used to be. Suffice it to say, when the only output from a test failure is about failing to resolve test.exe, that isn't particularly helpful when what actually happened is you had a mistake in your code and an exception was thrown. With the linker now eating more exceptions and returning a non-zero exit code rather than throwing and crashing I think it's worth having the test framework fail with the messages from the linker if the exit code is non-zero. For the tests that expect a non zero exit code, I added
|
|
Tagging subscribers to 'linkable-framework': @eerhardt, @vitek-karas, @LakshanF, @sbomer, @joperezr, @marek-safar Issue DetailsI've noticed that there are more coding error scenarios where a test will fail and the failure that is hit is the failed to resolve "test.exe" error. I don't fully have my head around which exceptions are being caught and logged but it seems like a lot more than there used to be. Suffice it to say, when the only output from a test failure is about failing to resolve test.exe, that isn't particularly helpful when what actually happened is you had a mistake in your code and an exception was thrown. With the linker now eating more exceptions and returning a non-zero exit code rather than throwing and crashing I think it's worth having the test framework fail with the messages from the linker if the exit code is non-zero. For the tests that expect a non zero exit code, I added
|
0c25bd7 to
20eb69c
Compare
I've noticed that there are more coding error scenarios where a test will fail and the failure that is hit is the failed to resolve "test.exe" error. I don't fully have my head around which exceptions are being caught and logged but it seems like a lot more than there used to be. Suffice it to say, when the only output from a test failure is about failing to resolve test.exe, that isn't particularly helpful when what actually happened is you had a mistake in your code and an exception was thrown. With the linker now eating more exceptions and returning a non-zero exit code rather than throwing and crashing I think it's worth having the test framework fail with the messages from the linker if the exit code is non-zero. For the tests that expect a non zero exit code, I added `ExpectNonZeroExitCodeAttribute`. Currently there is only 1 test that needs this.
20eb69c to
90d4b6f
Compare
I've noticed that there are more coding error scenarios where a test will fail and the failure that is hit is the failed to resolve "test.exe" error. I don't fully have my head around which exceptions are being caught and logged but it seems like a lot more than there used to be.
Suffice it to say, when the only output from a test failure is about failing to resolve test.exe, that isn't particularly helpful when what actually happened is you had a mistake in your code and an exception was thrown.
With the linker now eating more exceptions and returning a non-zero exit code rather than throwing and crashing I think it's worth having the test framework fail with the messages from the linker if the exit code is non-zero.
For the tests that expect a non zero exit code, I added
ExpectNonZeroExitCodeAttribute.