-
Notifications
You must be signed in to change notification settings - Fork 33
test: fix error reporting system test race #275
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
The system tests for error reporting were still not safe to run concurrently. The issue is that at the end we were deleting all events (there is no API to delete events selectively, AFAICT). This meant that concurrent executions of the system tests against the same project could clobber anothers logged errors. This is consistent with the observed timeouts looking for events to show up.
The system tests for error reporting were still not safe to run concurrently. The issue is that at the end we were deleting all events (there is no API to delete events selectively, AFAICT). This meant that concurrent executions of the system tests against the same project could clobber anothers logged errors. This is consistent with the observed timeouts looking for events to show up. Ref: googleapis/nodejs-logging-bunyan#275
|
I still do think that these error reporting system tests have been creating too much busy work and not providing real value. I do not think we have found a single legitimate failure in the past year+. I wouldn't mind if they were to go away. |
Codecov Report
@@ Coverage Diff @@
## master #275 +/- ##
=======================================
Coverage 94.87% 94.87%
=======================================
Files 2 2
Lines 78 78
Branches 8 8
=======================================
Hits 74 74
Misses 4 4Continue to review full report at Codecov.
|
soldair
left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Yeah no reason to delete them.
The system tests for error reporting were still not safe to run concurrently. The issue is that at the end we were deleting all events (there is no API to delete events selectively, AFAICT). This meant that concurrent executions of the system tests against the same project could clobber anothers logged errors. This is consistent with the observed timeouts looking for events to show up. Ref: googleapis/nodejs-logging-bunyan#275
The system tests for error reporting were still not safe to run concurrently. The issue is that at the end we were deleting all events (there is no API to delete events selectively, AFAICT). This meant that concurrent executions of the system tests against the same project could clobber anothers logged errors. This is consistent with the observed timeouts looking for events to show up. Ref: googleapis/nodejs-logging-bunyan#275
The system tests for error reporting were still not safe to run
concurrently. The issue is that at the end we were deleting all events
(there is no API to delete events selectively, AFAICT). This meant that
concurrent executions of the system tests against the same project could
clobber anothers logged errors.
This is consistent with the observed timeouts looking for events to
show up.
Fixes #267