-
Notifications
You must be signed in to change notification settings - Fork 48
test: fix error reporting system test race #279
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
The system tests for error reporting were still not safe to run concurrently. The issue is that at the end we were deleting all events (there is no API to delete events selectively, AFAICT). This meant that concurrent executions of the system tests against the same project could clobber anothers logged errors. This is consistent with the observed timeouts looking for events to show up. Ref: googleapis/nodejs-logging-bunyan#275
Codecov Report
@@ Coverage Diff @@
## master #279 +/- ##
=======================================
Coverage 92.15% 92.15%
=======================================
Files 6 6
Lines 102 102
Branches 18 18
=======================================
Hits 94 94
Misses 4 4
Partials 4 4Continue to review full report at Codecov.
|
Previously we were comparing the list of services using the representative sample. This means that if more than one service have the same error, we may not necessarily get the sample that we want to observe. Instead look for all the affected services for all groups to find the matching group.
|
@soldair note that this has an additional commit here. It was necessary here because we run the error reporting test twice, once for winston2 and once for winston3. This needed even more smarts to deflake. Once this LGTY, I can copy this over to bunyan next. |
Previously we were comparing the list of services using the representative sample. This means that if more than one service have the same error, we may not necessarily get the sample that we want to observe. Instead look for all the affected services for all groups to find the matching group. Ref: googleapis/nodejs-logging-winston#279
Previously we were comparing the list of services using the representative sample. This means that if more than one service have the same error, we may not necessarily get the sample that we want to observe. Instead look for all the affected services for all groups to find the matching group. Ref: googleapis/nodejs-logging-winston#279
Previously we were comparing the list of services using the representative sample. This means that if more than one service have the same error, we may not necessarily get the sample that we want to observe. Instead look for all the affected services for all groups to find the matching group. Ref: googleapis/nodejs-logging-winston#279
The system tests for error reporting were still not safe to run
concurrently. The issue is that at the end we were deleting all events
(there is no API to delete events selectively, AFAICT). This meant that
concurrent executions of the system tests against the same project could
clobber anothers logged errors.
This is consistent with the observed timeouts looking for events to
show up.
Ref: googleapis/nodejs-logging-bunyan#275