-
Notifications
You must be signed in to change notification settings - Fork 75
Closed
Labels
P1P1: Must be fixed.P1: Must be fixed.
Description
At the moment we only report if a Testground task is scheduled, processing or completed.
- We should include an exitcode for the task run in the task schema and display it on the dashboard
- When we get a failed run (see definition of fail below), testground should fetch extra information such as:
a) number ofoutcome: okevents / vs total instances per composition group
b) testground should inspect runner env events, for example incluster:k8s-ErrImagePull, orOOM, or instances blocked inPendingstate (which would result in global timeout for the run) and attach them to the task in case of failures.
Definition of exitcode:
- If a task failed to compile, the exitcode should be >0 and task should be marked as failed.
- If a task compiles and its run completes, and all instances are succeeded and all logs include
outcome: okevent, then the run is successful. - For now, every other case, means a run failed.
Note that partial successes are not in scope for this iteration. In the future we might want to split the failed runs into more categories, and include partial success (for example a test plan with 1000 instances, which are mostly independent and 999 manage to succeed with outcome: ok event). This is why it is important to also include extra information as part of runs that are not 100% successful.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
P1P1: Must be fixed.P1: Must be fixed.