Summary

This PR fixes conversation failure rate tracking by ensuring all terminal states are logged in V1 callback processors.

Problem

Previously, the V1 callback processors (GitHub, Slack, GitLab) only logged when conversations reached the finished state:

# Only act when execution has finished
if not (event.key == 'execution_status' and event.value == 'finished'):
    return None

_logger.info('[GitHub V1] Callback agent state was %s', event)

This meant error and stuck terminal states were never logged, making it impossible to track conversation failure rates from Datadog logs.

Solution

Move the logging to happen for ALL execution_status events, while still only requesting summaries when the status is finished:

if event.key != 'execution_status':
    return None

# Log ALL terminal states for monitoring (finished, error, stuck)
_logger.info('[GitHub V1] Callback agent state was %s', event)

# Only request summary when execution has finished successfully
if event.value != 'finished':
    return None

Impact

After this change, Datadog will receive logs for all terminal states:

• [GitHub V1] Callback agent state was ConversationStateUpdate(key=execution_status, value=finished)
• [GitHub V1] Callback agent state was ConversationStateUpdate(key=execution_status, value=error)
• [GitHub V1] Callback agent state was ConversationStateUpdate(key=execution_status, value=stuck)

This enables accurate conversation failure rate monitoring using the formula:

Failure Rate = (ERROR + STUCK) / (ERROR + STUCK + FINISHED) * 100

Files Changed

• enterprise/integrations/github/github_v1_callback_processor.py
• enterprise/integrations/slack/slack_v1_callback_processor.py
• enterprise/integrations/gitlab/gitlab_v1_callback_processor.py

Testing

The change is minimal and preserves existing behavior:

• ✅ All execution_status events are logged (new behavior)
• ✅ Summary requests only happen on finished (unchanged behavior)
• ✅ Non-execution_status events are still ignored (unchanged behavior)

To run this PR locally, use the following command:

GUI with Docker:

docker run -it --rm   -p 3000:3000   -v /var/run/docker.sock:/var/run/docker.sock   --add-host host.docker.internal:host-gateway   -e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.openhands.dev/openhands/runtime:71c337e-nikolaik   --name openhands-app-71c337e   docker.openhands.dev/openhands/openhands:71c337e