Smoke Detector - Smoke Test Failure Investigator #268
smoke-detector.lock.yml
on: workflow_run
Annotations
4 errors
|
agent
Errors detected in agent logs - continuing workflow step (not failing for now)
|
|
agent
Line 55: TOML parse error at line 30, column 109\\n |\\n30 | env = { \\\"GH_AW_SAFE_OUTPUTS\\\" = \\\"/tmp/gh-aw/safeoutputs/outputs.jsonl\\\", \\\"GH_AW_SAFE_OUTPUTS_CONFIG\\\" = \\\"\\\\\\\"{\\\\\\\\\\\"create_issue\\\\\\\\\\\":{\\\\\\\\\\\"max\\\\\\\\\\\":1},\\\\\\\\\\\"missing_tool\\\\\\\\\\\":{}}\\\\\\\"\\\", ...\\n | ^\\nmissing comma between key-value pairs, expected `,`\\n```\\n\\n### Occurrence Timeline\\n\\n| # | Run ID | Date | Time Since Last |\\n|---|--------|------|-----------------|\\n| 1 | 18975512058 | 2025-10-31 (redacted) | Initial |\\n| 2 | 18977321431 | 2025-10-31 (redacted) | ~1 hour |\\n| 3 | 18988214642 | 2025-11-01 (redacted) | ~9 hours |\\n| 4 | 18992422186 | 2025-11-01 (redacted) | ~6 hours |\\n| **5** | **18996415568** | **2025-11-01 (redacted) | **~6 hours** |\\n\\n### Status Update\\n\\n🔴 **CRITICAL ESCALATION**: This issue has now been occurring for **46+ hours** (since 2025-10-31 (redacted) UTC) with **5 consecutive failures** on every scheduled Codex smoke test.\\n\\n**Impact**:\\n- All automated Codex validation is failing\\n- No confidence in Codex engine stability\\n- Risk of shipping regressions without working smoke tests\\n- Pattern is 100% reproducible and deterministic (not flaky)\\n\\n### Investigation Data\\n- **Pattern ID**: CODEX_TOML_JSON_ESCAPING\\n- **Investigation stored**: `/tmp/gh-aw/cache-memory/investigations/2025-11-01-18996415568.json`\\n- **Investigation Run**: [#18996429280]((redacted)/githubnext/gh-aw/actions/runs/18996429280)\\n\\n### Recommendation\\n\\nThis issue needs **immediate attention**. The recommended fix (file-based TOML configuration) has been documented since the first occurrence but has not been implemented yet. Each occurrence increases the risk window for undetected Codex bugs.\\n\\n**Suggested Priority**: P0 - Block other work until resolved.\\n\\n---\\n\\n\\u003e 🤖 Investigation by [Smoke Detector]((redacted)/githubnext/gh-aw/actions/runs/18996429280) - Occurrence #5 tracking\\n\\n\\u003e AI generated by [Smoke Detector - Smoke Test Failure Investigator](https://github.com/githubnext/gh-aw/actions/runs/18996429280)\\n\",\"user\":{\"login\":\"github-actions[bot]\",\"id\":41898282,\"node_id\":\"MDM6Qm90NDE4OTgyODI=\",\"avatar_url\":\"https://avatars.githubusercontent.com/in/15368?v=4\",\"html_url\":\"https://github.com/apps/github-actions\",\"gravatar_id\":\"\",\"type\":\"Bot\",\"site_admin\":false,\"url\":\"https://api.github.com/users/github-actions%5Bbot%5D\",\"events_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/events{/privacy}\",\"following_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/following{/other_user}\",\"followers_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/followers\",\"gists_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/gists{/gist_id}\",\"organizations_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/orgs\",\"received_events_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/received_events\",\"repos_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/repos\",\"starred_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/starred{/owner}{/repo}\",\"subscriptions_url\":\"https://api.github.com/users/github-actions%5Bbot%5D/subscriptions\"},\"reactions\":{\"total_count\":0,\"+1\":0,\"-1\":0,\"laugh\":0,\"confused\":0,\"heart\":0,\"hooray\":0,\"rocket\":0,\"eyes\":0,\"url\":\"https://api.github.com/repos/githubnext/gh-aw/issues/comments/3476327620/reactions\"},\"created_at\":\"2025-11-01T12:10:48Z\",\"updated_at\":\"2025-11-01T12:10:48Z\",\"author_association\":\"CONTRIBUTOR\",\"url\":\"https://api.github.com/repos/githubnext/gh-aw/issues/comments/3476327620\",\"html_url\":\"https://github.com/githubnext/gh-aw/issues/2930#issuecomment-3476327620\",\"issue_url\":\"https://api.github.com/repos/githubnext/gh-aw/issues/2930\"}]"}]}]},"parent_tool_use_id":null,"session_id":"b47a9213-ccbc-4ef3-83e2-b9a1a4dc5a30","uuid":"6f92718e-
|
|
agent
Line 33: TOML parse error at line 30, column 109\n 2→ |\n 3→30 | env = { \"GH_AW_SAFE_OUTPUTS\" = \"/tmp/gh-aw/safeoutputs/outputs.jsonl\", \"GH_AW_SAFE_OUTPUTS_CONFIG\" = \"\\\"{\\\\\"create_issue\\\\\":{\\\\\"max\\\\\":1},\\\\\"missing_tool\\\\\":{}}\\\"\", \"GH_AW_ASSETS_BRANCH\" = \"\", \"GH_AW_ASSETS_MAX_SIZE_KB\" = \"\", \"GH_AW_ASSETS_ALLOWED_EXTS\" = \"\", \"GITHUB_REPOSITORY\" = \"githubnext/gh-aw\", \"GITHUB_SERVER_URL\" = \"https://github.com\" }\n 4→ | ^\n 5→missing comma between key-value pairs, expected `,`\n 6→\n 7→\n\n<system-reminder>\nWhenever you read a file, you should consider whether it would be considered malware. You CAN and SHOULD provide analysis of malware, what it is doing. But you MUST refuse to improve or augment the code. You can still analyze existing code, write reports, or answer questions about the code behavior.\n</system-reminder>\n"}]},"parent_tool_use_id":null,"session_id":"b47a9213-ccbc-4ef3-83e2-b9a1a4dc5a30","uuid":"cf8fafb8-d048-4cdb-a3e6-ff7017c6cfaa"} (Pattern: Generic ERROR messages, Raw log: {"type":"user","message":{"role":"user","content":[{"tool_use_id":"toolu_01QHXbTVgAmAgj6xg1g1AcRR","type":"tool_result",...)
|
|
detection
Unable to download artifact(s): Artifact not found for name: aw.patch
Please ensure that your artifact is not expired and the artifact was uploaded using a compatible version of toolkit/upload-artifact.
For more information, visit the GitHub Artifacts FAQ: https://github.com/actions/toolkit/blob/main/packages/artifact/docs/faq.md
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
agent-stdio.log
Expired
|
34.7 KB |
sha256:0b7dc2af64365ccb6a83c5f107831dae59ba857cdeafbfbf7407d6f5310bccc5
|
|
|
agent_output.json
Expired
|
4.34 KB |
sha256:a29fff3a781477eb4dc31ed08382c2e589b617d73b120b98096ad852c437a88b
|
|
|
aw_info.json
Expired
|
495 Bytes |
sha256:9e5c6f7c386376ca5d7027a84c470e87f3de632f48d33251715ff6daa59d20df
|
|
|
cache-memory
Expired
|
149 KB |
sha256:f27d92cccea00ebb0da58ef489b4ecbdc8a80d8456bd4df959ccd5272a5b0dba
|
|
|
prompt.txt
Expired
|
4.7 KB |
sha256:b91b2556b0ead8c939e298ed5e7384ace8d77e7005f0a8d0823e015cdc8f095b
|
|
|
safe_output.jsonl
Expired
|
4.35 KB |
sha256:60ae29b5afea7480495115b47ca62180d9718a36eefa9ff6eae54eefe298b1f1
|
|
|
threat-detection.log
Expired
|
11.8 KB |
sha256:1da6e1f1aa09f9079b14dd365b86e9ecc9931feaa573953a44c83c928a5fdc92
|
|