Skip to content

Commit 652712e

Browse files
committed
ci(qa): publish soak parity artifacts
1 parent 9f2c0a8 commit 652712e

2 files changed

Lines changed: 30 additions & 0 deletions

File tree

.github/workflows/openclaw-release-checks.yml

Lines changed: 29 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -945,6 +945,20 @@ jobs:
945945
--runtime-pair pi,codex \
946946
--output-dir ".artifacts/qa-e2e/runtime-parity-standard"
947947
948+
- name: Run soak runtime parity tier
949+
id: runtime_parity_soak_lane
950+
if: ${{ always() && needs.resolve_target.outputs.run_release_soak == 'true' && steps.runtime_parity_lane.outcome != 'skipped' && steps.runtime_parity_lane.outcome != 'cancelled' }}
951+
run: |
952+
set -euo pipefail
953+
pnpm openclaw qa suite \
954+
--provider-mode mock-openai \
955+
--runtime-parity-tier soak \
956+
--concurrency "${QA_PARITY_CONCURRENCY}" \
957+
--model "${OPENCLAW_CI_OPENAI_MODEL}" \
958+
--alt-model "openai/gpt-5.5-alt" \
959+
--runtime-pair pi,codex \
960+
--output-dir ".artifacts/qa-e2e/runtime-parity-soak"
961+
948962
- name: Generate runtime parity report
949963
if: always()
950964
run: |
@@ -965,6 +979,21 @@ jobs:
965979
--summary .artifacts/qa-e2e/runtime-parity-standard/qa-suite-summary.json \
966980
--output-dir .artifacts/qa-e2e/runtime-parity-standard-report
967981
982+
- name: Generate soak runtime parity report
983+
if: ${{ always() && needs.resolve_target.outputs.run_release_soak == 'true' && steps.runtime_parity_soak_lane.outcome != 'skipped' && steps.runtime_parity_soak_lane.outcome != 'cancelled' }}
984+
run: |
985+
set -euo pipefail
986+
summary=".artifacts/qa-e2e/runtime-parity-soak/qa-suite-summary.json"
987+
if [[ ! -f "$summary" ]]; then
988+
echo "No soak runtime parity summary was produced."
989+
exit 0
990+
fi
991+
pnpm openclaw qa parity-report \
992+
--repo-root . \
993+
--runtime-axis \
994+
--summary "$summary" \
995+
--output-dir .artifacts/qa-e2e/runtime-parity-soak-report
996+
968997
- name: Upload runtime parity artifacts
969998
if: always()
970999
uses: actions/upload-artifact@v7

CHANGELOG.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,7 @@ Docs: https://docs.openclaw.ai
1010
- Dependencies: refresh provider, plugin, UI, and tooling packages, update `protobufjs` to 8.4.0 to clear the current npm advisory, and carry the Claude ACP completion patch forward to `@agentclientprotocol/claude-agent-acp` 0.36.1.
1111
- Agents/tools: remove the old sender-owner tool gating path so configured tools stay visible for trusted sessions while command and channel-action auth still carry real sender identity.
1212
- QA-Lab: add curated mock JSONL replay fixtures and first-drift reporting for runtime-parity audits. (#80323, refs #80176) Thanks @100yenadmin.
13+
- QA-Lab: include the optional 100-turn runtime parity soak in release-soak artifacts so long-run Codex/Pi transcript drift stays visible outside the default gate. (#80395) Thanks @100yenadmin.
1314
- QA-Lab: add a personal-agent failure recovery scenario that checks honest partial status, retry boundaries, and local recovery artifacts. (#83872) Thanks @iFiras-Max1.
1415
- Tests/perf: isolate doctor core health check unit coverage from real skills/workspace discovery so `doctor-core-checks` no longer dominates unit perf while keeping one real skills-readiness smoke. (#84493) Thanks @frankekn.
1516

0 commit comments

Comments
 (0)