Skip to content

fix(tests): restore main CI baseline#13352

Open
sgaofen wants to merge 1 commit into
NousResearch:mainfrom
sgaofen:codex/fix-main-test-baseline
Open

fix(tests): restore main CI baseline#13352
sgaofen wants to merge 1 commit into
NousResearch:mainfrom
sgaofen:codex/fix-main-test-baseline

Conversation

@sgaofen

@sgaofen sgaofen commented Apr 21, 2026

Copy link
Copy Markdown
Contributor

Summary

  • restores the currently failing Tests/test baseline on main
  • syncs provider/model catalog expectations for Gemini and Hugging Face Kimi
  • updates the stale custom-provider compatibility test to the current base_url > url > api precedence
  • updates plugin-hook integration tests for the plugin allow-list gate
  • makes timeout helpers tolerate bare AIAgent.__new__ test instances
  • initializes file read tracker containers consistently and isolates command-guard approval context in xdist
  • updates the Camofox config schema version assertion and restores gateway insights estimated cost output

Root cause

The failing checks are also present on latest main (for example Tests run 24705547851), so downstream PRs authored by sgaofen inherited the same red Tests/test status even when their own targeted tests passed.

Tests

  • uv run --frozen --python 3.11 --extra dev pytest -o addopts='\ tests/agent/test_insights.py::TestGatewayFormatting::test_gateway_format_hides_cost tests/hermes_cli/test_api_key_providers.py::TestHuggingFaceModels::test_model_metadata_has_context_lengths tests/hermes_cli/test_config.py::TestCustomProviderCompatibility::test_compatible_custom_providers_prefers_api_then_url_then_base_url tests/hermes_cli/test_gemini_provider.py::TestGeminiModelCatalog::test_provider_models_exist tests/run_agent/test_interrupt_propagation.py::TestInterruptPropagationToChild::test_interrupt_during_child_api_call_detected tests/test_transform_tool_result_hook.py::test_transform_tool_result_integration_with_real_plugin tests/tools/test_browser_camofox_state.py::TestCamofoxConfigDefaults::test_config_version_matches_current_schema tests/tools/test_command_guards.py::TestTirithWarnSafe::test_warn_session_approved tests/tools/test_command_guards.py::TestCombinedWarnings::test_combined_cli_session_approves_both tests/tools/test_terminal_output_transform_hook.py::test_terminal_output_transform_integration_with_real_plugin -q -> 10 passed
  • uv run --frozen --python 3.11 --extra dev pytest -o addopts='\ -n 4 tests/hermes_cli/test_provider_config_validation.py::TestNormalizeCustomProviderEntry::test_base_url_preferred_over_api tests/hermes_cli/test_config.py::TestCustomProviderCompatibility::test_compatible_custom_providers_prefers_base_url_then_url_then_api tests/tools/test_accretion_caps.py::TestReadTrackerCaps::test_live_cap_applied_after_read_add tests/tools/test_command_guards.py::TestTirithWarnSafe::test_warn_session_approved tests/tools/test_command_guards.py::TestCombinedWarnings::test_combined_cli_session_approves_both -q -> 5 passed
  • uv run --frozen --python 3.11 --extra dev pytest -o addopts='\ tests/agent/test_insights.py tests/hermes_cli/test_api_key_providers.py tests/hermes_cli/test_config.py tests/hermes_cli/test_gemini_provider.py tests/hermes_cli/test_provider_config_validation.py tests/run_agent/test_interrupt_propagation.py tests/test_transform_tool_result_hook.py tests/tools/test_accretion_caps.py tests/tools/test_browser_camofox_state.py tests/tools/test_command_guards.py tests/tools/test_terminal_output_transform_hook.py -q -> 357 passed
  • git diff --check

@sgaofen sgaofen force-pushed the codex/fix-main-test-baseline branch 2 times, most recently from a1e25b1 to 4d18fb1 Compare April 21, 2026 05:59
@alt-glitch alt-glitch added type/test Test coverage or test infrastructure P1 High — major feature broken, no workaround comp/agent Core agent loop, run_agent.py, prompt builder comp/cli CLI entry point, hermes_cli/, setup wizard comp/gateway Gateway runner, session dispatch, delivery comp/plugins Plugin system and bundled plugins labels Apr 22, 2026
@sgaofen sgaofen force-pushed the codex/fix-main-test-baseline branch 4 times, most recently from 1a31209 to 7b41400 Compare April 23, 2026 04:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp/agent Core agent loop, run_agent.py, prompt builder comp/cli CLI entry point, hermes_cli/, setup wizard comp/gateway Gateway runner, session dispatch, delivery comp/plugins Plugin system and bundled plugins P1 High — major feature broken, no workaround type/test Test coverage or test infrastructure

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants