Skip to content

feat: Skill Evaluation Gate — universal skill loading (no keywords)#19524

Closed
Cyrene963 wants to merge 1 commit into
NousResearch:mainfrom
Cyrene963:feature/skill-evaluation-gate
Closed

feat: Skill Evaluation Gate — universal skill loading (no keywords)#19524
Cyrene963 wants to merge 1 commit into
NousResearch:mainfrom
Cyrene963:feature/skill-evaluation-gate

Conversation

@Cyrene963

@Cyrene963 Cyrene963 commented May 4, 2026

Copy link
Copy Markdown

Closing — all changes merged into PR #18316 (feature/semantic-skill-retrieval). The Skill Evaluation Gate is now part of the unified solution with FTS5 + hybrid selector + gate enforcement.

… keywords)

Replace keyword-based skill auto-injection with a code-enforced gate that
leverages the LLM's own semantic understanding to select relevant skills.

How it works:
1. System prompt includes all skill names + descriptions (existing mechanism)
2. A mandatory instruction tells the agent to evaluate skills before acting
3. A pre_tool_call hook BLOCKS non-read tools until skill_view() is called
4. After skill_view() is called once, the gate opens for the rest of the session

This is universal (works for any language), lightweight (no extra API calls),
and code-enforced (agent cannot skip it). No keyword matching.

Changes:
- agent/skill_eval_gate.py: New module with gate logic and instruction text
- run_agent.py: Integrate gate into system prompt + both tool dispatch paths
@alt-glitch alt-glitch added type/feature New feature or request P3 Low — cosmetic, nice to have comp/agent Core agent loop, run_agent.py, prompt builder tool/skills Skills system (list, view, manage) labels May 4, 2026
@Cyrene963 Cyrene963 closed this May 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

comp/agent Core agent loop, run_agent.py, prompt builder P3 Low — cosmetic, nice to have tool/skills Skills system (list, view, manage) type/feature New feature or request

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants