docs: add hermes-eval — skill regression testing + trajectory scoring#27071
Closed
Saurav0989 wants to merge 1 commit into
Closed
docs: add hermes-eval — skill regression testing + trajectory scoring#27071Saurav0989 wants to merge 1 commit into
Saurav0989 wants to merge 1 commit into
Conversation
teknium1
added a commit
that referenced
this pull request
May 17, 2026
Adds release-note attribution mappings for: - @Saurav0989 (PR #27071) - @avifenesh (PR #25902) - @BROCCOLO1D (PR #26796) - @matthewlai (PR #25293)
Contributor
|
Merged via PR #27247 — your commit was cherry-picked onto current |
Contributor
|
Heads up — I merged this earlier today as part of a batch salvage, but on a closer look at the linked repo (2 commits, 0 stars, 0 forks, no published releases) I've removed the link from the README in #27271. Nothing personal — README links from us implicitly endorse community projects, and we shouldn't be linking brand-new repos before they have any usage or track record. If hermes-eval picks up users and a real activity signal, please re-submit and we'll add it back. |
gweeteve
pushed a commit
to gweeteve/hermes-agent
that referenced
this pull request
Jun 2, 2026
Adds release-note attribution mappings for: - @Saurav0989 (PR NousResearch#27071) - @avifenesh (PR NousResearch#25902) - @BROCCOLO1D (PR NousResearch#26796) - @matthewlai (PR NousResearch#25293)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds hermes-eval — a skill regression testing + trajectory quality scoring library.
Addresses the skill drift problem documented in issue #13737 and multiple community posts.
The Atropos adapter outputs quality-scored ShareGPT trajectories directly in the format Atropos RL environments consume. MIT licensed, all tests offline (no LLM calls required).