Skip to content

feature request: implementing tool_calls grader #187

Description

@JasonYeMSFT

A grader that has access to not only the tool name, but also its arguments and result is necessary to validate the correct behavior for Azure MCP in the namespace mode. When Azure MCP runs in namespace mode, the actual tool name is hidden behind the abstracted namespace tool as an argument. Knowing the tool name is not enough to determin if the agent has used the tool correctly.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions