AskOpenSource by The Arthi AI Collective

skillevaluator

NVIDIA open-sourced a framework that automatically tests whether an AI agent's skills actually make it behave better, not just whether the skill files look correct.

View nvidia/skillevaluator on GitHub
GitHub stars
1,468
Forks
—
Language
Python

Project details

Repository
nvidia/skillevaluator
Licence
Apache-2.0
Primary language
Python
Catalog status
Available
Catalog check
2026-11-15

Repository description

Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.

Explore by topic

More tools in Skills & plugins