SkillEvaluator
Multi-tier framework for evaluating AI agent skills with quality gates, semantic overlap detection, synthetic evaluation dataset generation, and live agent evaluation that measures how skills affect agent behavior.
Open the source (opens github.com) https://github.com/nvidia/skillevaluator
What it is
Skills from NVIDIA.
The problem it solves and who it suits haven't been reviewed by InnerVault. The description above is the source's own.
How to get it
Get the code
git clone https://github.com/NVIDIA/SkillEvaluator.git
Standard git access to a public repository
Setup steps: not provided by the source. Follow the instructions on the source.
Related
-
agent-plugins-skills
SkillsAgentic OS Control Plane: deterministic state-machine governance for AI coding agents with cryptographically enforced SSH/CIBA human-in-the-loop gates and zero-trust verification.
git clone https://github.com/richfrem/agent-plugins-skills.git -
OpenART
SkillsOpenART is an open-source framework designed to evaluate the safety and robustness of autonomous AI agents in dynamic, long-horizon, and stateful environments. It stress-tests agent runtimes against multi-step state poisoning, privilege escalation, and tool-use vulnerabilities across 10,000+ benchmark scenarios.
git clone https://github.com/AI45Lab/OpenART.git -
agent-plugins
SkillsAgent Plugins for AWS equip AI coding agents with the skills to help you architect, deploy, and operate on AWS.
git clone https://github.com/awslabs/agent-plugins.git -
agent-plugins-spec
SkillsAgent Plugins Specification v1.0.0 — A minimal standard for packaging agent extensions into distributable plugins
git clone https://github.com/agentplugins/agent-plugins-spec.git -
skill-up
SkillsEvaluate Agent Skills and environments. Evolve Skills with evidence.
git clone https://github.com/alibaba/skill-up.git -
agent-plugins
SkillsA collection of agent plugins for improving productivity, automating workflows, and making AI coding agents work better together.
git clone https://github.com/antonbabenko/agent-plugins.git