# SkillEvaluator 0.9 — NVIDIA's agent-skill tester adds budgets and version diffs

> SkillEvaluator 0.9 runs your agent with and without a skill, then shows if the skill helped and what the run cost.

- Org: NVIDIA
- Date: 2026-11-13
- Category: tool, repo
- Source: https://github.com/NVIDIA/SkillEvaluator/releases/tag/v0.9.0
- Canonical page: https://ai-tldr.dev/releases/nvidia-skillevaluator-0-9-0/

## In short

NVIDIA SkillEvaluator 0.9.0 tests whether an Agent Skill really helps a coding agent. The release adds grounded test-set generation, skill version comparison, token and cost budgets, and clearer evidence in reports. The repo is trending on GitHub.

## What it is

SkillEvaluator 0.9.0 is the latest release of NVIDIA's open-source framework for checking Agent Skills, the instruction packs that coding agents like Claude Code and Codex load. The new version can build evaluation datasets from a skill's instructions, the author's intent or real traces, compare two versions of a skill, and stop a run when a token or cost budget is reached.

## How it works

The tool works in three tiers. Tier 1 checks that a skill is safe and well-formed with scanners like SkillSpector and Gitleaks; Tier 2 finds overlapping guidance with embeddings; Tier 3 runs the agent in a Docker sandbox through Harbor with and without the skill and reports the difference as 'Skill Lift'. In 0.9.0, --compare-to and compare-versions diff skill versions, --reuse-baseline reuses an old no-skill run, and Tier 3 moves to Harbor 0.25.0.

## Why it matters

A skill that reads well can still leave an agent's results unchanged, and SkillEvaluator measures that directly. Budgets make live evaluation safe to run in CI, and version comparison shows whether an edit to a skill made it better or worse. Some grading results change in this release, so NVIDIA advises re-running evaluations before comparing scores with older versions.

## Who it's for

Agent Skill authors, platform teams running coding agents

## Try it

pip install --upgrade skillevaluator

## Links

- [v0.9.0 Release](https://github.com/NVIDIA/SkillEvaluator/releases/tag/v0.9.0)
- [Repository](https://github.com/NVIDIA/SkillEvaluator)
- [Docs](https://docs.nvidia.com/skills/skillevaluator/)
- [GitHub Trending](https://github.com/trending?since=daily)
