Promptfoo Evaluation

Quality score: 70/100 · Category: Engineering · Sub-category: testing

lang:pythonai:llm

Configures and runs LLM evaluation using Promptfoo framework. Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts. Triggers on keywords like "promptfoo", "eval", "LLM evaluation", "prompt testing", or "model comparison".

What this skill does

Promptfoo Evaluation is a production-ready Claude Code skill (quality score 70/100) in the testing sub-category. It ships as a SKILL.md file that Claude Code auto-discovers under ~/.claude/skills/promptfoo-evaluation/ and loads when your prompt matches the skill's trigger.

When to invoke it: Use when setting up prompt testing, creating evaluation configs (promptfooconfig.yaml), writing Python custom assertions, implementing llm-rubric for LLM-as-judge, or managing few-shot examples in prompts.

Who uses this skill

The Promptfoo Evaluation skill is built for software engineers, backend developers, full-stack teams, and technical leads building and maintaining production systems. It is part of the open ClaudSkills registry, a community-curated catalog of 15,000+ capabilities you can install for Claude Code — the Claude CLI agent.

How to install

Free

Manual install (2 steps)

mkdir -p ~/.claude/skills/promptfoo-evaluation
curl -L https://claudskills.com/skills/promptfoo-evaluation/SKILL.md \
  -o ~/.claude/skills/promptfoo-evaluation/SKILL.md

Or just download SKILL.md directly and drop it into ~/.claude/skills/promptfoo-evaluation/. Claude Code auto-discovers it on next session.

Skills live at ~/.claude/skills/promptfoo-evaluation/SKILL.md on macOS/Linux, or %USERPROFILE%\.claude\skills\promptfoo-evaluation\SKILL.md on Windows. See the full install guide for step-by-step instructions.

Pro

One-click install via the desktop app

The ClaudSkills desktop app installs any skill directly into ~/.claude/skills/ with one click — no terminal required. Pro starts at $9/mo or $149 lifetime.

More Engineering skills

Browse all Engineering skills in the ClaudSkills registry, or explore these top-rated picks from the same category:

Browse all Engineering skills → Top 100 skills

Part of ClaudSkills — the open registry for Claude Code skills. · What's New · Install guide · About · llms.txt

Part of Acreator Store — Adam Lankamer's AI tools: GifPerfect · AspectPerfect · SlomoPerfect · Ucaption · UTagger · AutoXPoster · TestYourSkills