When output is open-ended — a summary, a support answer, tone, helpfulness — you can't score it with exact match, and human grading doesn't scale. An LLM-as-judge does, but only if it's built carefully: an uncalibrated judge produces confident, inconsistent scores that quietly corrupt every downstream decision. This skill designs a judge you can actually trust.
LLM As Judge Scorer is a community-contributed Claude Code skill in the education-learning sub-category. It ships as a SKILL.md file that Claude Code auto-discovers under ~/.claude/skills/llm-as-judge-scorer/ and loads when your prompt matches the skill's trigger.
When to invoke it: Use when grading open-ended LLM output (summaries, answers, tone) that exact-match can't score.
The LLM As Judge Scorer Claude Code skill is built for Claude Code users and developers across all disciplines looking for general-purpose AI assistance. It's part of ClaudSkills (also referred to as Claude Skills or Claude Code Skills) — the open community-curated registry of 152,000+ SKILL.md files for Anthropic's Claude Code agent and the wider Claude ecosystem (Claude API, Claude Agent SDK).
mkdir -p ~/.claude/skills/llm-as-judge-scorer curl -L https://claudskills.com/skills/llm-as-judge-scorer/SKILL.md \ -o ~/.claude/skills/llm-as-judge-scorer/SKILL.md
Or just download SKILL.md directly and drop it into ~/.claude/skills/llm-as-judge-scorer/. Claude Code auto-discovers it on next session.
Skills live at ~/.claude/skills/llm-as-judge-scorer/SKILL.md on macOS/Linux, or %USERPROFILE%\.claude\skills\llm-as-judge-scorer\SKILL.md on Windows. See the full install guide for step-by-step instructions.
Open @claudskills_bot on Telegram, tap Open Desktop App, and the desktop app installs this skill for you. Or share the bot link with a colleague — they get the same one-tap install. Learn more →
The ClaudSkills desktop app installs any skill directly into ~/.claude/skills/ with one click — no terminal required. Pro starts at $9/mo or $149 lifetime.
For the full experience including quality scoring and one-click install features for each skill — upgrade to Pro.
SKILL.md from the source repository to ~/.claude/skills/llm-as-judge-scorer/SKILL.md and restart Claude Code. Both flows are detailed at claudskills.com/install/.SKILL.md file that lives under ~/.claude/skills/<name>/ and tells the Claude Code CLI agent how to perform a specific task (instructions, prompts, allowed tools). Skills are auto-discovered at session start. LLM As Judge Scorer is one of 67,000+ skills indexed in the open ClaudSkills catalog, classified under the General category. Learn more at /learn/what-is-a-claude-skill/.If you reference this skill in a blog post, paper, or documentation, you can cite it as:
@misc{llm-as-judge-scorer-2026,
author = {imtiazrayhan},
title = {LLM As Judge Scorer [Claude Code skill]},
year = {2026},
publisher = {ClaudSkills},
url = {https://claudskills.com/skills/llm-as-judge-scorer/}
}Grade A · scanned 2026-07-16 — free static scan against the OWASP Agentic Skills Top 10.
No risk patterns were found in any of the ten OWASP-aligned categories. How grading works ›
Browse all General skills in the ClaudSkills registry, or explore these other picks from the same category:
Part of Acreator Store — Adam Lankamer's AI tools: PerfectStudio · Ucaption · UTagger · AutoXPoster · TestYourSkills · AutomationFlows · Au Naturel · Telegram @acreatorstore
SKILL.md files, not affiliated with, endorsed by, or sponsored by Anthropic.