Claude Code Skills·Claude Skills·The open SKILL.md registry for Claude
ClaudSkills / General / ai-tooling

Build A Scorer

Category: General  ·  Sub-category: ai-tooling  ·  Last updated:
ai:agent
Use when designing or revising a suite of quality checks, evals, or scorers for an LLM app, agent, multi-agent system, RAG app, or GenAI workflow — picking which criteria to measure and deciding rule/code check vs. built-in vs. LLM judge for each. Also use when a judge suite has grown vague, bloated, or expensive, when someone reaches for an LLM judge to check something code could check, or before writing any evaluation criteria. MLflow-native in its API examples; the method is stack-independent and the skill continues from first principles when MLflow is absent.
Security AStatic scan found no risk patternsHow grading works ›

From the source SKILL.md

<!-- Source: https://github.com/mlflow/skills (Apache-2.0, mlflow org, joshuawong-db). Installed 2026-08-19. BODY IS VERBATIM — re-pull from upstream rather than editing it. ONE LOCAL CHANGE: the frontmatter description was rewritten to trigger on eval-suite design generally, not on MLflow. Upstream's version gated discovery behind a vendor keyword this user doesn't use. Re-apply this edit after any upstream pull. Often used here WITHOUT MLflow: Phases 1/3/5 and the Phase 4 routing tree are stack-independent. When MLflow is absent, follow the skill's own instruction — continue from first…

What this skill does

Build A Scorer is a community-contributed Claude Code skill in the ai-tooling sub-category. It ships as a SKILL.md file that Claude Code auto-discovers under ~/.claude/skills/build-a-scorer/ and loads when your prompt matches the skill's trigger.

When to invoke it: Use when designing or revising a suite of quality checks, evals, or scorers for an LLM app, agent, multi-agent system, RAG app, or GenAI workflow — picking which criteria to measure and deciding rule/code check vs. built-in vs.

Who uses this skill

The Build A Scorer Claude Code skill is built for Claude Code users and developers across all disciplines looking for general-purpose AI assistance. It's part of ClaudSkills (also referred to as Claude Skills or Claude Code Skills) — the open community-curated registry of 196,000+ SKILL.md files for Anthropic's Claude Code agent and the wider Claude ecosystem (Claude API, Claude Agent SDK).

How to install

Free

Manual install (2 steps)

mkdir -p ~/.claude/skills/build-a-scorer
curl -L https://claudskills.com/skills/build-a-scorer/SKILL.md \
  -o ~/.claude/skills/build-a-scorer/SKILL.md

Or just download SKILL.md directly and drop it into ~/.claude/skills/build-a-scorer/. Claude Code auto-discovers it on next session.

Skills live at ~/.claude/skills/build-a-scorer/SKILL.md on macOS/Linux, or %USERPROFILE%\.claude\skills\build-a-scorer\SKILL.md on Windows. See the full install guide for step-by-step instructions.

Telegram

📱 Install from your phone or desktop Telegram

Open @claudskills_bot on Telegram, tap Open Desktop App, and the desktop app installs this skill for you. Or share the bot link with a colleague — they get the same one-tap install. Learn more →

Pro

One-click install via the desktop app

The ClaudSkills desktop app installs any skill directly into ~/.claude/skills/ with one click — no terminal required. Pro starts at $9/mo or $149 lifetime.

Pro

For the full experience including quality scoring and one-click install features for each skill — upgrade to Pro.

See pricing → Download desktop app

Frequently asked questions

How do I install the Build A Scorer Claude Code skill?
Install via the ClaudSkills desktop app (one click) or copy SKILL.md from the source repository to ~/.claude/skills/build-a-scorer/SKILL.md and restart Claude Code. Both flows are detailed at claudskills.com/install/.
What does the Build A Scorer skill do?
Use when designing or revising a suite of quality checks, evals, or scorers for an LLM app, agent, multi-agent system, RAG app, or GenAI workflow — picking which criteria to measure and deciding rule/code check vs. built-in vs. LLM judge for each. Also use when a judge suite has grown vague, bloated, or expensive, when someone reaches for an LLM judge to check something code could check, or before writing any evaluation criteria. MLflow-native in its API examples; the method is stack-independent and the skill continues from first principles when MLflow is absent.
Is this skill free to install?
Yes. ClaudSkills is an open registry — every skill keeps its source repository's license, and manual install via copy is free. ClaudSkills Pro ($9/mo, $79/yr, or $149 one-time) adds one-click install via the desktop app and a multi-signal Quality Score.
When should I use the Build A Scorer skill?
Use Build A Scorer when your Claude Code task falls under the General category — specifically in the ai tooling area. Claude Code auto-discovers installed skills and invokes the right one based on the task description, so you can also ask Claude directly (e.g. "use Build A Scorer" or describe the task and let Claude pick). Browse related skills at /category/general/.
What is a Claude Code skill and how does the Build A Scorer skill fit in?
A Claude Code skill is a SKILL.md file that lives under ~/.claude/skills/<name>/ and tells the Claude Code CLI agent how to perform a specific task (instructions, prompts, allowed tools). Skills are auto-discovered at session start. Build A Scorer is one of 67,000+ skills indexed in the open ClaudSkills catalog, classified under the General category. Learn more at /learn/what-is-a-claude-skill/.

Cite this skill

If you reference this skill in a blog post, paper, or documentation, you can cite it as:

APA
ClaudSkills. (2026). Build A Scorer [Claude Code skill]. ClaudSkills. https://claudskills.com/skills/build-a-scorer/
BibTeX
@misc{build-a-scorer-2026,
  author    = {ClaudSkills},
  title     = {Build A Scorer [Claude Code skill]},
  year      = {2026},
  publisher = {ClaudSkills},
  url       = {https://claudskills.com/skills/build-a-scorer/}
}

Embed this skill

Promote, attribute, or link this skill from your own README, blog post, or documentation. All three snippets are free to use — no sign-up, no API key. More distribution surfaces →

Badge
[![ClaudSkills](https://claudskills.com/badge/build-a-scorer.svg)](https://claudskills.com/skills/build-a-scorer/?utm_source=badge&utm_medium=readme&utm_campaign=skill_badge)
<script>
<script src="https://claudskills.com/embed/build-a-scorer.js" async></script>
<iframe>
<iframe src="https://claudskills.com/embed/build-a-scorer.html" width="100%" height="160" frameborder="0" loading="lazy" title="ClaudSkills: Build A Scorer"></iframe>

Security scan

Grade A · scanned 2026-09-28 — free static scan against the OWASP Agentic Skills Top 10.

No risk patterns were found in any of the ten OWASP-aligned categories. How grading works ›

Show this grade on your repo (click to copy):

[![Security: A](https://img.shields.io/badge/Security-A-2e7d32)](https://claudskills.com/skills/build-a-scorer/#security)

Free. No spam. Unsubscribe in one click.

More General skills

Browse all General skills in the ClaudSkills registry, or explore these other picks from the same category:

Browse all General skills → Top 100 skills
Part of ClaudSkills — the open registry for Claude Skills & Claude Code Skills.  ·  What's New  ·  Install guide  ·  About  ·  llms.txt

Part of Acreator Store — Adam Lankamer's AI tools: PerfectStudio · Ucaption · UTagger · AutoXPoster · TestYourSkills · AutomationFlows · Au Naturel · Telegram @acreatorstore

Categories

Use cases

Popular tags

Learn

Site