Agento11y Prod Setup

Sets up production evaluation and guardrails for a DEPLOYED AI agent in Grafana Agent Observability, grounded in the agent's own code and its real ingested traffic. The judgment layer on top of the `agento11y` skill: it reads the agent's source (system prompt, tools, entrypoint) AND samples its live traffic via gcx, checks what evaluators/rules/guards already exist, then recommends only what's missing — online eval rules (score live conversations for regressions) and guards (warn-first request-path policies that redact / tool-filter and may later be promoted to deny). It drafts reviewable YAML and, only with explicit confirmation, applies via `gcx agento11y`. New guards are drafted in warn mode (safe on live traffic — warn records but never blocks). It DOES create stack-level objects — that is the point — but every write is confirmed. It never rewrites or redeploys the agent. Trigger on phrases like "set up production evaluation", "my agent is in prod what should I evaluate", "catch quality regressions", "add guardrails to my agent", "redact PII from my agent", "block dangerous tools", "set up online evals and guards".

mkdir -p ~/.claude/skills/agento11y-prod-setup
curl -L https://claudskills.com/skills/agento11y-prod-setup/SKILL.md \
  -o ~/.claude/skills/agento11y-prod-setup/SKILL.md

@misc{agento11y-prod-setup-2026,
  author    = {grafana},
  title     = {Agento11y Prod Setup [Claude Code skill]},
  year      = {2026},
  publisher = {ClaudSkills},
  url       = {https://claudskills.com/skills/agento11y-prod-setup/}
}