Coder Eval
Test whether your Claude Code skills actually trigger, and benchmark any coding agent — author, run, and analyze the eval suite that proves it, locally or as...
Coder Eval is an open-source Claude Code plugin in Productivity & Automation. It bundles 6 skills, 6 slash commands, and 7 subagents to extend Claude Code with verified install commands and live GitHub tracking.
How to Install & Test
Official Claude Code installation commands generated from verified marketplace manifests.
Local Script Execution
This plugin runs shell scripts or local binaries on your computer. Review the code repository before installing.
What this plugin can run:
- 6 contextual agent skill(s)
- 6 slash command(s)
- 7 dedicated subagent(s)
Installation Time: Running Claude Code marketplace commands resolves dependencies, AST verification, and hooks. This usually takes 10–30 seconds. Wait for the CLI confirmation before proceeding.
Run these slash commands inside your Claude Code interactive session:
Registers the author's plugin catalog with your Claude Code client:
/plugin marketplace add UiPath/coder_eval
Installs the package into your chosen scope (user, project, or local):
/plugin install coder-eval@coder-eval
Reloads active plugins in your session without exiting:
/reload-plugins
Test or inspect the plugin locally using official Claude Code CLI commands:
git clone https://github.com/UiPath/coder_eval.git
Loads the local plugin into this terminal session only:
claude --plugin-dir ./
claude plugin validate ./
claude plugin install ./
Copy this audit-and-install prompt and paste it into Claude Code or your AI coding assistant:
Please inspect the Claude Code plugin at https://github.com/UiPath/coder_eval. 1. Read the manifest (.claude-plugin/plugin.json or marketplace.json) and scan components (commands, skills, agents, hooks, and .mcp.json). 2. Summarize every hook lifecycle event, script, command, and external MCP server it defines. 3. Verify whether it requests API keys or accesses sensitive local paths. 4. Ask for my confirmation. Once approved, run: /plugin marketplace add UiPath/coder_eval /plugin install coder-eval@coder-eval /reload-plugins
What's Inside This Package
Components declared in the plugin tree: skills, slash commands, dedicated subagents, lifecycle hooks, and MCP servers.
Agent Skills (6)
Custom Slash Commands (6)
/coder-eval-code-review /coder-eval-code-review-full /coder-eval-code-review-wf /coder-eval-create-plan /coder-eval-implement-plan /coder-eval-reviewSpecialized Subagents (7)
Overview & Documentation
Coder Eval — Test whether your Claude Code skills actually trigger, and benchmark any coding agent — author, run, and analyze the eval suite that proves it, locally or as a CI gate.
Includes 6 skills, 6 slash commands, 7 agents.
Install in Claude Code: /plugin marketplace add UiPath/coder_eval, then /plugin install coder-eval@coder-eval.
Source: UiPath/coder_eval (160 GitHub stars as of 2026-11-18).
Frequently Asked Questions
Answers to common questions regarding Coder Eval compatibility, safety, and configuration.
Frequently Asked Questions
Direct answers to common questions about using these skills and tools.
How do I install Coder Eval in Claude Code?
Add the marketplace via "/plugin marketplace add UiPath/coder_eval", then run "/plugin install coder-eval@coder-eval". Finally, run "/reload-plugins" to activate the package in your current session.
What capabilities and components are included inside Coder Eval?
Coder Eval bundles 6 contextual skills, 6 custom commands, 7 subagents, no event hooks, and 0 external MCP server connections.
Is Coder Eval safe to run on my machine?
This package is classified as "runs-scripts" risk. It runs locally without unauthorized elevation. Always inspect the code before installing.
How do I test Coder Eval locally without permanent installation?
Clone the repository and run "claude --plugin-dir ./". This loads the plugin strictly for the active terminal session without changing your global settings.