---
title: "OpenAI Evaluate Skill: review, setup & limitations · Undominated.ai"
canonical: https://undominated.ai/skills/openai-evaluate-skill/
description: "Connects a local skill review to structural checks, budget explanations and an explicitly separate live benchmark workflow."
---

# OpenAI Evaluate Skill: review, setup & limitations · Undominated.ai

> Connects a local skill review to structural checks, budget explanations and an explicitly separate live benchmark workflow.

[← Explore all skills](/skills/)

AGENT DEVELOPMENT / OpenAI

# OpenAI Evaluate Skill

Connects a local skill review to structural checks, budget explanations and an explicitly separate live benchmark workflow.

 [See setup guidance ↓](#setup)[Original source ↗](https://github.com/openai/plugins/tree/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/skills/evaluate-skill)

SOURCE REVIEW

 Reviewed 2026-10-15
 Evidence 8 linked sources
 Publisher OpenAI
 Licence [MIT (declared in plugin manifest) ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/.codex-plugin/plugin.json)
 Revision 0722921d5542
 [Read what was—and wasn’t—checked ↓](#review)

“Evaluate a local Codex skill in engineer-friendly terms.…”

 [OpenAI · upstream description ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/skills/evaluate-skill/SKILL.md) Our analysis follows below.

01 / THE REASONING

## Why this made the selection.

 - Distinguishes static instruction-size estimates from observed usage collected by real agent runs.
- Directs attention to broken references, metadata and helper code before proposing a benchmark.

### A good fit for

 - Reviewing a skill before adopting or revising it
- Preparing realistic scenarios for measuring an installed skill
- Separate structural, budget-related and code-related findings before preparing starter benchmark scenarios.

### Weigh up before choosing

 - Static scores and budget bands are tool heuristics, not proof of task quality or safety.
- The CLI is marked private and is installed from a checkout; a skill-only copy does not supply it.
- Benchmarking launches real Codex sessions and can exercise task permissions or incur usage costs.
- MIT is declared in the plugin manifest, but no licence file exists in plugins/plugin-eval or at the repository root at 0722921d5542fc593105c27bd52630babd8b8c2a; no redistribution artifact is offered.

02 / THE REVIEW RECORD

## What we actually inspected.

Source review has boundaries. A clear record is more useful than a “safe” badge.

### Material inspected

 - plugins/plugin-eval/skills/evaluate-skill/SKILL.md
- plugins/plugin-eval/references/chat-first-workflows.md
- plugins/plugin-eval/src/core/analyze.js
- plugins/plugin-eval/src/cli.js
- plugins/plugin-eval/.codex-plugin/plugin.json (license MIT, no licence file beside it)
- plugins/plugin-eval/README.md

### Our findings

 - The inspected analyzer combines structural evaluation, code checks, budget profiles and optional observed-usage input.
- The workflow distinguishes analyze from init-benchmark and requires reviewing the generated scenarios before live runs.
- The publisher documents local reports and benchmark artifacts under .plugin-eval; this catalogue did not run them.
- The SKILL.md drives the plugin-eval CLI: start, analyze, explain-budget, measurement-plan, init-benchmark and benchmark --dry-run. The README requires Node.js >=20 and says the package is private, so it runs from a checkout.
- Re-pinned from 1dc195897af4161d039b80d8471ec0a10c9bbc89 to 0722921d5542fc593105c27bd52630babd8b8c2a: no file under plugins/plugin-eval changed between the two (GitHub compare). plugin.json still declares license MIT, and no licence file exists in the plugin or at the repository root at the new pin.

### Not established by this review

 - Source inspection only; no skill installation or workflow execution was performed.
- Not executed: it was not installed or run.

The review applies to the material and revision named here. A newer upstream release can change its behavior.

03 / PUT IT TO WORK

## Add a skill to your workflow.

[Upstream setup instructions ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/README.md)
 - Use a checkout of the complete plugins/plugin-eval directory and follow its README setup.
- From that directory, node ./scripts/plugin-eval.js --help runs the CLI without a global install; npm link is the documented optional global command.
- Install the full Codex plugin through the documented local marketplace instructions for natural-language skill invocation.

### Before you start

 - Node.js meeting the documented runtime requirement
- Complete plugin files; a live Codex CLI session is needed only for benchmarks
- Complete plugin checkout and its CLI dependencies
- Codex CLI access only for live benchmarking

### Compatibility

Codex plugin-eval plugin · Local Node.js CLI with the upstream-required runtime version

### Read target skill/plugin files and write local reports

 - Read target skill/plugin files and write local reports
- Create benchmark configuration
- Optional live Codex sessions in temporary workspaces

### Cost model

MIT is declared in the plugin manifest; static inspection runs locally, while live benchmarks use the configured Codex service.

04 / FOLLOW THE EVIDENCE

## The source trail.

Our notes are separate from the original resource. Check upstream before adopting a new version.

 - [Skill definition at reviewed revision ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/skills/evaluate-skill/SKILL.md) Checked 2026-10-13 https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/skills/evaluate-skill/SKILL.md Supports: summary, upstreamDescription, whySelected, bestFor, limitations, review, compatibility, access
- [Reviewed reference or helper: ../../references/chat-first-workflows.md ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/references/chat-first-workflows.md) Checked 2026-10-13 https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/references/chat-first-workflows.md Supports: review, limitations, access
- [Reviewed reference or helper: ../../src/core/analyze.js ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/src/core/analyze.js) Checked 2026-10-13 https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/src/core/analyze.js Supports: review, limitations, access
- [Reviewed reference or helper: ../../src/cli.js ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/src/cli.js) Checked 2026-10-13 https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/src/cli.js Supports: review, limitations, access
- [Upstream license or licensing declaration ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/.codex-plugin/plugin.json) Checked 2026-10-13 https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/.codex-plugin/plugin.json Supports: license
- [Publisher installation and project documentation ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/README.md) Checked 2026-10-13 https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/README.md Supports: install, compatibility, access
- [Complete plugin setup and operational boundaries ↗](https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/README.md) Checked 2026-10-13 https://github.com/openai/plugins/blob/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/README.md Supports: install, compatibility, access, review
- [Pinned source review C2-W23 ↗](https://raw.githubusercontent.com/openai/plugins/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/skills/evaluate-skill/SKILL.md) Checked 2026-10-15 https://raw.githubusercontent.com/openai/plugins/0722921d5542fc593105c27bd52630babd8b8c2a/plugins/plugin-eval/skills/evaluate-skill/SKILL.md Supports: bestFor, review.notTested, upstreamDescription, review.reviewedAt

KEEP COMPARING

## Other approaches to consider.

Related by category or shared topics. These are alternatives to inspect, not a measured quality order.

 [### Anthropic Skill Creator ↗ Develops skills from realistic task fixtures and baseline comparisons, with separate trigger-description experiments and human output review.](/skills/anthropics-skill-creator/)[### Skill Development for Claude Code Plugins ↗ Guides writing a skill that ships inside a Claude Code plugin: directory layout, a third-person trigger description, an imperative SKILL.md body and progressive disclosure into references/, examples/ and scripts/.](/skills/anthropic-skill-development/)[### Testing Handbook Skill Generator ↗ Maintainer workflow that reads sections of the Trail of Bits Testing Handbook (appsec.guide) and writes or refreshes the matching Claude Code skills inside the trailofbits/skills testing-handbook-skills plugin.](/skills/trailofbits-testing-handbook-generator/)

 [AI Tools ↗](/tools/)[Skills ↗](/skills/)[Agents ↗](/agents/)[MCP Servers ↗](/mcp-servers/)[Workflows ↗](/workflows/)

## Continue your investigation

 - [Choose a toolkit](/tools/)
- [Inspect execution hosts](/agents/)
- [Check tool access](/mcp-servers/)
- [Check project dependencies](/check-repo/)
