TESTING AND REVIEW / Trail of Bits
Skill reviewer fixture
Reviews one Claude Code skill from a loop dispatch, writes nothing, and leaves a rejected ledger finding closed unless the evidence is new.
“Reviews one skill per dispatch, edits nothing, and reopens a rejected ledger finding only when the evidence is new.”
01 / THE REASONING
Why this made the selection.
- The description says it reviews one skill per dispatch and is not for general code review.
- It says not to edit or write files, and a rejected ledger entry stands unless the new evidence falls outside the recorded reason.
02 / THE REVIEW RECORD
What we actually inspected.
Source review has boundaries.
A clear record is more useful than a “safe” badge.
Material inspected
- plugins/code-improver/tests/fixtures/plugin-dev/agents/skill-reviewer.md
- plugins/code-improver/README.md
- README.md
- LICENSE
Our findings
- The description says it reviews one Claude Code skill per dispatch, checks the run's findings ledger, and is not for general code review.
- It says to report every defect with a severity, including ones that seem minor or unlikely to be fixed.
- It says not to edit or write files. The ledger copy in the prompt is read-only context, and the loop persists the ledger.
- A rejected status stands. Re-filing requires new evidence the recorded reason does not cover, and disagreeing with that reason is not new evidence.
- It says not to soften a severity because the finding was rejected before. Severity states impact, and the ledger records the disagreement.
Not established by this review
- The resource was not executed and its tools were not called.
- No skill and no findings ledger were supplied.
- The external plugin-dev skill-reviewer was not fetched.
The review applies to the material and revision named here. A newer upstream release can change its behavior.
03 / PUT IT TO WORK
Use the role in your project.
DOCUMENTED COMMAND
/plugin marketplace add trailofbits/skills Copying does not execute this command. It may retrieve a newer version than the reviewed source.
- The repository README at this pin shows /plugin marketplace add trailofbits/skills as one unindented line. That line adds the marketplace, not this fixture.
- The code-improver README says the skill-improver entry needs the plugin-dev plugin from the claude-plugins-official marketplace. This file is in the local test harness, not that plugin.
- No fetched file contains a single-line command that installs this fixture alone.
Before you start
- A host that can read a Markdown agent profile
- A dispatch that supplies one skill and the run's findings ledger, which this file says it expects
04 / FOLLOW THE EVIDENCE
The source trail.
Our notes are separate from the original resource.
Check upstream before adopting a new version.
- skill-reviewer fixture ↗Checked
https://github.com/trailofbits/skills/blob/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/code-improver/tests/fixtures/plugin-dev/agents/skill-reviewer.md
Supports: one-skill dispatch, no edits, and rejected findings stay closed without new evidence
- Repository root LICENSE ↗Checked
https://github.com/trailofbits/skills/blob/8e54050ae63c2f62224c35b1616efe71865b4777/LICENSE
Supports: CC-BY-SA-4.0 Attribution-ShareAlike 4.0 International
- code-improver README ↗Checked
https://github.com/trailofbits/skills/blob/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/code-improver/README.md
Supports: tests/ is the offline harness, and skill-improver names an external plugin-dev reviewer
- Repository README ↗Checked
https://github.com/trailofbits/skills/blob/8e54050ae63c2f62224c35b1616efe71865b4777/README.md
Supports: marketplace install line and the same CC-BY-SA-4.0 statement