TESTING AND RELIABILITY / Trail of Bits
Trail of Bits Mutation Analysis
Interprets mutation campaign results and turns survivors into qualified test-gap reports or separately reproduced bug findings.
“Configures mewt or muton campaigns, analyzes surviving mutants, and investigates bugs exposed by testing gaps. Use when setting up mutation testing, reviewing campaign results,”
01 / THE REASONING
Why this made the selection.
- Separates test-gap analysis from bug hunting, so an uncaught mutation is not automatically presented as a vulnerability.
- Requires source context and an equivalence investigation, keeps uncertain cases unresolved, and makes report denominators explicit.
02 / THE REVIEW RECORD
What we actually inspected.
Source review has boundaries.
A clear record is more useful than a “safe” badge.
Material inspected
- plugins/mutation-testing/skills/mutation-testing/SKILL.md
- plugins/mutation-testing/skills/mutation-testing/agents/openai.yaml
- plugins/mutation-testing/skills/mutation-testing/references/blockchain-patterns.md
- plugins/mutation-testing/skills/mutation-testing/references/equivalent-mutants.md
- plugins/mutation-testing/skills/mutation-testing/references/input-formats.md
- plugins/mutation-testing/skills/mutation-testing/references/optimization-strategies.md
- plugins/mutation-testing/skills/mutation-testing/references/report-template.md
- plugins/mutation-testing/skills/mutation-testing/references/severity-classification.md
- plugins/mutation-testing/skills/mutation-testing/workflows/analyzing-results.md
- plugins/mutation-testing/skills/mutation-testing/workflows/bug-hunter.md
- plugins/mutation-testing/skills/mutation-testing/workflows/configuration.md
- README.md (installation, compatibility and licence sections)
- LICENSE
Our findings
- The full definition, three workflows and all analysis references were read, including equivalence, severity, foreign input formats and blockchain-specific qualifications.
- The report keeps killed, surviving, equivalent, skipped, timed-out and unresolved cases separate; overall test adequacy is not inferred from a kill rate.
- The bug-hunting workflow requires evidence from the original program and a reproduction before calling a bug confirmed.
Not established by this review
- No mutation engine, campaign, benchmark, test suite or proof of concept was run.
- Foreign report parsers and every mewt/muton CLI example were not runtime-validated.
The review applies to the material and revision named here. A newer upstream release can change its behavior.
03 / PUT IT TO WORK
Add a skill to your workflow.
DOCUMENTED COMMAND
npx skills add https://github.com/trailofbits/skills/tree/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testingCopying does not execute this command. It may retrieve a newer version than the reviewed source.
- Install the complete mutation-testing directory with its workflows and references.
- Start with an existing report for analysis or bug investigation. Campaign setup needs a separate check of target paths, installed-engine help and the final duration estimate; preserve results before any purge.
- Choose the intended host and project scope in the installer. The source revision is pinned; the installer itself is not executed or version-pinned by this review.
Before you start
- Node.js/npm and git for the documented Skills installer
- The target repository and a working baseline test command
- An existing mutation report for the recommended analysis workflow; mewt or muton is separately required if you choose to run a campaign
04 / FOLLOW THE EVIDENCE
The source trail.
Our notes are separate from the original resource.
Check upstream before adopting a new version.
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/SKILL.md
Supports: summary, upstreamDescription, whySelected, bestFor, limitations, review, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/blockchain-patterns.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/equivalent-mutants.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/input-formats.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/optimization-strategies.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/report-template.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/severity-classification.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/workflows/analyzing-results.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/workflows/bug-hunter.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/workflows/configuration.md
Supports: review, limitations, install, access
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/README.md
Supports: install, compatibility, access, license
https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/LICENSE
Supports: license, access.cost
https://github.com/vercel-labs/skills/blob/7407f3893ad4dceab546ac002c3ef806e4000c73/README.md
Supports: install
https://github.com/vercel-labs/skills/blob/7407f3893ad4dceab546ac002c3ef806e4000c73/src/git.ts
Supports: install
https://github.com/vercel-labs/skills/blob/7407f3893ad4dceab546ac002c3ef806e4000c73/src/source-parser.ts
Supports: install