--- title: "Trail of Bits Mutation Analysis: review, setup & limitations · Undominated.ai" canonical: https://undominated.ai/skills/trailofbits-mutation-testing/ description: "Interprets mutation campaign results and turns survivors into qualified test-gap reports or separately reproduced bug findings." --- # Trail of Bits Mutation Analysis: review, setup & limitations · Undominated.ai > Interprets mutation campaign results and turns survivors into qualified test-gap reports or separately reproduced bug findings. [← Explore all skills](/skills/) TESTING AND RELIABILITY / Trail of Bits # Trail of Bits Mutation Analysis Interprets mutation campaign results and turns survivors into qualified test-gap reports or separately reproduced bug findings. See setup guidance ↓Original source ↗ SOURCE REVIEW Reviewed 2026-09-21 Evidence 15 linked sources Publisher Trail of Bits Licence CC-BY-SA-4.0 ↗ Revision 32e34f817379 Read what was—and wasn’t—checked ↓ “Configures mewt or muton campaigns, analyzes surviving mutants, and investigates bugs exposed by testing gaps. Use when setting up mutation testing, reviewing campaign results,” Trail of Bits · upstream description ↗ Our analysis follows below. 01 / THE REASONING ## Why this made the selection. - Separates test-gap analysis from bug hunting, so an uncaught mutation is not automatically presented as a vulnerability. - Requires source context and an equivalence investigation, keeps uncertain cases unresolved, and makes report denominators explicit. ### A good fit for - Prioritizing assertions and edge cases missed by an existing test suite - Investigating whether a mutation-testing blind spot hides a reproducible defect ### Weigh up before choosing - This selection focuses on existing-report analysis. Setup and optimization need separate review: examples hardcode src/, retain a pre-optimization acceptance check and mix counting formats. Do not copy their campaign estimates or purge steps unchanged. - Campaigns execute the project’s tests repeatedly and can be expensive; estimates and illustrative speedups are not measurements of your repository. - The tool’s mutation severity is distinct from actual product risk, and targeted tests can miss cross-module failures. - Configuration changes may purge saved campaign data. Preserve needed results and authorize destructive cleanup before following those steps. - Equivalence patterns still need proof from actual operand types and observable behavior; the double-negation example applies to boolean values, not arbitrary truthy values. 02 / THE REVIEW RECORD ## What we actually inspected. Source review has boundaries. A clear record is more useful than a “safe” badge. ### Material inspected - plugins/mutation-testing/skills/mutation-testing/SKILL.md - plugins/mutation-testing/skills/mutation-testing/agents/openai.yaml - plugins/mutation-testing/skills/mutation-testing/references/blockchain-patterns.md - plugins/mutation-testing/skills/mutation-testing/references/equivalent-mutants.md - plugins/mutation-testing/skills/mutation-testing/references/input-formats.md - plugins/mutation-testing/skills/mutation-testing/references/optimization-strategies.md - plugins/mutation-testing/skills/mutation-testing/references/report-template.md - plugins/mutation-testing/skills/mutation-testing/references/severity-classification.md - plugins/mutation-testing/skills/mutation-testing/workflows/analyzing-results.md - plugins/mutation-testing/skills/mutation-testing/workflows/bug-hunter.md - plugins/mutation-testing/skills/mutation-testing/workflows/configuration.md - README.md (installation, compatibility and licence sections) - LICENSE ### Our findings - The full definition, three workflows and all analysis references were read, including equivalence, severity, foreign input formats and blockchain-specific qualifications. - The report keeps killed, surviving, equivalent, skipped, timed-out and unresolved cases separate; overall test adequacy is not inferred from a kill rate. - The bug-hunting workflow requires evidence from the original program and a reproduction before calling a bug confirmed. ### Not established by this review - No mutation engine, campaign, benchmark, test suite or proof of concept was run. - Foreign report parsers and every mewt/muton CLI example were not runtime-validated. The review applies to the material and revision named here. A newer upstream release can change its behavior. 03 / PUT IT TO WORK ## Add a skill to your workflow. Upstream setup instructions ↗ DOCUMENTED COMMAND npx skills add https://github.com/trailofbits/skills/tree/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing Copy command ↗ Copying does not execute this command. It may retrieve a newer version than the reviewed source. - Install the complete mutation-testing directory with its workflows and references. - Start with an existing report for analysis or bug investigation. Campaign setup needs a separate check of target paths, installed-engine help and the final duration estimate; preserve results before any purge. - Choose the intended host and project scope in the installer. The source revision is pinned; the installer itself is not executed or version-pinned by this review. ### Before you start - Node.js/npm and git for the documented Skills installer - The target repository and a working baseline test command - An existing mutation report for the recommended analysis workflow; mewt or muton is separately required if you choose to run a campaign ### Compatibility Claude Code · Codex ### Source, tests and mutation campaign data - Read source, tests and campaign results - Write configuration, analysis reports and authorized reproduction tests - Run test processes; optional purge commands delete stored campaign records ### Cost model CC BY-SA 4.0-licensed skill collection; mutation-engine terms, repeated local/CI test compute and agent usage remain separate. 04 / FOLLOW THE EVIDENCE ## The source trail. Our notes are separate from the original resource. Check upstream before adopting a new version. - Skill definition at reviewed revision ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/SKILL.md Supports: summary, upstreamDescription, whySelected, bestFor, limitations, review, access - Reviewed reference or helper: references/blockchain-patterns.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/blockchain-patterns.md Supports: review, limitations, install, access - Reviewed reference or helper: references/equivalent-mutants.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/equivalent-mutants.md Supports: review, limitations, install, access - Reviewed reference or helper: references/input-formats.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/input-formats.md Supports: review, limitations, install, access - Reviewed reference or helper: references/optimization-strategies.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/optimization-strategies.md Supports: review, limitations, install, access - Reviewed reference or helper: references/report-template.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/report-template.md Supports: review, limitations, install, access - Reviewed reference or helper: references/severity-classification.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/references/severity-classification.md Supports: review, limitations, install, access - Reviewed reference or helper: workflows/analyzing-results.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/workflows/analyzing-results.md Supports: review, limitations, install, access - Reviewed reference or helper: workflows/bug-hunter.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/workflows/bug-hunter.md Supports: review, limitations, install, access - Reviewed reference or helper: workflows/configuration.md ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/plugins/mutation-testing/skills/mutation-testing/workflows/configuration.md Supports: review, limitations, install, access - Publisher installation, compatibility and licensing guidance ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/README.md Supports: install, compatibility, access, license - Upstream licence at reviewed revision ↗ Checked 2026-09-21 https://github.com/trailofbits/skills/blob/32e34f8173796e3566a51aee877dc96bc5191f64/LICENSE Supports: license, access.cost - Skills installer: source formats and repeated skill selection ↗ Checked 2026-09-21 https://github.com/vercel-labs/skills/blob/7407f3893ad4dceab546ac002c3ef806e4000c73/README.md Supports: install - Skills installer: full commit SHA checkout support ↗ Checked 2026-09-21 https://github.com/vercel-labs/skills/blob/7407f3893ad4dceab546ac002c3ef806e4000c73/src/git.ts Supports: install - Skills installer: tree revision and subdirectory parsing ↗ Checked 2026-09-21 https://github.com/vercel-labs/skills/blob/7407f3893ad4dceab546ac002c3ef806e4000c73/src/source-parser.ts Supports: install KEEP COMPARING ## Other approaches to consider. Related by category or shared topics. These are alternatives to inspect, not a measured quality order. [### Bug Receipt ↗ Creates an evidence-bearing defect or incident handoff that distinguishes verified, partial and blocked outcomes.](/skills/github-bug-receipt/)[### Diagnosing Bugs ↗ A debugging procedure that establishes a reproducible symptom, tests competing explanations and preserves a regression check.](/skills/mattpocock-diagnosing-bugs/)[### Sentry Find Bugs ↗ Reviews a branch diff against surrounding code and existing tests, reporting only substantiated issues and explicit coverage limits.](/skills/getsentry-find-bugs/) [AI Tools ↗](/tools/)[Skills ↗](/skills/)[Agents ↗](/agents/)[MCP Servers ↗](/mcp-servers/)