---
title: "Vector Forge: review, setup & limitations · Undominated.ai"
canonical: https://undominated.ai/skills/trailofbits-trailmark-vector-forge/
description: "Finds implementations of a cryptographic algorithm, runs mutation testing to locate escaped mutants, generates test vectors that exercise the uncovered paths, and compares mutation kill rates before and after."
---

# Vector Forge: review, setup & limitations · Undominated.ai

> Finds implementations of a cryptographic algorithm, runs mutation testing to locate escaped mutants, generates test vectors that exercise the uncovered paths, and compares mutation kill rates before and after.

[← Explore all skills](/skills/)

TESTING AND RELIABILITY / Trail of Bits

# Vector Forge

Finds implementations of a cryptographic algorithm, runs mutation testing to locate escaped mutants, generates test vectors that exercise the uncovered paths, and compares mutation kill rates before and after.

 [See setup guidance ↓](#setup)[Original source ↗](https://github.com/trailofbits/skills/tree/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/skills/vector-forge)

SOURCE REVIEW

 Reviewed 2026-10-22
 Evidence 6 linked sources
 Publisher Trail of Bits
 Licence [CC-BY-SA-4.0 ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/LICENSE)
 Revision 8e54050ae63c
 [Read what was—and wasn’t—checked ↓](#review)

“Mutation-driven test vector generation. Finds implementations of a cryptographic algorithm or protocol, runs mutation testing to identify escaped mutants, then generates new test vectors that deliberately exercise the uncovered code paths. Compares before/after mutation kill rates to prove vector effectiveness. Use when generating cryptographic test vectors, measuring Wycheproof coverage gaps, finding escaped mutants via mutation testing, creating cross-implementation test suites, or improving test vector coverage for crypto primitives.”

 [Trail of Bits · upstream description ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/skills/vector-forge/SKILL.md) Our analysis follows below.

01 / THE REASONING

## Why this made the selection.

 - Finds a crypto implementation, runs mutation testing to identify escaped mutants, then generates test vectors that exercise the uncovered code paths.
- Measures vector effectiveness by re-running mutation testing and comparing kill rates, and writes VECTOR_FORGE_REPORT.md with the before/after delta.

### A good fit for

 - Generate crypto test vectors that exercise mutation-escaped code paths
- Measure Wycheproof-style coverage gaps for a primitive
- Show whether new vectors raise the mutation kill rate

### Weigh up before choosing

 - It installs the tools it needs: `uv tool install trailmark` when missing, and mutation frameworks per references/mutation-frameworks.md, whose Installation Policy says they MUST be installed (cargo install, brew, go install …@latest, sudo package managers).
- For Mull on Ubuntu/Debian and RHEL/Fedora, that reference's first option pipes a remote Cloudsmith setup script into `sudo -E bash`.
- It needs at least one implementation in a language with mutation-testing support and a harness that consumes vectors; it is not for application logic.
- Named frameworks are gremlins (Go), cargo-mutants (Rust), mutmut (Python) and Mull (C/C++).
- Installs with the whole `trailmark` plugin — and the Trailmark CLI via `uv tool install trailmark` — not as a standalone Vector Forge skill.
- Last commit touching plugins/trailmark/skills/vector-forge at the pinned revision: 2026-09-16.
- Not executed: it was not installed or run.

02 / THE REVIEW RECORD

## What we actually inspected.

Source review has boundaries. A clear record is more useful than a “safe” badge.

### Material inspected

 - plugins/trailmark/skills/vector-forge/SKILL.md
- plugins/trailmark/skills/vector-forge/references/mutation-frameworks.md
- plugins/trailmark/README.md (prerequisites and version notes)
- plugins/trailmark/agents/code-slice-worker.md (host note)
- README.md (installation and licence sections)
- LICENSE

### Our findings

 - Vector Forge's SKILL.md frontmatter declares no allowed-tools.
- The workflow runs discovery, harness, baseline, escape analysis, vector generation and validation, ending in a coverage report and new vectors.
- VECTOR_FORGE_REPORT.md covers the baseline, escape analysis, new vectors, after results and the before/after delta.

### Not established by this review

 - Not executed: it was not installed or run.
- The Vector Forge skill and any bundled scripts were not run.

The review applies to the material and revision named here. A newer upstream release can change its behavior.

03 / PUT IT TO WORK

## Add a skill to your workflow.

[Upstream setup instructions ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/README.md)
 - `/plugin marketplace add trailofbits/skills` (repository README) adds the whole Trail of Bits marketplace, not one skill.
- Install the `trailmark` plugin from `/plugin menu`; it bundles the Vector Forge skill with the other trailmark skills listed in the trailmark plugin README.
- `uv tool install trailmark` (trailmark plugin README) installs the Trailmark CLI that this skill drives.

### Before you start

 - The Trailmark CLI, installed with `uv tool install trailmark` (trailmark plugin README)
- uv
- At least one implementation of the target algorithm in a language with mutation-testing support
- A test harness that consumes test vectors
- A mutation-testing framework for the target language; the skill installs one if it is missing

### Compatibility

Claude Code

### Installs and runs Trailmark and mutation frameworks; writes vectors and a report

 - Vector Forge declares no allowed-tools, so tool use follows the host's settings
- Install missing tools: `uv tool install trailmark` and the mutation framework per references/mutation-frameworks.md
- Run Trailmark and a mutation framework over the implementation
- Write or adapt a test-vector harness, new test vectors and VECTOR_FORGE_REPORT.md

### Cost model

CC-BY-SA-4.0. The Vector Forge skill's files name no paid service.

04 / FOLLOW THE EVIDENCE

## The source trail.

Our notes are separate from the original resource. Check upstream before adopting a new version.

 - [Vector Forge SKILL.md ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/skills/vector-forge/SKILL.md) Checked 2026-10-22 https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/skills/vector-forge/SKILL.md Supports: upstreamDescription, summary, whySelected, bestFor, limitations, access, review.findings
- [Vector Forge mutation-frameworks reference ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/skills/vector-forge/references/mutation-frameworks.md) Checked 2026-10-22 https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/skills/vector-forge/references/mutation-frameworks.md Supports: limitations, access.permissions
- [trailmark plugin README ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/README.md) Checked 2026-10-22 https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/README.md Supports: install.prerequisites, install.steps
- [trailmark code-slice-worker agent (names Claude Code as host) ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/agents/code-slice-worker.md) Checked 2026-10-22 https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/plugins/trailmark/agents/code-slice-worker.md Supports: compatibility
- [trailofbits/skills README ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/README.md) Checked 2026-10-22 https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/README.md Supports: install.steps, license
- [trailofbits/skills LICENSE ↗](https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/LICENSE) Checked 2026-10-22 https://raw.githubusercontent.com/trailofbits/skills/8e54050ae63c2f62224c35b1616efe71865b4777/LICENSE Supports: license

KEEP COMPARING

## Other approaches to consider.

Related by category or shared topics. These are alternatives to inspect, not a measured quality order.

 [### Genotoxic ↗ Builds a Trailmark graph, runs a mutation-testing framework and, where supported, necessist, and uses survived mutants, unnecessary test statements and call-graph data to sort findings into false positives, missing unit tests and fuzzing targets.](/skills/trailofbits-trailmark-genotoxic/)[### Trail of Bits Mutation Analysis ↗ Interprets mutation campaign results and turns survivors into qualified test-gap reports or separately reproduced bug findings.](/skills/trailofbits-mutation-testing/)[### Bug Receipt ↗ Creates an evidence-bearing defect or incident handoff that distinguishes verified, partial and blocked outcomes.](/skills/github-bug-receipt/)

 [AI Tools ↗](/tools/)[Skills ↗](/skills/)[Agents ↗](/agents/)[MCP Servers ↗](/mcp-servers/)[Workflows ↗](/workflows/)

## Continue your investigation

 - [Choose a toolkit](/tools/)
- [Inspect execution hosts](/agents/)
- [Check tool access](/mcp-servers/)
- [Check project dependencies](/check-repo/)
