← Explore all agents

MODEL DEVELOPMENT / Seth Hobson

LLM fine-tuning architect

A fine-tuning planning component that requires a baseline and can recommend a retrieval or prompting alternative.

“Fine-tuning strategist who owns the eval gate and method/model selection. Refuses to plan training without a baselined eval harness. Use PROACTIVELY when a user wants to fine-tune a model, before any training configuration exists.”

01 / THE REASONING

Why this made the selection.

  • It owns planning phases and must hand off a written brief rather than silently train or invent dataset-size guidance.
  • The brief includes a replay fraction even when zero is intentionally accepted and cites the source of model and memory assumptions.

02 / THE REVIEW RECORD

What we actually inspected.

Source review has boundaries.
A clear record is more useful than a “safe” badge.

Material inspected

  • plugins/llm-finetuning/agents/llm-finetuning-architect.md (pinned complete source retained)
  • LICENSE
  • Repository README and current official host configuration documentation
  • plugins/llm-finetuning/skills/finetuning-method-selection/SKILL.md

Our findings

  • It owns planning phases and must hand off a written brief rather than silently train or invent dataset-size guidance.
  • The brief includes a replay fraction even when zero is intentionally accepted and cites the source of model and memory assumptions.

Not established by this review

  • Source review only: no agent was installed or invoked. Task correctness, effective host restrictions and integration behaviour were not tested.

The review applies to the material and revision named here. A newer upstream release can change its behavior.

03 / PUT IT TO WORK

Use the role in your project.

Upstream setup instructions ↗
  1. Read the pinned source and its licence, then configure an explicitly bounded host context.
  2. Use the matching fine-tuning skills, current model catalogue and evaluation artifacts; resolve every referenced worksheet and budget before delegating training.
  3. Provide the target failure cases, existing evaluation baseline, dataset evidence and compute constraints.

Before you start

  • Matching llm-finetuning plugin reference material
  • Dataset rights and evaluation baseline
  • Available hardware and explicit compute budget

04 / FOLLOW THE EVIDENCE

The source trail.

Our notes are separate from the original resource.
Check upstream before adopting a new version.

  1. https://github.com/wshobson/agents/blob/46891e7e60da0e52baf1050b7b6391b64e84c6d9/plugins/llm-finetuning/agents/llm-finetuning-architect.md

    Supports: Workflow, inputs, outputs and stated boundaries

  2. Applicable licence ↗Checked

    https://github.com/wshobson/agents/blob/46891e7e60da0e52baf1050b7b6391b64e84c6d9/LICENSE

    Supports: Redistribution and attribution

  3. https://code.claude.com/docs/en/sub-agents.md

    Supports: Host loading and effective permission boundaries

  4. https://github.com/wshobson/agents/blob/46891e7e60da0e52baf1050b7b6391b64e84c6d9/plugins/llm-finetuning/skills/finetuning-method-selection/SKILL.md

    Supports: Dependency setup and source-review boundary

Evidence & Ask