MODEL DEVELOPMENT / Seth Hobson
LLM fine-tuning architect
A fine-tuning planning component that requires a baseline and can recommend a retrieval or prompting alternative.
“Fine-tuning strategist who owns the eval gate and method/model selection. Refuses to plan training without a baselined eval harness. Use PROACTIVELY when a user wants to fine-tune a model, before any training configuration exists.”
01 / THE REASONING
Why this made the selection.
- It owns planning phases and must hand off a written brief rather than silently train or invent dataset-size guidance.
- The brief includes a replay fraction even when zero is intentionally accepted and cites the source of model and memory assumptions.
02 / THE REVIEW RECORD
What we actually inspected.
Source review has boundaries.
A clear record is more useful than a “safe” badge.
Material inspected
- plugins/llm-finetuning/agents/llm-finetuning-architect.md (pinned complete source retained)
- LICENSE
- Repository README and current official host configuration documentation
- plugins/llm-finetuning/skills/finetuning-method-selection/SKILL.md
Our findings
- It owns planning phases and must hand off a written brief rather than silently train or invent dataset-size guidance.
- The brief includes a replay fraction even when zero is intentionally accepted and cites the source of model and memory assumptions.
Not established by this review
- Source review only: no agent was installed or invoked. Task correctness, effective host restrictions and integration behaviour were not tested.
The review applies to the material and revision named here. A newer upstream release can change its behavior.
03 / PUT IT TO WORK
Use the role in your project.
- Read the pinned source and its licence, then configure an explicitly bounded host context.
- Use the matching fine-tuning skills, current model catalogue and evaluation artifacts; resolve every referenced worksheet and budget before delegating training.
- Provide the target failure cases, existing evaluation baseline, dataset evidence and compute constraints.
Before you start
- Matching llm-finetuning plugin reference material
- Dataset rights and evaluation baseline
- Available hardware and explicit compute budget
04 / FOLLOW THE EVIDENCE
The source trail.
Our notes are separate from the original resource.
Check upstream before adopting a new version.
https://github.com/wshobson/agents/blob/46891e7e60da0e52baf1050b7b6391b64e84c6d9/plugins/llm-finetuning/agents/llm-finetuning-architect.md
Supports: Workflow, inputs, outputs and stated boundaries
- Applicable licence ↗Checked
https://github.com/wshobson/agents/blob/46891e7e60da0e52baf1050b7b6391b64e84c6d9/LICENSE
Supports: Redistribution and attribution
https://code.claude.com/docs/en/sub-agents.md
Supports: Host loading and effective permission boundaries
- Pinned inspected source: plugins/llm-finetuning/skills/finetuning-method-selection/SKILL.md ↗Checked
https://github.com/wshobson/agents/blob/46891e7e60da0e52baf1050b7b6391b64e84c6d9/plugins/llm-finetuning/skills/finetuning-method-selection/SKILL.md
Supports: Dependency setup and source-review boundary