sirdocalot · measured 20 August 2026 · Opus 5
Comparing generating a brief with Sir DocAlot against generating an artifact with Claude Code.
A Claude Code session had been working in this repository for a few hours — reading files, running tests, changing code. The work was finished and needed to go to a person.
We forked that session twice. Both forks inherited the same 219,172 tokens of context, so the only thing separating them was the instruction, and the instructions differed by a single sentence.
Three pairs ran that way. Every fork published something a person can open, and neither was told how much effort to spend.
Fork A measured against fork B, median of the three pairs. Every figure is the brief costing less.
Fewer tokens written
Output tokens, thinking excluded — 2.4× less. Range across pairs: 55% to 72%.
Less context added
What the handover left behind in the session that ran it — 3.5× less.
Less time waiting
Wall clock, from the instruction to a published link — 2.9× less.
Pair one. Fork B loaded a design skill without being asked to; nothing in either prompt mentioned design.
| Pair 1 | Pair 2 | Pair 3 | |
|---|---|---|---|
| Tokens written | |||
| Brief | 3,497 | 3,194 | 4,413 |
| Artifact | 8,262 | 11,534 | 9,884 |
| Ratio | 2.36× | 3.61× | 2.24× |
| Context added | |||
| Brief | 5,138 | 4,760 | 5,675 |
| Artifact | 17,307 | 24,113 | 19,932 |
| Ratio | 3.37× | 5.07× | 3.51× |
| Wall clock | |||
| Brief | 61s | 59s | 66s |
| Artifact | 161s | 232s | 189s |
| Ratio | 2.63× | 3.95× | 2.88× |
| Tool calls | |||
| Brief | 1 | 1 | 2 |
| Artifact | 3 | 5 | 4 |
| Turns | |||
| Brief | 4 | 4 | 6 |
| Artifact | 7 | 12 | 10 |
Two artifact links are missing for the same reason: publishing an artifact from a session updates that session's artifact rather than making a second one. Pair 2's fork republished over pair 1's, and this page was later published over the same one. The numbers come from the transcripts, not the artifacts, so they are unaffected.