sirdocalot · measured 20 August 2026 · Opus 5

What handing over costs

Comparing generating a brief with Sir DocAlot against generating an artifact with Claude Code.


The experiment

A Claude Code session had been working in this repository for a few hours — reading files, running tests, changing code. The work was finished and needed to go to a person.

We forked that session twice. Both forks inherited the same 219,172 tokens of context, so the only thing separating them was the instruction, and the instructions differed by a single sentence.

Hand the current state of this benchmark work to the operator, so they can read it at their own pace rather than out of this transcript — what was measured, what was found, what is still open, and what needs their decision.
Fork AUse sirdocalot: create a brief for them.
Fork BProduce it as a published Claude artifact they can open at a link.
When you are done, reply with only the URL and nothing else.

Three pairs ran that way. Every fork published something a person can open, and neither was told how much effort to spend.

What the brief saved

Fork A measured against fork B, median of the three pairs. Every figure is the brief costing less.

58%

Fewer tokens written

Output tokens, thinking excluded — 2.4× less. Range across pairs: 55% to 72%.

72%

Less context added

What the handover left behind in the session that ran it — 3.5× less.

65%

Less time waiting

Wall clock, from the instruction to a published link — 2.9× less.

What each fork did

Fork A — brief

1 tool call
Bash
Tokens written
3,497
Context added
5,138
Turns
4
Wall clock
61s

Fork B — artifact

3 tool calls
Skill→ Write→ Artifact
Tokens written
8,262
Context added
17,307
Turns
7
Wall clock
161s

Pair one. Fork B loaded a design skill without being asked to; nothing in either prompt mentioned design.

All three pairs

 Pair 1Pair 2Pair 3
Tokens written
Brief3,4973,1944,413
Artifact8,26211,5349,884
Ratio2.36×3.61×2.24×
Context added
Brief5,1384,7605,675
Artifact17,30724,11319,932
Ratio3.37×5.07×3.51×
Wall clock
Brief61s59s66s
Artifact161s232s189s
Ratio2.63×3.95×2.88×
Tool calls
Brief112
Artifact354
Turns
Brief446
Artifact71210

Two artifact links are missing for the same reason: publishing an artifact from a session updates that session's artifact rather than making a second one. Pair 2's fork republished over pair 1's, and this page was later published over the same one. The numbers come from the transcripts, not the artifacts, so they are unaffected.


What this does not claim