Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → Fable 5.1 (xhigh)

Live run data

Anthropic

Fable 5.1 (xhigh)

xhigh reasoning effort · via Claude CLI · judged by Claude Sonnet 5 · the setting shown on the standings; also run at medium75.4 high72.9 low72.6✳

Results from run ‘first’: ten items, ten verdicts.

Fable 5.1 (xhigh) scores 77 on craft, 14 points above the field’s 63 and 16 points short of the authors themselves. Its shape differs from the field’s: relatively strong on folding the brief into the story, relatively weak on character and building scenes. On the mechanical checks it kept to the brief’s word range on 8 of 10 items.

Headline 76.8 of 100 · compliance × craft
Compliance 100 of 100
Craft 77 of 100

The record: 10 items · 10 verdicts · 0 errors · 2,489 words on average · est. generation cost $14.49

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
79
Prose
78
Character
76
Scene
76
Integration
78
Momentum
76
Restraint
75
Specificity
79
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 77. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 81.2100812,203
Persuasion item 001 · after ch. 1 · Jane Austen 80.0100802,550
The Moonstone item 011 · after ch. 8 · Wilkie Collins 78.0100782,789
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 77.8100782,692
The Awakening item 016 · after ch. 7 · Kate Chopin 76.4100761,840
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 76.1100763,218
Dracula item 015 · after ch. 5 · Bram Stoker 75.1100752,586
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 74.995792,393
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 74.5100742,267
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 73.5100742,356

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The Sun Also Rises
2,203
Persuasion
2,550
The Moonstone
2,789
The Mysterious Affair at Styles
2,692
The Awakening
1,840
Leave It to Psmith
3,218
Dracula
2,586
The War of the Worlds
2,393
Red Harvest
2,267
The Secret Garden
2,356
01,0002,0003,0004,000
words; the ink tick marks each brief’s maximum

Eight of ten items landed inside their brief’s word range. The Awakening and Leave It to Psmith ran over by 40 and 418 words respectively.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

In a couple of places the story stops to spell out the meaning of a moment for the reader -- comparing Craven's face to "the rooms... shut up," or the closing string of sentences that flatly explains "Nobody would tell her... She would find out for herself" -- rather than trusting the reader to feel it.

on The Secret Garden, item 013 · Claude Sonnet 5

The invented 'Freddie has no money' speech takes over the whole interview and asks a fair bit of a reader's patience, since it isn't quite earned by anything Emsworth was previously shown to care sharply about.

on Leave It to Psmith, item 022 · Claude Sonnet 5

The dinner and several other beats are mostly reported after the fact in summary rather than staged moment-by-moment, so the chapter often tells you what happened instead of putting you in the room.

on Dracula, item 015 · Claude Sonnet 5

The ending drifts away from Robert's remark into swimming and moonlight imagery instead of closing tightly on it, so the required final beat feels a little diffuse rather than sharp.

on The Awakening, item 016 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.