Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → Fable 5 (xhigh)

Live run data

Anthropic

Fable 5 (xhigh)

xhigh reasoning effort · via Claude CLI · judged by Claude Sonnet 5 · the setting shown on the standings; also run at high73.9 medium68.8✳

Results from run ‘first’: ten items, ten verdicts.

Fable 5 (xhigh) scores 76 on craft, 12 points above the field’s 63 and 17 points short of the authors themselves. Its shape differs from the field’s: relatively strong on period detail and folding the brief into the story, relatively weak on restraint and momentum. On the mechanical checks it kept to the brief’s word range on 10 of 10 items and reproduced a 47-word run of the real book verbatim.

Headline 75.2 of 100 · compliance × craft
Compliance 100 of 100
Craft 76 of 100

The record: 10 items · 10 verdicts · 0 errors · 2,194 words on average · est. generation cost $8.83

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
78
Prose
77
Character
74
Scene
76
Integration
75
Momentum
74
Restraint
72
Specificity
78
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 76. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 85.1100852,386
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 80.0100802,419
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 78.8100792,330
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 77.0100772,207
Dracula item 015 · after ch. 5 · Bram Stoker 75.8100762,175
The Awakening item 016 · after ch. 7 · Kate Chopin 74.6100751,639
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 73.6100742,083
Persuasion item 001 · after ch. 1 · Jane Austen 71.0100712,078
The Moonstone item 011 · after ch. 8 · Wilkie Collins 70.295742,480
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 65.8100662,141

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The Secret Garden
2,386
Leave It to Psmith
2,419
The War of the Worlds
2,330
The Mysterious Affair at Styles
2,207
Dracula
2,175
The Awakening
1,639
The Sun Also Rises
2,083
Persuasion
2,078
The Moonstone
2,480
Red Harvest
2,141
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Ten of ten items landed inside their brief’s word range.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

The prose stacks up several separate similes near the end (the coin sewn into a hem, the shell with whorls, the lady in black's proverb about the water), which makes the quiet closing moment feel a little overworked instead of plain and understated the way Chopin usually is.

on The Awakening, item 016 · Claude Sonnet 5

Right when Jake is supposed to be holding something back, the chapter has him flatly announce 'what I felt... was that I loved her and that I was very miserable,' spelling out the exact feeling the rest of the book lets you infer.

on The Sun Also Rises, item 021 · Claude Sonnet 5

The closing paragraph slips into telling us Anne's feelings in a slightly overwritten wrap-up (calling Sir Walter's reaction being 'betrayed in his own citadel') instead of trusting a smaller, quieter image to do the work.

on Persuasion, item 001 · Claude Sonnet 5

The widow's confession basically hands the reader the whole solution at once (who tipped her, who bent over the body, that it was Thaler), which makes the mystery feel wrapped up rather than deepened.

on Red Harvest, item 023 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.