Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → Fable 5 (medium)

Live run data

Anthropic

Fable 5 (medium)

medium reasoning effort · via Claude CLI · judged by Claude Sonnet 5 · not the setting shown on the standings; also run at xhigh75.2 high73.9

Results from run ‘first’: nine items, nine verdicts.

Fable 5 (medium) scores 71 on craft, 8 points above the field’s 63 and 22 points short of the authors themselves. Its shape differs from the field’s mainly in being relatively weak on folding the brief into the story. On the mechanical checks it kept to the brief’s word range on 9 of 9 items and reproduced a 103-word run of the real book verbatim.

Headline 68.8 of 100 · compliance × craft
Compliance 97 of 100
Craft 71 of 100

The record: 9 items · 9 verdicts · 0 errors · 2,175 words on average · est. generation cost $2.44

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over nine items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
73
Prose
72
Character
71
Scene
72
Integration
67
Momentum
71
Restraint
69
Specificity
73
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 71. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same nine items in figures, with word counts.
Item Headline Compliance Craft Words
The Moonstone item 011 · after ch. 8 · Wilkie Collins 73.995782,494
Dracula item 015 · after ch. 5 · Bram Stoker 73.0100731,972
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 72.0100722,249
The Awakening item 016 · after ch. 7 · Kate Chopin 71.695751,504
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 69.6100702,356
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 67.5100682,298
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 66.995702,287
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 66.190742,230
Persuasion item 001 · after ch. 1 · Jane Austen 58.295612,183

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The Moonstone
2,494
Dracula
1,972
The Sun Also Rises
2,249
The Awakening
1,504
Leave It to Psmith
2,356
Red Harvest
2,298
The War of the Worlds
2,287
The Mysterious Affair at Styles
2,230
Persuasion
2,183
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Nine of nine items landed inside their brief’s word range.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

Large stretches of dialogue and description (Sir Walter's 'What! every comfort of life knocked off!' speech; the description of Mr Shepherd as one who 'would rather have the disagreeable prompted by any body else') are lifted almost word-for-word from the real published novel rather than newly written, and the borrowed material doesn't always fit its new context.

on Persuasion, item 001 · Claude Sonnet 5

Large stretches — the opening taxi route and the closing 'hard-boiled' sentence — are copied almost word for word from the real published book, and the Count's 'arrow wounds' story is lifted from a much later chapter, so it reads less like original writing than like patchwork from the source novel.

on The Sun Also Rises, item 021 · Claude Sonnet 5

A strange, dangling line in the lawyer's letter — 'Septimus Luker being in no way concerned in this' — names a person from nowhere with no explanation, and even the narrator admits he never understood it, which reads like an unfinished idea rather than a mystery.

on The Moonstone, item 011 · Claude Sonnet 5

Its opening three sentences are copied almost word-for-word from the real published novel instead of being original, and it also confusingly gives two unrelated characters the same surname, Henderson, without explanation.

on The War of the Worlds, item 006 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the nine outputs.