Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → Claude Sonnet 5 (low)

Live run data

Anthropic

Claude Sonnet 5 (low)

low reasoning effort · via Claude CLI · judged by Claude Sonnet 5 · not the setting shown on the standings; also run at high60.8 xhigh60.4 medium60.0

Results from run ‘first’: ten items, ten verdicts.

Claude Sonnet 5 (low) scores 60 on craft, 3 points below the field’s 63 and 33 points short of the authors themselves. Its shape differs from the field’s: relatively strong on restraint, relatively weak on folding the brief into the story and building scenes. On the mechanical checks it kept to the brief’s word range on 7 of 10 items and reproduced a 46-word run of the real book verbatim.

Headline 55.9 of 100 · compliance × craft
Compliance 93 of 100
Craft 60 of 100

The record: 10 items · 10 verdicts · 0 errors · 1,912 words on average · est. generation cost $0.34

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
62
Prose
60
Character
61
Scene
59
Integration
57
Momentum
59
Restraint
60
Specificity
62
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 60. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
Persuasion item 001 · after ch. 1 · Jane Austen 68.895721,926
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 67.1100671,936
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 63.0100631,260
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 58.295612,603
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 55.990622,258
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 55.690621,860
The Awakening item 016 · after ch. 7 · Kate Chopin 49.585581,436
The Moonstone item 011 · after ch. 8 · Wilkie Collins 48.495512,563
Dracula item 015 · after ch. 5 · Bram Stoker 47.685561,302
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 45.095471,976

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
Persuasion
1,926
The Secret Garden
1,936
The Sun Also Rises
1,260
Leave It to Psmith
2,603
The War of the Worlds
2,258
The Mysterious Affair at Styles
1,860
The Awakening
1,436
The Moonstone
2,563
Dracula
1,302
Red Harvest
1,976
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Seven of ten items landed inside their brief’s word range.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

The description of Edna's first swim ("A quick vision of death smote her soul, and for a second appalled and enfeebled her senses") is lifted almost verbatim from the real novel's later swimming chapter rather than freshly written, and on top of that Adèle is shown warning Robert off Edna, which the brief explicitly forbade.

on The Awakening, item 016 · Claude Sonnet 5

Partway through, the narration suddenly glitches into a stray foreign character with a nonsensical aside about the pen 'slipping into a language I don't know,' which breaks the illusion that this is Betteredge's own handwritten account and jars the reader out of the story.

on The Moonstone, item 011 · Claude Sonnet 5

Large stretches of dialogue (the stationmaster's greeting, Mrs. Medlock's replies) are lifted almost word-for-word from the real book, so the chapter feels stitched together rather than freshly imagined.

on The Secret Garden, item 013 · Claude Sonnet 5

The ending spells out Jake's mood ('tired and a little sad, and not really about anything I could have put a name to') too plainly, telling the reader the feeling instead of letting the scene carry it.

on The Sun Also Rises, item 021 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.