Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → Claude Sonnet 5 (xhigh)

Live run data

Anthropic

Claude Sonnet 5 (xhigh)

xhigh reasoning effort · via Claude CLI · judged by Claude Sonnet 5 · not the setting shown on the standings; also run at high60.8 medium60.0 low55.9

Results from run ‘first’: ten items, ten verdicts.

Claude Sonnet 5 (xhigh) scores 65 on craft, 2 points above the field’s 63 and 28 points short of the authors themselves. Its shape differs from the field’s: relatively strong on character and sentence-level prose, relatively weak on building scenes and folding the brief into the story. On the mechanical checks it kept to the brief’s word range on 8 of 10 items and reproduced a 153-word run of the real book verbatim.

Headline 60.4 of 100 · compliance × craft
Compliance 92 of 100
Craft 65 of 100

The record: 10 items · 10 verdicts · 0 errors · 2,050 words on average · est. generation cost $0.69

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
67
Prose
67
Character
67
Scene
64
Integration
62
Momentum
64
Restraint
64
Specificity
66
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 65. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 74.5100741,567
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 67.490752,700
The Moonstone item 011 · after ch. 8 · Wilkie Collins 62.395662,535
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 62.085732,346
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 61.595652,085
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 60.8100612,257
Dracula item 015 · after ch. 5 · Bram Stoker 57.695611,464
Persuasion item 001 · after ch. 1 · Jane Austen 57.490642,099
The Awakening item 016 · after ch. 7 · Kate Chopin 57.095601,412
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 43.580542,040

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The Sun Also Rises
1,567
Leave It to Psmith
2,700
The Moonstone
2,535
The War of the Worlds
2,346
The Secret Garden
2,085
The Mysterious Affair at Styles
2,257
Dracula
1,464
Persuasion
2,099
The Awakening
1,412
Red Harvest
2,040
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Eight of ten items landed inside their brief’s word range.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

By having a stranger's letter reveal Jonathan already hospitalized with brain fever and then a telegram saying he's fully cured and sailing home, the chapter resolves the whole Transylvania ordeal in one leap, which deflates the slow dread the real story depends on, and the line about him raving of 'matters so wild and so confused' sails a little too close to hinting at what actually happened to him.

on Dracula, item 015 · Claude Sonnet 5

The opening station scene (the station-master's greeting, Mrs Medlock's reply, and the surrounding narration) is reproduced almost word-for-word from the real published chapter rather than being the candidate's own writing, so a meaningful stretch of the chapter isn't an original continuation at all.

on The Secret Garden, item 013 · Claude Sonnet 5

The supposedly menacing note from Thaler is a generic, unsigned threat -- "There is a nine o'clock train" -- and the story never actually confirms on the page that it's from him, so the required beat feels hedged rather than delivered.

on Red Harvest, item 023 · Claude Sonnet 5

The story-telling leans on convenient devices — a maid who happens to blurt out a clue, a mysterious object Poirot won't explain — that feel like puzzle pieces being placed rather than real moments between real people.

on The Mysterious Affair at Styles, item 017 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.