Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → GPT‑6 Astra (high)

Live run data

OpenAI

GPT‑6 Astra (high)

high reasoning effort · via Codex CLI · judged by Claude Sonnet 5 · the setting shown on the standings; also run at low70.2 medium70.1 xhigh68.6

Results from run ‘first’: ten items, ten verdicts.

GPT‑6 Astra (high) scores 73 on craft, 10 points above the field’s 63 and 20 points short of the authors themselves. Its shape differs from the field’s: relatively strong on restraint and folding the brief into the story, relatively weak on momentum and period detail. On the mechanical checks it kept to the brief’s word range on 10 of 10 items.

Headline 73.0 of 100 · compliance × craft
Compliance 100 of 100
Craft 73 of 100

The record: 10 items · 10 verdicts · 0 errors · 2,328 words on average · est. generation cost $3.84

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
73
Prose
73
Character
73
Scene
74
Integration
74
Momentum
70
Restraint
77
Specificity
73
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 73. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 79.9100802,409
The Moonstone item 011 · after ch. 8 · Wilkie Collins 77.2100772,570
Persuasion item 001 · after ch. 1 · Jane Austen 76.5100762,499
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 76.1100762,482
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 73.8100742,322
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 72.1100722,191
Dracula item 015 · after ch. 5 · Bram Stoker 71.6100722,253
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 71.695752,500
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 66.8100672,351
The Awakening item 016 · after ch. 7 · Kate Chopin 64.6100651,700

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The War of the Worlds
2,409
The Moonstone
2,570
Persuasion
2,499
The Mysterious Affair at Styles
2,482
The Secret Garden
2,322
The Sun Also Rises
2,191
Dracula
2,253
Leave It to Psmith
2,500
Red Harvest
2,351
The Awakening
1,700
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Ten of ten items landed inside their brief’s word range.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

Several exchanges, especially the joking back-and-forth about lawyer's advice, feel padded and slightly mechanical, and the final line lands as a checklist item being ticked off rather than a natural beat.

on The Moonstone, item 011 · Claude Sonnet 5

The writing is clear and well-organized but a little flat and functional, missing the sly, teasing narrator's voice that makes Austen's own sentences fun to read even when nothing much is happening.

on Persuasion, item 001 · Claude Sonnet 5

Some of the invented business, like the stranger sketching a portrait at the next café table, feels like decorative filler rather than something that reveals character or moves the story forward.

on The Sun Also Rises, item 021 · Claude Sonnet 5

Psmith's trademark "Comrade" address, which defines his voice throughout the book, is used only once, so the dialogue reads as generic clever banter rather than distinctly Psmith.

on Leave It to Psmith, item 022 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.