Vol. I · No. 1 · MMXXVI
NextChapterBench A Benchmark of Literary Continuation
23 models · 10 items · 1 judge

The Standings → Muse Spark 1.3 (xhigh)

Live run data

Meta

Muse Spark 1.3 (xhigh)

xhigh reasoning effort · via OpenCode CLI · judged by Claude Sonnet 5 · not the setting shown on the standings; also run at medium60.1 high59.2

Results from run ‘first’: ten items, ten verdicts.

Muse Spark 1.3 (xhigh) scores 61 on craft, 2 points below the field’s 63 and 32 points short of the authors themselves. Its shape differs from the field’s: relatively strong on the author’s voice and restraint, relatively weak on momentum and building scenes. On the mechanical checks it kept to the brief’s word range on 4 of 10 items.

Headline 58.3 of 100 · compliance × craft
Compliance 96 of 100
Craft 61 of 100

The record: 10 items · 10 verdicts · 0 errors · 2,656 words on average · est. generation cost $0.59

Read the chapters in full

§ I

Craft by Dimension

Eight dimensions, each 0–100, averaged over ten items; the author’s real chapter was in the room every time.

Craft by dimension, 0–100 · judged by Sonnet 5 beside the author’s real chapter

Voice
65
Prose
61
Character
60
Scene
60
Integration
59
Momentum
58
Restraint
61
Specificity
63
0255075100
reader’s score, 0–100 · hollow tick: field average · filled tick: the authors themselves

The authors themselves average 93 on the five writing dimensions, the field 63, this model 61. Hover or focus a bar for the field and the authors on that dimension.

In plain words, item by item

The judge’s one-sentence best quality and worst flaw for each chapter, written for a general reader.


§ II

Per-Item Results

Headline, compliance and craft for each chapter, 0–100.

The same ten items in figures, with word counts.
Item Headline Compliance Craft Words
The Secret Garden item 013 · after ch. 2 · Frances Hodgson Burnett 74.0100742,721
The War of the Worlds item 006 · after ch. 1 · H. G. Wells 69.795732,660
Leave It to Psmith item 022 · after ch. 3 · P. G. Wodehouse 59.195623,167
The Mysterious Affair at Styles item 017 · after ch. 3 · Agatha Christie 57.795612,406
The Awakening item 016 · after ch. 7 · Kate Chopin 55.795592,795
Dracula item 015 · after ch. 5 · Bram Stoker 55.2100552,241
The Moonstone item 011 · after ch. 8 · Wilkie Collins 54.390603,076
Red Harvest item 023 · after ch. 2 · Dashiell Hammett 54.1100542,271
Persuasion item 001 · after ch. 1 · Jane Austen 53.895572,905
The Sun Also Rises item 021 · after ch. 3 · Ernest Hemingway 49.390552,314

§ III

Length Against the Brief

Words written per item, against each brief’s maximum.

Word count per item vs. brief maximum · run ‘first’

words written brief maximum
The Secret Garden
2,721
The War of the Worlds
2,660
Leave It to Psmith
3,167
The Mysterious Affair at Styles
2,406
The Awakening
2,795
Dracula
2,241
The Moonstone
3,076
Red Harvest
2,271
Persuasion
2,905
The Sun Also Rises
2,314
08001,6002,4003,200
words; the ink tick marks each brief’s maximum

Four of ten items landed inside their brief’s word range. The Secret Garden and The War of the Worlds and Leave It to Psmith and The Awakening and The Moonstone and Persuasion ran over by 321 and 60 and 367 and 995 and 276 and 305 words respectively.


§ IV

Worst Flaws, as Recorded

Each verdict names the chapter’s single worst flaw, with evidence. Quoted verbatim from run ‘first’.

The chapter tells the reader what to feel instead of showing it, going so far as to have Edna's private thought echo the novel's own opening sentence almost word for word ('inward life, which questions, and not... the outward existence which conforms'), which spells out the theme instead of trusting the scene.

on The Awakening, item 016 · Claude Sonnet 5

The letter that supposedly makes Franklin rush home turns out to be about carriage arrangements for a shopping trip, so his urgent four-hour dash never feels earned, and the chapter later has Miss Rachel serving as hostess at dinner right after flatly stating she never came down that day.

on The Moonstone, item 011 · Claude Sonnet 5

Some lines get too emotional or explain their own meaning out loud, like the widow swearing on her mother's grave or the narrator spelling out why Thaler's warning matters, which is more soap opera than the flat, tight-lipped style of the original.

on Red Harvest, item 023 · Claude Sonnet 5

It tells the reader what people feel (mortification, relief, astonishment) instead of dramatizing it, and it drops in a character, Mrs Clay, who has never been introduced in this story, which will confuse readers.

on Persuasion, item 001 · Claude Sonnet 5

§ V

The Mechanical Docket

Automated screening results across the ten outputs.