Does the standard hold across OpenAI's models?

Every model the Benchmark tests from OpenAI, checked against one line: with guidance, fewer than 10 in 100 drafts needing revision.

Human-centered language, with guidance

68 drafts per model · bar shows the 95% interval · dashed line at 10%

GPT-5.6 Luna Settled, predecessor in a pair

1 of 68 need revision (1.5%), interval 0.3 to 7.9%. Without guidance: 10.3%.

Holds

GPT-6 Astra Settled

2 of 68 need revision (2.9%), interval 0.8 to 10.1%. Without guidance: 2.9%.

Can’t tell yet

GPT-6 Luna First look, paired

0 of 68 need revision (0.0%), interval 0.0 to 5.3%. Without guidance: 5.9%.

Holds

GPT-6.1 Sol First look

2 of 68 need revision (2.9%), interval 0.8 to 10.1%. Without guidance: 2.9%.

Can’t tell yet

Holds: the whole interval sits under the line. Falls short: the whole interval sits above it. Can't tell yet: the interval crosses the line, and more drafts are needed to say.

Trauma-informed language, with guidance

24 drafts per model · bar shows the 95% interval · dashed line at 10%

GPT-5.6 Luna Settled, predecessor in a pair

3 of 24 need revision (12.5%), interval 4.3 to 31.0%. Without guidance: 20.8%.

Can’t tell yet

GPT-6 Astra Settled

0 of 24 need revision (0.0%), interval 0.0 to 13.8%. Without guidance: 8.3%.

Can’t tell yet

GPT-6 Luna First look, paired

2 of 24 need revision (8.3%), interval 2.3 to 25.8%. Without guidance: 8.3%.

Can’t tell yet

GPT-6.1 Sol First look

0 of 24 need revision (0.0%), interval 0.0 to 13.8%. Without guidance: 8.3%.

Can’t tell yet

Holds: the whole interval sits under the line. Falls short: the whole interval sits above it. Can't tell yet: the interval crosses the line, and more drafts are needed to say.

Generations in this lab

GPT-5.6 Luna to GPT-6 Luna, same run. With guidance: no detectable change. Without guidance: no detectable change.

New models, in detail

OpenAI models the Benchmark doesn't test

This list comes from the lineage registry, which isn't built yet. It will name each untested model and why, so silence never reads as a pass.

Table design inspired by EQ-Bench, by Sam Paech. Benchmark engineered by MKTNG.

Tell us