Does the standard hold across OpenAI's models?

Every model the Benchmark tests from OpenAI, checked against one line: with guidance, fewer than 10 in 100 drafts needing revision.

Human-centered language, with guidance

68 drafts per model · bar shows the 95% interval · dashed line at 10%

GPT-6 Astra Settled

1 of 68 need revision (1.5%), interval 0.3 to 7.9%. Without guidance: 4.4%.

Holds

GPT-6 Luna Settled

0 of 68 need revision (0.0%), interval 0.0 to 5.3%. Without guidance: 4.4%.

Holds

GPT-6.1 Sol Settled

1 of 68 need revision (1.5%), interval 0.3 to 7.9%. Without guidance: 4.4%.

Holds

GPT-6.1 Terra First look

2 of 68 need revision (2.9%), interval 0.8 to 10.1%. Without guidance: 8.8%.

Can’t tell yet

Holds: the whole interval sits under the line. Falls short: the whole interval sits above it. Can't tell yet: the interval crosses the line, and more drafts are needed to say.

Trauma-informed language, with guidance

24 drafts per model · bar shows the 95% interval · dashed line at 10%

GPT-6 Astra Settled

0 of 24 need revision (0.0%), interval 0.0 to 13.8%. Without guidance: 8.3%.

Can’t tell yet

GPT-6 Luna Settled

2 of 24 need revision (8.3%), interval 2.3 to 25.8%. Without guidance: 8.3%.

Can’t tell yet

GPT-6.1 Sol Settled

0 of 24 need revision (0.0%), interval 0.0 to 13.8%. Without guidance: 8.3%.

Can’t tell yet

GPT-6.1 Terra First look

3 of 24 need revision (12.5%), interval 4.3 to 31.0%. Without guidance: 16.7%.

Can’t tell yet

Holds: the whole interval sits under the line. Falls short: the whole interval sits above it. Can't tell yet: the interval crosses the line, and more drafts are needed to say.

Generations in this lab

No same-run pair this month.

New models, in detail

OpenAI models the Benchmark doesn't test

This list comes from the lineage registry, which isn't built yet. It will name each untested model and why, so silence never reads as a pass.

Table design inspired by EQ-Bench, by Sam Paech. Benchmark engineered by MKTNG.