Does the standard hold across Google's models?

Every model the Benchmark tests from Google, checked against one line: with guidance, fewer than 10 in 100 drafts needing revision.

Human-centered language, with guidance

68 drafts per model · bar shows the 95% interval · dashed line at 10%

Gemini 3.8 Flash Settled

0 of 68 need revision (0.0%), interval 0.0 to 5.3%. Without guidance: 48.5%.

Holds

Gemini 4 Argon First look

0 of 68 need revision (0.0%), interval 0.0 to 5.3%. Without guidance: 52.9%.

Holds

Gemma 4 31B Settled

3 of 68 need revision (4.4%), interval 1.5 to 12.2%. Without guidance: 64.7%.

Can’t tell yet

Holds: the whole interval sits under the line. Falls short: the whole interval sits above it. Can't tell yet: the interval crosses the line, and more drafts are needed to say.

Trauma-informed language, with guidance

24 drafts per model · bar shows the 95% interval · dashed line at 10%

Gemini 3.8 Flash Settled

0 of 24 need revision (0.0%), interval 0.0 to 13.8%. Without guidance: 54.2%.

Can’t tell yet

Gemini 4 Argon First look

0 of 24 need revision (0.0%), interval 0.0 to 13.8%. Without guidance: 62.5%.

Can’t tell yet

Gemma 4 31B Settled

4 of 24 need revision (16.7%), interval 6.7 to 35.9%. Without guidance: 58.3%.

Can’t tell yet

Holds: the whole interval sits under the line. Falls short: the whole interval sits above it. Can't tell yet: the interval crosses the line, and more drafts are needed to say.

Generations in this lab

No same-run pair this month.

New models, in detail

Google models the Benchmark doesn't test

This list comes from the lineage registry, which isn't built yet. It will name each untested model and why, so silence never reads as a pass.

Table design inspired by EQ-Bench, by Sam Paech. Benchmark engineered by MKTNG.

Tell us