Skip to content

ARC-AGI-3: interactive puzzle games

Best ARC Prize score on the semi-private set. Standard harness vs a lab's own harness.

Topics: Benchmarks, Agents & METR

What this measures: Hundreds of small turn-based games with no instructions: the AI has to explore, work out the rules and win in as few moves as possible. Every game was beaten by human testers; 100% means matching a typical first-time human player's efficiency on every game.

  • ARC's standard harness
  • Lab's own harness (provider adapter)
  • Reference level
0%50%100%Typical first-time human player (100%)

Every model tested both ways scored far higher with its lab's own harness, which lets it keep its hidden reasoning between moves. Dates are model release dates. ARC Prize 2026 competition results are due on 4 December 2026.

Sources: ARC Prize, ARC Prize FoundationData as of 10 Nov 2026
Show data table and sources
SeriesDateModelValue
ARC's standard harness25 Mar 2026Best frontier AI at launch0.5%
ARC's standard harness1 Jun 2026Claude Opus 4.8 (high)1.5%
ARC's standard harness9 Jul 2026GPT-5.6 Sol (max)7.8%
ARC's standard harness24 Jul 2026Claude Opus 5 (high)30%
ARC's standard harness2 Sept 2026Gemini 3.8 Flash10%
ARC's standard harness3 Sept 2026GPT-6 Astra (max)63%
ARC's standard harness28 Sept 2026Claude Sonnet 5.524%
ARC's standard harness29 Sept 2026GPT-6.1 Sol53%
ARC's standard harness30 Sept 2026Gemini 4 Argon50%
ARC's standard harness9 Nov 2026Claude Fable 5.281%
Lab's own harness (provider adapter)2 Sept 2026Gemini 3.8 Flash + adapter35%
Lab's own harness (provider adapter)3 Sept 2026GPT-6 Astra + OpenAI adapter100%
Lab's own harness (provider adapter)28 Sept 2026Claude Sonnet 5.5 + adapter72%
Lab's own harness (provider adapter)29 Sept 2026GPT-6.1 Sol + adapter96%
Lab's own harness (provider adapter)30 Sept 2026Gemini 4 Argon + adapter98%
Lab's own harness (provider adapter)9 Nov 2026Claude Fable 5.2 + adapter98%
ReferenceTypical first-time human player (100%)100%

Entries with this chart