Skip to content

ARC-AGI-2 puzzles: with and without a harness

Best ARC Prize-verified score on the semi-private set, by model release date.

Topics: Benchmarks, Agents & METR

What this measures: Visual logic puzzles, each solved by at least two people, that AI found almost impossible in early 2025. A "harness" is extra code around the model that lets it try, check and refine answers.

  • Model alone (ARC's standard setup)
  • With a third-party refinement harness
  • Reference level
0%50%100%20252026Human panel (100%)Average test-taker (60%)

Model alone (ARC's standard setup), Saturated: The best model scores 95% (September 2026), and ARC Prize says ARC-AGI-1 and -2 are being overfit. Its focus has moved to the interactive ARC-AGI-3. Now watch: ARC-AGI-3.

With a third-party refinement harness, No new results · last data Feb 2026: No new verified harness result since February 2026: plain models overtook the harness systems (GPT-6 Astra scored 95% at $1.12 per task, versus 72.9% at $38.99 for the best harness), so there has been little reason to submit new ones.

The compute-capped ARC Prize 2025 Kaggle competition was won by NVARC with 24.0% at about $0.20 per task.

Source: ARC PrizeData as of 9 Nov 2026
Show data table and sources
SeriesDateLabelValue
Model alone (ARC's standard setup)20 Dec 2024o3-preview (low)4%
Model alone (ARC's standard setup)16 Apr 2025o3 (high)6.5%
Model alone (ARC's standard setup)14 May 2025Claude Opus 48.6%
Model alone (ARC's standard setup)9 Jul 2025Grok 4 (thinking)16%
Model alone (ARC's standard setup)6 Oct 2025GPT-5 Pro18%
Model alone (ARC's standard setup)18 Nov 2025Gemini 3 Pro31%
Model alone (ARC's standard setup)24 Nov 2025Claude Opus 4.538%
Model alone (ARC's standard setup)11 Dec 2025GPT-5.2 Pro (high)54%
Model alone (ARC's standard setup)5 Feb 2026Claude Opus 4.6 (high)69%
Model alone (ARC's standard setup)12 Feb 2026Gemini 3 Deep Think85%
Model alone (ARC's standard setup)22 Apr 2026GPT-5.5 (xhigh)85%
Model alone (ARC's standard setup)9 Jun 2026Claude Fable 5 (max)89%
Model alone (ARC's standard setup)9 Jul 2026GPT-5.6 Sol (max)93%
Model alone (ARC's standard setup)3 Sept 2026GPT-6 Astra (max)95%
With a third-party refinement harness7 Aug 2025Grok 4 + refinement (j_berman)29%
With a third-party refinement harness4 Dec 2025Gemini 3 Pro + Poetiq54%
With a third-party refinement harness3 Feb 2026GPT-5.2 + refinement (johan_land)73%
ReferenceHuman panel (100%)100%
ReferenceAverage test-taker (60%)60%

Entries with this chart