- 6 mosame record as now
- 1 yrsame record as now
- 2 yr$0.13Gemini 1.5 Flash2.8× cheaper
- 3 yr$15GPT-4 Turbo316× cheaper
Price per IQ
What a fixed level of capability costs, and how fast that price falls.
Progress over time
- 6 mo$0.17Gemini 3 Flash Preview (high)15× cheaper
- 1 yr$8.42Grok 4 refinement system714× cheaper
- 2 yrno result yet
- 3 yrno result yet
- 6 mo123 pointsGrok 4+13 points
- 1 yr96.5 pointso1+40 points
- 2 yr85.5 pointsClaude 3+51 points
- 3 yrtest didn’t exist yet
Charts
Price of GPT-4-level performance
Cheapest non-reasoning model scoring at least GPT-4's level (≥33% on GPQA Diamond), USD per million tokens (3:1 input:output blend). Log scale.
What this measures: What it costs to use an AI at least as capable as the original GPT-4 (2023). A million tokens is roughly 750,000 words of input and output.
2023–2024 points are Epoch AI's. Points from late 2024 on are AI Tracker's extension using archived OpenRouter price lists and published GPQA Diamond scores (one provider route, not always the cheapest). The price of this capability level has flattened at roughly $0.05–0.13 since late 2024; the steep declines are now at higher capability levels (see the ARC-AGI cost chart). Per-token price is not cost per task.
Show data table and sources
| Date | Label | Value |
|---|---|---|
| 14 Mar 2023 | GPT-4 | $37.50 |
| 6 Nov 2023 | GPT-4 Turbo | $15 |
| 26 Feb 2024 | Mistral Large | $6 |
| 4 Mar 2024 | Claude 3 Haiku | $0.50 |
| 4 Nov 2024 | Gemini 1.5 Flash | $0.13 |
| 13 Dec 2024 | Phi 4 | $0.12 |
| 3 May 2025 | Gemma 3 12B | $0.063 |
| 1 Nov 2025 | Gemma 3 12B | $0.048 |
| 4 May 2026 | Mistral Small 3 | $0.058 |
| 1 Nov 2026 | Mistral Small 3 | $0.058 |
- LLM inference prices have fallen rapidly but unequally across tasks (Epoch AI)
- Lowest inference prices at fixed performance (CSV) (Epoch AI)
- OpenRouter models API (archived 2025-11-01) (OpenRouter via Internet Archive)
- OpenRouter models API (archived 2026-05-04) (OpenRouter via Internet Archive)
- Gemma 3 Technical Report (GPQA Diamond scores) (Google DeepMind)
Cost per task to score 75%+ on ARC-AGI-1
Cheapest entry on ARC Prize's leaderboard scoring at least 75% on the ARC-AGI-1 semi-private set, USD per task. Log scale.
What this measures: How much it costs an AI to solve one ARC-AGI-1 visual logic puzzle while scoring 75% or more.
Dates are ARC Prize's model release dates. Costs depend on ARC Prize's pricing assumptions, which it has revised (o3-preview went from $26 to $200 per task). The tested o3-preview was trained on part of the public training set and differs from the released o3.
Show data table and sources
| Date | Label | Value |
|---|---|---|
| 20 Dec 2024 | o3-preview (low) | $200 |
| 7 Aug 2025 | Grok 4 refinement system | $8.42 |
| 18 Nov 2025 | Gemini 3 Pro | $0.49 |
| 17 Dec 2025 | Gemini 3 Flash Preview (high) | $0.17 |
| 9 Jul 2026 | GPT-5.6 Terra (medium) | $0.13 |
| 21 Jul 2026 | Gemini 3.6 Flash (low) | $0.12 |
| 30 Jul 2026 | GPT-5.6 Luna (high) | $0.028 |
| 31 Jul 2026 | DeepSeek V4 Flash (low) | $0.012 |
- ARC-AGI Leaderboard (ARC Prize)
- ARC Prize leaderboard data (evaluations.json) (ARC Prize)
- OpenAI o3 Breakthrough High Score on ARC-AGI-Pub (ARC Prize)
Top AI score on an offline IQ-style test
Best monthly score on TrackingAI's verbal IQ-style quiz that has never been published online. Human average = 100.
What this measures: A short IQ-style pattern quiz that has never been published online, so models can't have memorised it. 100 is the human average.
- Top model (offline test)
- Reference level
Monthly maxima, dated to the end of each month. IQ norms are designed for humans and aren't validated for AI; this is a small matrix-style quiz, not a measure of general intelligence. On the public Mensa Norway test (which may be in training data) scores are higher, about 150.
Show data table and sources
| Date | Label | Value |
|---|---|---|
| 31 May 2024 | Claude 3 | 85.5 points |
| 30 Nov 2024 | o1 | 96.5 points |
| 30 Nov 2025 | Grok 4 | 123 points |
| 31 May 2026 | GPT-5 Pro | 127 points |
| 31 Oct 2026 | GPT Astra Ultra (TrackingAI label) | 136 points |
| Human average (100) | 100 points |
- Top AI IQ scores over time (TrackingAI)
- Offline-test monthly top scores (CSV) (TrackingAI)
Entries
Same AI, same puzzle games: 62.7% with the standard test setup, 99.9% with its maker's own
How a model is run in a test can matter as much as the model. GPT-6 Astra scored 62.7% or 99.9% depending on the software wrapped around it.
62.7% → 99.9%GPT-6 Astra on ARC-AGI-3: standard harness vs OpenAI's own adapter
On an IQ-style quiz never published online, top AI scores rose from 85 to 136
The quiz is kept offline so models can't have trained on it. Scores rose about 50 points since May 2024, but an AI ‘IQ’ means little.
85 → 136top score on the unpublished quiz, May 2024 to Oct 2026
Buying a fixed level of AI ability gets about 13× cheaper each year, Epoch AI found
The price of answering at a fixed standard halves about every quarter: one science level got 725× cheaper in 18 months. Top models did not.
725×cheaper per science question at o3's level, in under 18 months
OpenAI's unreleased Astra AI produced 10 research results, each with a computer-checked proof
The 10 results include three Erdős problems, and anyone can re-check the proofs by computer. OpenAI reported only its successes.
10 of 10results with a computer-checked proof, for about },000 of computing
One fixed score on a reasoning puzzle test went from $200 a puzzle to about a penny
Passing 75% on a set of visual puzzles cost $200 a puzzle in December 2024 and $0.012 by July 2026. The best models still cost far more.
$200 → $0.012cheapest cost per puzzle at 75% or better, Dec 2024 to Jul 2026
Agents, long documents and video can use 10× to 1,000× more energy than a short AI prompt
A short prompt uses about 0.3 Wh, a very long document about 40 Wh, an agent task about 50 Wh. New data centres are built for heavy uses.
~50 Whone AI agent task with reasoning (IEA estimate, AI chips only)
Google DeepMind's AI solved 9 open Erdős maths problems, with every proof computer-checked
AlphaProof Nexus also settled 44 of 492 conjectures about number sequences, for a few hundred dollars each. It failed on most it tried.
9 of 353open Erdős problems solved with computer-checked proofs (about 2.5%)
GPT-4's level of ability got about 300× cheaper in under two years, then stopped falling
The cheapest model matching GPT-4 on PhD-level science fell from $37.50 to $0.12 per million tokens by late 2024. Top models stay pricey.
$37.50 → $0.05per million tokens for GPT-4's level of ability, 2023 to 2026