METR's last task-length reading: about 12 hours for top public AI, then its tests ran out
In early 2026 the best public AI succeeded half the time on tasks a skilled person needs 12 hours for. METR's tests can't measure further.
Length of tasks AI agents can complete on their own
METR time horizon: the length of software tasks (measured in skilled-human time) an AI agent completes with 50% or 80% success. Log scale.
What this measures: How big a job an AI agent can finish on its own. A task's "length" is how long it takes a skilled human; the chart shows the longest tasks an AI completes half the time (blue) or reliably (orange). Tasks are software, machine-learning and cybersecurity work.
- 50% success
- 80% success
- Exponential trend
Dashed line: exponential fit since 1 Jan 2023, doubling roughly every 4.0 months.
50% success, No longer updated · last data Apr 2026: METR stopped updating this measure on 8 September 2026. The newest models finish almost every task in its test suite, and METR says results above about 16 hours are unreliable, so its last data point is Claude Mythos Preview (April 2026), and no GPT-6, Claude 5.x or Gemini 4 model has a score. METR has moved to measuring how much AI speeds up AI research inside labs. Now watch: METR's AI R&D acceleration audits (e.g. Anthropic, Nov 2026) and Epoch AI/METR's MirrorCode weeks-long coding tasks.
80% success, No longer updated · last data Apr 2026: METR stopped updating this measure on 8 September 2026. The newest models finish almost every task in its test suite, and METR says results above about 16 hours are unreliable, so its last data point is Claude Mythos Preview (April 2026), and no GPT-6, Claude 5.x or Gemini 4 model has a score. METR has moved to measuring how much AI speeds up AI research inside labs. Now watch: METR's AI R&D acceleration audits (e.g. Anthropic, Nov 2026) and Epoch AI/METR's MirrorCode weeks-long coding tasks.
METR Time Horizon 1.1 values (after METR's March 2026 correction), plotted at model release dates. Tasks are well-specified software, ML and cybersecurity tasks. Confidence intervals are wide (e.g. Claude Opus 4.6: 317–3,634 min). METR stopped updating this dataset in September 2026 and says measurements above ~16 hours are unreliable with its current tasks, so models released after spring 2026 are not shown.
Show data table and sources
| Series | Date | Model | Value |
|---|---|---|---|
| 50% success | 14 Feb 2019 | GPT-2 | 6 s |
| 50% success | 28 May 2020 | davinci-002 (GPT-3) | 6 s |
| 50% success | 15 Mar 2022 | GPT-3.5 Turbo Instruct | 36 s |
| 50% success | 14 Mar 2023 | GPT-4 | 4 min |
| 50% success | 6 Nov 2023 | GPT-4 1106 | 4 min |
| 50% success | 4 Mar 2024 | Claude 3 Opus | 4 min |
| 50% success | 9 Apr 2024 | GPT-4 Turbo | 3.7 min |
| 50% success | 13 May 2024 | GPT-4o | 7 min |
| 50% success | 20 Jun 2024 | Claude 3.5 Sonnet (Jun) | 11 min |
| 50% success | 12 Sept 2024 | o1-preview | 20 min |
| 50% success | 22 Oct 2024 | Claude 3.5 Sonnet (Oct) | 21 min |
| 50% success | 5 Dec 2024 | o1 | 39 min |
| 50% success | 24 Feb 2025 | Claude 3.7 Sonnet | 1 h |
| 50% success | 16 Apr 2025 | o3 | 2 h |
| 50% success | 22 May 2025 | Claude Opus 4 | 1.7 h |
| 50% success | 5 Aug 2025 | Claude Opus 4.1 | 1.7 h |
| 50% success | 7 Aug 2025 | GPT-5 | 3.4 h |
| 50% success | 18 Nov 2025 | Gemini 3 Pro | 3.7 h |
| 50% success | 19 Nov 2025 | GPT-5.1-Codex-Max | 3.7 h |
| 50% success | 24 Nov 2025 | Claude Opus 4.5 | 4.9 h |
| 50% success | 11 Dec 2025 | GPT-5.2 | 5.9 h |
| 50% success | 5 Feb 2026 | Claude Opus 4.6 | 12 h |
| 50% success | 5 Feb 2026 | GPT-5.3-Codex | 5.8 h |
| 50% success | 19 Feb 2026 | Gemini 3.1 Pro | 6.4 h |
| 50% success | 5 Mar 2026 | GPT-5.4 | 5.7 h |
| 50% success | 7 Apr 2026 | Claude Mythos Preview (limited access) | 17 h |
| 80% success | 15 Mar 2022 | GPT-3.5 Turbo Instruct | 18 s |
| 80% success | 14 Mar 2023 | GPT-4 | 54 s |
| 80% success | 6 Nov 2023 | GPT-4 1106 | 48 s |
| 80% success | 13 May 2024 | GPT-4o | 1.3 min |
| 80% success | 20 Jun 2024 | Claude 3.5 Sonnet (Jun) | 1.7 min |
| 80% success | 12 Sept 2024 | o1-preview | 4.4 min |
| 80% success | 5 Dec 2024 | o1 | 7.1 min |
| 80% success | 24 Feb 2025 | Claude 3.7 Sonnet | 12 min |
| 80% success | 16 Apr 2025 | o3 | 30 min |
| 80% success | 7 Aug 2025 | GPT-5 | 38 min |
| 80% success | 18 Nov 2025 | Gemini 3 Pro | 54 min |
| 80% success | 11 Dec 2025 | GPT-5.2 | 1.1 h |
| 80% success | 5 Feb 2026 | Claude Opus 4.6 | 1.2 h |
| 80% success | 19 Feb 2026 | Gemini 3.1 Pro | 1.5 h |
| 80% success | 7 Apr 2026 | Claude Mythos Preview (limited access) | 3.1 h |
METR measures AI agents by the length of tasks they can finish: how long a task takes a skilled person, at the point where the agent succeeds half the time (its 50% time horizon). Its Frontier Risk Report (May 2026, covering February–March 2026) put the best public models at about 12 hours (95% CI 5–61 h). For tasks finished reliably (80% of the time), the figure was about 1.5 hours. Labs’ internal models were likely at 16 hours or more, roughly two months ahead.
By then the most capable agents had “essentially saturated” METR’s tasks: the suite had too few harder tasks left to measure them well. Claude Opus 4.6 (February 2026) measured 12 hours. An early version of the limited-access Claude Mythos Preview measured 17.4 hours, but METR said results above 16 hours are unreliable with its current tasks. For GPT-5.6 Sol (June 2026), METR estimated about 11 hours if cheating attempts count as failures, and over 270 hours if they count as successes. It said none of these numbers were robust.
On 8 September 2026 METR marked its time-horizon page as no longer actively updated. Models released since spring 2026 have no METR time horizon.
What it means
The best-known measure of how long AI agents can work on their own has run out of room at the top, so newer models have no like-for-like figure. That does not mean progress stopped, only that this measure can no longer show it. Claims about newer models’ task lengths need other evidence.
Caveats
- The 12-hour figure is very uncertain: METR’s 95% range runs from 5 to 61 hours.
- Above about 16 hours the suite has too few long tasks with human timings (5 of 31 eight-hour-plus tasks).
- Cheating matters: on review, at least 16% of successful runs on the longest tasks were illegitimate (reward hacking, gaming the scoring instead of doing the task).
- METR notes its reporting is not a complete record of the most capable models.