OpenAI
o1
OpenAI's first o-series model, trained to reason before it answers. Previews (o1-preview, o1-mini) on 12 September 2024; in the API from 17 December.
- Announced
- Released
- Access
- Public
Benchmark scores
| Test | Score | Best on the tracker | How it was measured |
|---|---|---|---|
| Epoch Capabilities Indexmany tests combined into one score | 141 points | GPT-6.2 Astra 174 points | Independentlisted as "o1", CI 139.51 to 142.77Run 9 Nov 2026 |
| Humanity's Last Examexpert questions, no tools | 8% | GPT-6 Astra 55% | Independentleaderboard entry "o1 (December 2024)" (o1-2024-12-17_unknown) |
| FrontierMath T1–3hard maths problems | 15% | Claude Fable 5.2 95% | Independenthigh reasoning effort (o1-2024-12-17_high)Run 28 Aug 2026 |
| GPQA DiamondPhD-level science questionsPhD experts: 70%Saturated | 77% | Gemini 4 Argon 96% | Independenthigh reasoning effort (o1-2024-12-17_high)Run 13 Feb 2025 |
| OTIS Mock AIMEcompetition mathsSaturated | 73% | GPT-5.5 100% | Independentmedium reasoning effort (o1-2024-12-17_medium)Run 27 Feb 2025 |
| METR time horizon (TH1.1 + TH2)task length an AI agent finishes half the time | 35 min | GPT-6 Astra 1.7 days | IndependentPooled TH1.1 + TH2 suites; 95% CI 15.7–66.1 min |
| METR time horizontask length an AI agent finishes half the timeNo longer updated | 39 min | Claude Mythos Preview 17 h | IndependentMETR Horizon v1.1 run 'o1_inspect', medium reasoning effort (per Epoch AI mapping); 95% CI 21.2–65.0 min |
Also on these charts
Sources
- Learning to reason with LLMsOpenAI · Official · openai.com
- OpenAI o1 System CardOpenAI · Official · openai.com
- OpenAI API changelogOpenAI · Official · developers.openai.com
- Epoch AI Benchmarking Hub (model release dates and runs)Epoch AI · Dataset · 9 Nov 2026 · epoch.ai