Myth check: “AI can't create new knowledge, it only remixes its training data”
Verdict: FalseAI disproved an 80-year-old conjecture and designed antibiotics that worked in mice. Real finds come where answers can be checked.
Share of 68 significant open Erdős problems a model solves with a machine-checked proof, in one attempt with a ~$300 budget.
What this measures: Unlike exam-style tests, nobody knew the answers to these problems when the test was made. A model only scores if the Lean proof checker accepts its proof or disproof.
Plotted at model release dates (the benchmark launched 1 September 2026, so earlier models were evaluated retroactively). Outside the official one-attempt rules, 17 of the 68 problems have now been solved by some means, including 12 credited to OpenAI's 6 October research release. Contamination risk grows as solutions are published.
| Date | Label | Value |
|---|---|---|
| 23 Apr 2026 | GPT-5.5 | 0% |
| 3 Sept 2026 | GPT-6 Astra (pre-release) | 2.9% |
| 29 Sept 2026 | GPT-6.1 Sol | 4.4% |
AI disproved an 80-year-old conjecture and designed antibiotics that worked in mice. Real finds come where answers can be checked.
The strict rules allow one attempt and $300 per problem. Counting every effort outside those rules too, AI has solved 17 of the 68.
3 of 68major open Erdős problems the best model solves under strict rules