OpenAI
o3-2025-04-16
Made by OpenAI. Released 2025-04-16. Accessibility not recorded. We hold no price for this model: no seller we can read lists it any more, so what follows is what was measured, not what it cost.
What it scores, by house
| Benchmark | House | Score | Evaluated | Scaffold |
|---|---|---|---|---|
| chess puzzles | Epoch AI | 0.3±0.05 | 2026-08-07 | high |
| chess puzzles | Epoch AI | 0.4±0.05 | 2026-08-07 | medium |
| chess puzzles | Epoch AI | 0.3±0.04 | 2026-07-15 | low |
| frontiermath | Epoch AI | 0.1±0.02 | 2025-11-17 | low |
| frontiermath | Epoch AI | 0.2±0.02 | 2025-11-16 | medium |
| frontiermath | Epoch AI | 0.2±0.02 | 2025-11-16 | high |
| frontiermath tier 4 | Epoch AI | 0.0±0.02 | 2025-07-01 | high |
| frontiermath tiers 1 3 v2 | Epoch AI | 0.3±0.03 | 2026-08-27 | high |
| frontiermath tiers 1 3 v2 | Epoch AI | 0.2±0.02 | 2026-08-27 | low |
| frontiermath tiers 1 3 v2 | Epoch AI | 0.3±0.03 | 2026-08-27 | medium |
| gpqa diamond | Epoch AI | 0.8±0.03 | 2026-08-07 | medium |
| gpqa diamond | Epoch AI | 0.8±0.03 | 2026-07-15 | low |
| gpqa diamond | Epoch AI | 0.8±0.02 | 2025-04-16 | high |
| math level 5near its ceiling | Epoch AI | 1.0±0.00 | 2025-04-16 | high |
| mystery game puzzles | Epoch AI | 0.2±0.04 | 2026-08-27 | medium |
| mystery game puzzles | Epoch AI | 0.3±0.05 | 2026-08-27 | high |
| otis mock aime 2024 2025near its ceiling | Epoch AI | 0.8±0.05 | 2026-08-07 | medium |
| otis mock aime 2024 2025near its ceiling | Epoch AI | 0.6±0.07 | 2026-07-15 | low |
| otis mock aime 2024 2025near its ceiling | Epoch AI | 0.8±0.04 | 2025-04-16 | high |
| simpleqa verified | Epoch AI | 0.5±0.02 | 2026-08-27 | high |
| swe bench verified | Epoch AI | 0.6±0.02 | 2026-02-12 | medium |
| aider polyglot | collected by Epoch AI | 76.9 | — | unknown |
| aider polyglot | collected by Epoch AI | 76.9 | — | medium |
| aider polyglot | collected by Epoch AI | 81.3 | — | high |
| ale bench | collected by Epoch AI | 934 | — | high |
| apex agents | collected by Epoch AI | 0.3 | — | high |
| arc aginear its ceiling | collected by Epoch AI | 0.5 | — | medium |
| arc aginear its ceiling | collected by Epoch AI | 0.4 | — | low |
| arc aginear its ceiling | collected by Epoch AI | 0.6 | — | high |
| arc agi 2 | collected by Epoch AI | 0.1 | — | high |
| arc agi 2 | collected by Epoch AI | 0.0 | — | low |
| arc agi 2 | collected by Epoch AI | 0.0 | — | medium |
| cad eval | collected by Epoch AI | 0.7 | — | medium |
| cl bench | collected by Epoch AI | 0.2 | — | high |
| critpt | collected by Epoch AI | 0.0 | — | high |
| deepresearchbench | collected by Epoch AI | 0.5 | — | medium |
| dtbenchnear its ceiling | collected by Epoch AI | 0.8 | — | high |
| enigma eval | collected by Epoch AI | 0.1 | — | high |
| enigma eval | collected by Epoch AI | 0.1 | — | medium |
| fictionlivebench | collected by Epoch AI | 1.0 | — | medium |
| forecastbench | collected by Epoch AI | 62.5 | — | unknown |
| gdpval | collected by Epoch AI | 0.3 | — | medium |
| geobench | collected by Epoch AI | 3930 | — | high |
| geobench | collected by Epoch AI | 3858 | — | medium |
| gso | collected by Epoch AI | 0.1 | — | OpenHands |
| hle | collected by Epoch AI | 0.2 | — | medium |
| hle | collected by Epoch AI | 0.2 | — | high |
| lech mazur writing | collected by Epoch AI | 8.4 | — | medium |
| lmca | collected by Epoch AI | 39.7 | — | high |
| metr time horizons | collected by Epoch AI | 120 | — | unknown |
| metr time horizons | collected by Epoch AI | 91.3 | — | medium |
| os world | collected by Epoch AI | 9.1 | — | o3 (15 steps) |
| os world | collected by Epoch AI | 23.0 | — | o3 (100 steps) |
| os world | collected by Epoch AI | 17.2 | — | o3 (50 steps) |
| simplebench | collected by Epoch AI | 0.5 | — | high |
| vpct | collected by Epoch AI | 0.5 | — | medium |
| weirdml | collected by Epoch AI | 0.5 | — | high |
These scores are not comparable between houses and are not added up. A score is dated by when it was evaluated, not when the model was released, and a score without its scaffold is not a measurement — which is why both are printed.
What retires, and when
- deprecation — 2026-12-11, replaced by gpt-5.6-sol