Epoch AI (28 Sep): the cost of reaching a fixed AI benchmark score falls 13x a year; 725x on GPQA in 18 months
Epoch AI finds the cheapest price of hitting a given score on five benchmarks has fallen 13x a year; o3's 75% on GPQA Diamond cost $0.30 a question in Jan 2025, matched 18 months later for $0.0004. That is 6x faster than compute and 18x faster than lithium batteries.
Why it matters. If the price of a given level of AI skill keeps falling this fast, the cost argument for keeping people on routine thinking tasks weakens quickly.
Next. Epoch's and METR's next measurements of frontier models.
Sources: epochai.substack.com