Artificial intelligence systems may be good at generating text, recognizing images, and even solving basic math problems—but when it comes to advanced mathematical reasoning, they are hitting a wall.
Hosted on MSN
AI is actually bad at math, ORCA shows
ORCA benchmark trips up ChatGPT-5, Gemini 2.5 Flash, Claude Sonnet 4.5, Grok 4, and DeepSeek V3.2 In the world of George Orwell's 1984, two and two make five. And large language models are not much ...
A team of AI researchers and mathematicians affiliated with several institutions in the U.S. and the U.K. has developed a math benchmark that allows scientists to test the ability of AI systems to ...
The FrontierMath benchmark from Epoch AI tests generative models on difficult math problems. Find out how OpenAI’s o3 and other AI models performed. FrontierMath accuracy for OpenAI’s o3 and o4-mini ...
OpenAI's Astra achieves a record ECI score of 169, posts near-perfect results across 37+ benchmarks, and becomes the first ...
Some results have been hidden because they may be inaccessible to you
Show inaccessible results