This research paper introduces FrontierMath, a collection of very hard math problems designed to test how well AI can solve advanced math. The problems in FrontierMath are brand-new and cover many different areas of math, like algebra and calculus. The researchers found that even the smartest AI today can only solve a tiny fraction (less than 2%) of these problems. To make sure the problems were really tough, they asked famous mathematicians, including some who have won the highest prize in math, to look at them. These experts agreed that the problems were very difficult and would likely take AI many years to solve on their own. The paper also explains how FrontierMath was created, how AI are tested on the problems, and what kinds of math are included. The researchers hope that FrontierMath will help push ...