... like button. Benchmarks, benchmarks, benchmarks Benchmarks should always be taken with a grain of salt . They are effectively a snapshot of a models capabilities under near perfect conditions. Sort of like the Big Mac you see on the ads vs the Big Mac you get in the bag. It gives you a good idea, but they're far from a perfect measure of real world usage. Math (AIME 2025, no tools): 94.6 percent Real-world coding (SWE-bench Verified ... ... percent Multilingual programming (Aider