Nishit uploaded a large CRM dataset and asked a simple question: rank salespeople by total sales.

Perplexity got it wrong. Gemini got it wrong.

Why? Both were silently sampling a portion of the data instead of processing the full thing. Big dataset? Let's just look at some of it and call it a day.

We processed every row locally on his machine. Correct answer every time.