We ve been looking at a question that feels increasingly relevant as more products put LLM output directly in front of users: if two frontier models are asked to judge the same factual claim, how often do they actually reach the same conclusion?
We tested five frontier models on 1,000 real-world claims under the same forced-choice setup.
On 63% of the complete claims, at least one model disagreed with the others or no majority formed.
On 23%, the disagreement was substantive verdicts at least two categories apart.
