The LLM Challenge - Measuring the quality corridor that matters to end users

With more and more LLMs, and a diverse set of benchmarks it's really hard for developers, engineers and decision makers to make sense of evaluating LLMs for their use cases. The LLM challenge tries to measure the metric that matters: were end users satisfied?