Narev
Find a faster, cheaper LLM in 5 minutes. Bubble burster.
Start new thread

Narev - Rapid A/B testing for LLMs

by•
Run a series of A/B tests for your LLM setup in 15 minutes. Define model, parameters and system prompt and see what's the impact on latency cost and quality. Call it a bespoke benchmark.

Add a comment

Replies

Best
Maker
📌
Hey, we've built this to allow a quick iteration and finding the best quality for the dollar spent. Here is a short Loom video showing how this looks: https://www.loom.com/share/39b7cd24166c4e1fafd5e7fbd12a9d4d?sid=55659f54-ba68-4be2-be53-15057001a1c7 Open access at https://narev.ai. Would love to get your feedback!