Launching today

Compute:Arena

Launching today

Community submitted benchmarks for Local AI

46 followers

Community submitted benchmarks for Local AI

46 followers

Visit website

AI Metrics and Evaluation

Community-submitted performance benchmarks for local AI models on any hardware, any runtime, any quantisation.

Free

Launch tags:Open Source•Artificial Intelligence•GitHub

Launch Team / Built With

Local

Maker

📌

If you want to know how fast a local LLM runs on your hardware, chances are it's pretty confusing. Benchmarking AI models on real hardware is way harder than it looks. Between AMD, NVIDIA, Apple Silicon, Intel, and Qualcomm, plus hundreds of open source models, getting the test bench right is a challenge. So we're making it dead simple. We're open sourcing our internal testing harness. Anyone can run open source models on their own hardware and submit results to the public leaderboard at computearena.ai. It's live now, with a few hundred submissions already. If you want to know how a specific model performs on a given hardware, chances are the data is already there. This is the same tool we use internally to track model and chip performance. Try it out and tell us what to improve!

Report

11h ago