BaseRT
Fastest LLM runtime on Apple Silicon
269 followers
Fastest LLM runtime on Apple Silicon
269 followers
Running AI locally means no per token cost + full privacy. BaseRT is the fastest LLM runtime on Apple Silicon. Install it with one command and run local models on your own device.
This is the 2nd launch from BaseRT. View more
BaseRT
Launched this week
BaseRT is the fastest LLM runtime on Apple Silicon. Install it with one command and run local models on your own device.
Free
Launch Team
The speed numbers are impressive, especially on Apple hardware. For teams deciding between llama.cpp, MLX, and BaseRT, what is the tradeoff in model coverage or quantization support? I would love to know where you see BaseRT fitting in a production local-inference stack.
LottieFiles
The 3.9x over MLX claim caught my eye — is that mostly custom Metal kernels or smarter KV-cache handling? And does the speedup hold for long-context prompt processing, or mainly decode? Running models locally is fast becoming my default for anything privacy-sensitive, so this is timely.
Running Llama on my M2 was genuinely instant, no setup headaches. Loving that it just works without Docker or weird config files.
BaseRT
@hafizezdztabm thanks that’s great feedback, we made one line install a prio
honestly the install was just one command and my m2 was running llama models in like a minute, kind of wild how fast it feels compared to ollama
BaseRT
@oykuener77260 awesome, thanks :) curious what model did you run
The one-command install is such a thoughtful touch, especially for folks who just want to experiment without dealing with setup headaches. Nice work making local LLMs feel that accessible on Apple Silicon.
BaseRT
@aleyna710492 thanks! Just curious, would you want a UI or were you happy with the terminal setup