xrumka

It’s one of the most convenient and lightweight tools for working with LLMs locally. The interface is clean and thoughtfully designed. New models are added almost immediately after release. It can run in server mode with remote access, and it automatically selects the largest model variant that fully fits into available memory. It runs stably and natively on macOS and is well suited for use as a remote server on a MacStudio. An excellent choice for everyday users who want to run models locally.