trending
β€’

4h ago

Mobile LLM Server - Run local LLMs with Android. llama.cpp & LiteRT-LM

AI Node brings local LLM inference to Android with llama.cpp and GGUF model support. It turns your phone into a private AI server with OpenAI-compatible API endpoints. Unlike cloud-based AI apps, all models run fully on-device for privacy and low latency.