Launched this week
infai
Run local AI with profiles, not flags
1 follower
Run local AI with profiles, not flags
1 follower
Its an open-source terminal control plane for local AI inference. Find or import models, save reusable launch profiles for llama.cpp and vLLM, check hardware fit, and run multiple models with live logs, ports, tokens-per-second, CPU, RAM, and VRAM telemetry. One Go binary, one SQLite file, no cloud or telemetry.
infai Reviews
Reviews