Launching today

llmaker

Launching today

Selfhost LLM stacks. Run whole fleets from your terminal

1 follower

Selfhost LLM stacks. Run whole fleets from your terminal

1 follower

Visit website

AI Infrastructure Tools

•

LLM Fine Tuning

•

LLM Developer Tools

llmaker is an open source platform for running the complete modern LLM stack on your own infrastructure. Large language models, vector databases, embeddings, caching, observability and a builtin retrieval & agent layer. All provisioned, networked and production shaped from a single command. Build private retrieval augmented chatbots, FAQ assistants and recommendation engines locally. No third-party API keys. No data leaving your machine.

Free

Launch tags:Open Source•Developer Tools•Artificial Intelligence

Launch Team

ReplayAutonomous app testing for teams who ship at AI-speed

Promoted

buildpipe

Maker

📌

Hi PH 👋, Running a model locally is easy. Shipping an application is not. A production retrieval system needs a vector database, an embeddings service, a caching layer, an orchestration layer and observability. Each containerized, networked and configured to discover the others. Assembling that is a recurring tax: a sprawl of docker run flags, a brittle Compose file, and hundreds of lines of framework glue. llmaker removes that tax. One CLI provisions the entire stack on a private network and operates it as a single fleet. Live status, logs and a resource dashboard across every model and service. Stacks are declarative and reconcilable (apply --prune), models are OpenAI compatible and retrieval is traced out of the box. From a single model to a complete application.

Report

1d ago