Conifer is an open-source SDK that routes cloud, local, and BYOK inference through one gateway. Every call returns an exact cost receipt, including cache reads and writes, so you know what each request actually cost instead of guessing from a monthly bill. It works with hosted APIs, self-hosted models, and local models on your own machine. It is free when you bring your own keys, there is no forced rerouting, and it ships in TypeScript and Python.
It's a local inference engine we built from scratch in Rust. The engine, the agent, and the tooling are all our own.
What's inside:
- Editor: integrated terminal, file viewers, IDE
- Security: All agents and tool calls run inside a kernel-level sandbox, so it can only touch what you allow.
- One click to run: We kept it simple, no Docker, no servers to point at, no config files. Download the app, open it and its running.