Reply Better AI - Free, private AI writing: on-device or your own model
by•
Reply Better AI is now free and private by default. Improve your drafts and write replies in any text field, with the AI running on-device (Chrome's Gemini Nano) or on your own local model (Ollama / LM Studio): no API key, and nothing leaves your machine. Prefer cloud? Bring a free Groq key or OpenRouter. One button morphs between Reply and Improve, with live streaming, a word-level diff of what changed, tone presets, and one-tap undo. Chrome and Firefox, open source, zero telemetry.

Replies
The morphing Reply/Improve button is a really elegant solution to a problem most tools overcomplicate with menus and toggles. Love that it also defaults to on-device with Gemini Nano instead of pushing cloud like everyone else.
Thanks so much! Yeah, the button was something I iterated on a lot — wanted it to feel natural without adding UI clutter. And yeah, on-device-first felt like the right call, especially since Nano's gotten pretty capable. Figured most people would prefer their stuff staying local if it could work well, but having the cloud options there as a fallback for heavier rewrites seemed like a good balance.
Have you had a chance to try it with any local models yet? That's honestly where I'm most curious about feedback right now — how it performs with different setups, what kinds of prompts work best, that kind of thing.