Launching today
LocalClicky
Control your Mac with your voice locally
28 followers
Control your Mac with your voice locally
28 followers
LocalClicky is a Mac menubar app that lets you have a real conversation with your computer - completely offline. Say "Computer" to start a session. It stays listening. You chain commands back to back. Say "goodbye" when you're done. Everything runs on your machine: voice transcription, LLM multi models, VAD, macOS say No API keys. No subscription. No data leaving your Mac. MIT licensed.
NeighborHoodShare
Refocus
The fully local stack is the part that resonates with me. I work on voice AI for aging-in-place, and privacy comes up in nearly every conversation with families, because the data involved (health, daily routines, who stopped by) is about as sensitive as it gets. Keeping Whisper and the LLM on-device the way you have here removes a whole category of worry. One thing I am curious about: on older or lower-spec Macs, what is the realistic gap from end of speech to spoken response with the local models, and which model sizes stay usable? That latency is usually where local voice either feels like a real conversation or starts to break it.
NeighborHoodShare
@igorgurovich Oh, thats a solid use case.
To answer your question "on older or lower-spec Macs", the gap is noticeable, I haven't tested myself but on M1 with 16 gb ram with nothing else running, the latency should be under 3-5s for a normal command, but for complex commands like generating some health report, it can take a while. Yes latency has been a concern but I was earlier looking into possibility of distributed computing just like how torrent works, offloading compute, but couldn't make much progress there :)