https://www.mithril.solutions/ Hi! my name is Josh - boshjerns on X and elsewhere. Using an application called Wispr Flow for voice dictation, and I was on the free trial for a week before I realized that 100% of the conversations that I was having with the application were being saved, and it got me thinking about how my data is controlled and saved I'm a software developer and especially recently have been focused on working with small and local LLMs (mainly for coding) but it occurred to me that it should not be too difficult to build a system that had the features I loved the most from Wispr but have it run 100% locally. The clean heads up display, hotkey for dictation, and audio ducking for continuous work while I'm listening to music or watching video during work... I got at it.... It wasn't too long before I had something that I was really proud of... similar electron app with heads up display audio ducking and hotkeys... I figured I would take this to the fullest extent and make it fully installable as well free and open source. Whisper.cpp binaries are compiled from the quantized Base.en version of the whisper.cpp models. Quantized base version ensures it works well but still keeps it small. There's a version for both Intel Chips as well as Apple Silicon chips so everyone can run it. There's a secondary feature in the application I am working on that is an ai assistant that gains context to chat with from anything you have highlighted on a page. If you run the installable version of this app instead of from the github it requires a login only so that I cna track usage on my keys. 100% of voice dictation is 100% local let me be clear ONLY the token usage / character count is tracked and ONLY when using the secondary assistant feature not dictation... I posted a video demo of the app on X: https://x.com/boshjerns/status/1... Would love if some people checked it out and let me know what they thought! My goal in creating this software as open source and free is to spark interesting conversations with people working on similar tools and ideas and also provide some value back in any way I can to an ecosystem that is constantly providing me value...

MITHRIL WHISPER

100% free, local and open-source voice dictation

100% free, local and open-source voice dictation