Hello everyone, I've been missing all-in-one, simple-to-use GUI app for running language models locally so I made one. It's almost 3 months since I've started with this and I've recently added experimental support for Windows so I think the time has come and without any further marketing gibberish, let me just share this project with you :)
Happy to hear any kind of feedback, really.
@naoto_shibata_morph yes, just download the models somewhere and then go to the settings and click on the import button. by default it will look in the downloads folder but you can change that
@kingromstar Yes, there is llama.cpp if you don't mind compiling it yourself, then there's Ollama which is small layer of top of llama.cpp, and it's a command-line app, so no GUI. And then there are all-in-one GUI apps like this one, LM Studio and Faraday. I am not aware of any other ones currently. LM Studio is great and has many toggles if you like to play with all the possibilities, this is way more simple and straight to the point. Faraday is similar in spirit to this one but more focused on role-playing. This is something in between, and I'm working on automation feature which will make it more a productivity tool.
@leon_ostrez there's an import button in the settings, just point it to the path where your models are saved.
BTW: if it doesn't work pls report that in our discord. there were previously some issues with non-latin characters on windows machines but those should be resolved now.
Report
Hey, I wanted to know why is it using purely CPU for my Windows machine is there a specific reason for that or I can switch to GPU?
@tarun_asnani windows version does not have that enabled yet, it's literally few days old :) but it will be supported, of course, just follow me on twitter or join the discord to get notified.
Report
@cztomsik awesome ✨ thank you for the update will follow this closely 😇
Hello everyone, I've been missing all-in-one, simple-to-use GUI app for running language models locally so I made one. It's almost 3 months since I've started with this and I've recently added experimental support for Windows so I think the time has come and without any further marketing gibberish, let me just share this project with you :)
Happy to hear any kind of feedback, really.
Ava PLS
Morph
Ava PLS
Go Mail Merge
Ava PLS
Pythagora
Ava PLS
Ava PLS
Meshy
Crustdata