Ava PLS

Desktop app for running LLMs locally

72 followers

Desktop app for running LLMs locally

72 followers

Visit website

LLMs

•

AI Chatbots

An easy to use, all-in-one desktop application to run large language models (like Llama) locally, on your computer.

Free

Launch tags:Productivity•Artificial Intelligence•Tech

Launch Team

Ava PLS

Maker

📌

Hello everyone, I've been missing all-in-one, simple-to-use GUI app for running language models locally so I made one. It's almost 3 months since I've started with this and I've recently added experimental support for Windows so I think the time has come and without any further marketing gibberish, let me just share this project with you :) Happy to hear any kind of feedback, really.

Report

3yr ago

Morph

Awesome! Nice product! Is it possible to install a new model on my own? for example, I want to try some models from Huggingface.

Report

3yr ago

Ava PLS

Maker

@naoto_shibata_morph yes, just download the models somewhere and then go to the settings and click on the import button. by default it will look in the downloads folder but you can change that

Report

3yr ago

Hey, I wanted to know why is it using purely CPU for my Windows machine is there a specific reason for that or I can switch to GPU?

Report

3yr ago

Ava PLS

Maker

@tarun_asnani windows version does not have that enabled yet, it's literally few days old :) but it will be supported, of course, just follow me on twitter or join the discord to get notified.

Report

3yr ago

@cztomsik awesome ✨ thank you for the update will follow this closely 😇

Report

3yr ago

Go Mail Merge

Isn't this already doable with llama app or something like that?

Report

3yr ago

Ava PLS

Maker

@kingromstar Yes, there is llama.cpp if you don't mind compiling it yourself, then there's Ollama which is small layer of top of llama.cpp, and it's a command-line app, so no GUI. And then there are all-in-one GUI apps like this one, LM Studio and Faraday. I am not aware of any other ones currently. LM Studio is great and has many toggles if you like to play with all the possibilities, this is way more simple and straight to the point. Faraday is similar in spirit to this one but more focused on role-playing. This is something in between, and I'm working on automation feature which will make it more a productivity tool.

Report

3yr ago

Pythagora

Awesome, love it!!! how do i connect different models to it?

Report

3yr ago

Ava PLS

Maker

@leon_ostrez there's an import button in the settings, just point it to the path where your models are saved. BTW: if it doesn't work pls report that in our discord. there were previously some issues with non-latin characters on windows machines but those should be resolved now.

Report

3yr ago

Meshy

Congrats on the product launch!

Report

3yr ago

Crustdata

Congrats team Ava PLS on the launch!

Report

3yr ago

Reviews