AnythingLLM

You want a desktop AI that just does it all - that is AnythingLLM. Hey ProductHunt 👋! Long-time member, longer-time builder. I wanted to finally formally launch AnythingLLM to the community. AnythingLLM is the all-in-one AI app that just works and does exactly what you hope other apps would do, locally and privately on your desktop. AnythingLLM bakes in all of the things you are looking for, but with no setup, and no command line tools, all in one application you can just install on your computer. AnythingLLM includes... 🤖 A built-in LLM engine That's right, no Ollama, LMStudio, or API key. You can just download the latest cutting-edge models and run them without any other software. You can still use your favorite tool or cloud-based LLM if you have a preference 😁. 📚 Upload and chat with documents With our built-in embedder and vector database you get full RAG capabilities to chat with your documents like you can in other popular apps. Just drag and drop files or images and you can chat with them nearly instantly. 🧠 AI Agents that are useful We include some sensible AI agents to help you be productive. This includes tools like Web Search, Web Scraping, SQL Connector, Document Summary, File creation, and soon - custom tools you write or get from our community of over 4K+ members. 🔌 Data connectors Aside from local documents, you can also connect to various external data sources like GitHub, Confluence, and other websites to build up your LLMs knowledge base. 🔒 Privacy first Unless you decide to work with a third party, AnythingLLM is fully on-device and private. Everything is stored on your device to ensure maximum security. This is why large corporations opt to use AnythingLLM within their organizations and why you might want to also. Your IT team will love how easy it is to install ❤️ 🤩 Open-Source Lastly, but for the hackers, AnythingLLM is open-source, and with over 18K GitHub stars and 2 years of a solid development track record - AnythingLLM is here to stay. And some notable other features: - Text-to-speech and speech-to-text support - Full developer API for custom integrations - Poppin Discord community of 4K members - Dark mode first (and only lol) - Works with the LLM provider you are already using AnythingLLM is the result of our team's dedicated focus for 2 years to bring AI fully locally with a no-fuss setup that just works the way you want. AnythingLLM hopes to be your ideal solution for improving productivity with zero frustrating setups or configurations. Bonus! We offer a Docker Image with over 100K+ pulls that offers a more "multi-user" and administrative version of AnythingLLM that has all the benefits of the desktop app with rule-based access for those who want a more centralized way to onboarding you org with a cutting-edge AI tool suite. Let us know what you think! - Timothy Carambat

Hey Tim, I'm wondering how you handle model updates. Do users need to manually download new versions or is there an automatic update process? How does the performance of your built-in LLM compare to popular alternatives? Congrats on the launch!

I use it solely because LanceDB is built into the product. It's totally awesome, and I'm loving it! I can't wait to see what the future holds for this app.

Variety sounds great with AnythingLLM! I checked it out, and it seems to have everything. Great work open-sourcing and prioritising privacy.Glad you launched.

I previously only used cloud LLM services, but AnythingLLM helped me make the jump to trying out all the different flavors of LLMs. Keep up the great work!

I use it everyday. You have created an amazing tool.

This new AI tool sounds cool and all but isn't it a bit excessive to have everything crammed into one app, like sometimes I just need simple and specific tools not an entire suite, feels like overkill to me