Name: Private LLM
Rating: 4.67 (3 reviews)

Private LLM is an AI chatbot that runs fully offline without an internet connection on iPhone, iPad and Macs.

Personal GPT is a small 3B parameter LLM quantized to run on recent iPhones, iPads and macs. The model is based on the RedPajama-INCITE-Chat-3B-v1 model, and further SFT fine tuned on a few OSS and our own internal instruction tuning datasets. The app is a universal app; buying it once on either the macOS App Store or the iOS App Store gets you the app on both platform. Here are 5 promo codes for each App Store. iOS: 4XAMLLMPTA4X NHEE6H9NF9XX 6YF3APY67NAW RYPKXTELT466 AEFRXNYAAFXK macOS: LY6EPHYXJF9P A673LRMXNW3E 6NH6MJH9F6M4 9HFPW3JE636N ALLKN63FJ3JP

On MacOS, it seems not to recognize questions with typos; a single typo in a question will stray away from the context. Answers I get are okay for quick info, but never given specifics. iOS app is not working on my iphone se2 on iOS16.5; clicked open the app, doesn't open anything.

Thanks for the review! The iOS app works well only on iPhones and iPads equipped with A14 Bionic or later chips (iPhone 12 and later). Unfortunately as of iOS 16, Apple only allows developers to gate on A12 Bionic or later. This leaves a small set of devices (iPhone XS, iPhone XR, iPhone 11 and 2nd gen iPhone SE) on which we cannot restrict users from downloading the app, and the app wouldn't work well. We've added this caveat on the App Store description. Hopefully, iOS 17 have a way to restrict the app to be installable only on devices with the A14 Bionic or later chips.

Update: Both the macOS and the iOS apps have evolved significantly since my last reply. The macOS app now ships with a bigger 7B parameter model and users with Apple Silicon Macs that have 16GB or more RAM, can now download a bigger and better 13B parameter LLM.

Tested it out on my MacBook Pro M1 Max 32GB and iPhone 12. It is working incredibly well on both. A bit slower on my iPhone, but very usable. I plan to cancel my ChatGPT Plus subscription.

Private LLM

A private, on-device AI Chatbot for iOS and macOS

A private, on-device AI Chatbot for iOS and macOS

Have a question about Private LLM? Ask it here and get a real answer.

Do you use Private LLM?

Maker Comment

Have a question about Private LLM? Ask it here and get a real answer.

Do you use Private LLM?

Maker Comment

What needs improvement

What's great

What needs improvement

What needs improvement

What's great

What needs improvement