Lora is a local LLM for mobile, with performance comparable to GPT-4o-mini. It offers seamless SDK integration, guarantees complete privacy without data logging, and supports airplane mode. Try our app and build your own Lora-powered app.
@krazygaurav93 Really appreciate it! 😊 Excited to hear that you’re already thinking of use cases—can’t wait to see how you put it to work! 🚀 Let us know if you have any ideas or feedback. 🙌
@godwin_mathias Thanks a lot! I'd appreciate it to give us feedback about our app. It'll be really helpful to us to make an awesome product.
Report
When building an app using Lora, I wonder if it would work well on a typical smartphone CPU. I think Lora seems to require a lot of memory, making it difficult to work on regular smartphones. Could you let me know any performance thing like speed other than cost, etc.?
@paul_na ANY device with 8GB ram can run Lora(For example, Galaxy Note 9 or OnePlus 5). It is just matter of how long it takes to run inference :) In our best test device iphone 15 pro, it takes only 1.2 second to start inference!
Replies