Running Laya on iPhone: an offline decision-support experiment
I'm the maker of Does He Love Me? (他爱我吗), a Chinese-language iOS app exploring a narrow question: can a local decision model help people reflect on relationship questions without sending their personal context to a server?
The app runs Laya locally through Core ML. Users describe a situation, then see candidate answers with relative model scores, including an uncertain option. Chinese voice input is transcribed locally with SenseVoice. It is a paid download, with no account or subscription.
For builders exploring JEV and System 1 approaches: Laya's upstream project describes it as a non-autoregressive System 1 decision engine and offers an optional Jev-compatible server interface. This iOS app uses local Laya inference; it does not call the Jev API or run that server. Short explanations are template-based, rather than cloud-LLM conversations.
The central UX challenge is uncertainty. A model's relative score is not a measured probability of another person's feelings. The app is an experiment in reflection, not mind-reading or relationship advice with guaranteed accuracy.
I'd welcome discussion from other on-device AI builders:
• How would you present relative scores without implying calibrated confidence?
• How do you test sensitivity to the wording of candidate answers?
• What trade-offs have you made between model size, offline speech, and download size on iOS?
If you'd like to explore the current Chinese-language version, the website links to its China App Store listing: https://doesheloveme.tennote.site/
Happy to compare approaches with other local-AI app makers. What would you test first?

Replies