Built a notes app that groups your notes automatically using Apple's on-device Foundation Models

by

I've been building Fog, a notes app that tries to solve a problem I kept running into: notes apps either make you organize everything manually (folders, tags) or don't organize at all.

Fog uses Apple's on-device Foundation Models framework (the same one powering Apple Intelligence) to read your notes and group related ones into "Clouds" automatically — no manual tagging, and nothing ever leaves your device since it's all on-device inference.

The interesting technical challenge was the clustering logic. I ended up using a union-find (disjoint set) structure combined with NaturalLanguage embeddings to figure out which notes are actually related, then merge them into clusters that update as you add more notes. Getting the similarity threshold right so Clouds don't over-merge unrelated notes or fragment obviously-related ones took a lot of tuning.



Curious if anyone else here has worked with Apple's on-device Foundation Models yet — how are you handling similarity/clustering tasks, and did you run into similar tuning headaches with thresholds?

5 views

Add a comment

Replies

Be the first to comment