Randomly got inspired yesterday seeing SmolVLM working on WebGPU and had the silly idea for this project. it's not perfect and super limited because of the current limitations of WebML (and admittedly, because I suck at prompting, but that's why it's Open Source haha) but it is 1.5B WORTH OF AI (SmolVLM 500M and LLama 3.2 1B) working RIGHT IN YOUR BROWSER with you not having to install anything! In fact, the whole thing is actually just an index.html that you can install and even use directly! It might be a little bit slow on first try (takes about 3 mins) when it installs models, but it caches it so it's way faster the second time (also, it's available offline after it's cached haha) Works on any modern web browser! It may be a funny little project, but it's genuinely taught me so much about WebML and Vision models, and the technologies we're getting with WebML will 100% democratize AI access and make it way simpler and easier to be used everywhere :p

AsianMOM

WebGPU Vision-LLM app that roasts you like ur mom in-browser

WebGPU Vision-LLM app that roasts you like ur mom in-browser