Draw Things - AI-assisted image generation in your pocket

Stable Diffusion in a pocket - what a dream! Thanks you!

Hi, there. This is Liu. Draw Things starts as a crazy experimentation to see how today's phone stacks against powerful GPU cards. Luckily, I built Swift deep neural network library in the past a few years (https://libnnc.org/s4nnc) so it is relatively painless to migrate from PyTorch to Swift. From there, I made the stable diffusion models work on M1 chips (https://github.com/liuliu/swift-...) and then discovered it is painfully slow (around 1 minute on iPhone 14 Pro), but borderline usable on the top-of-the-line iPhone! Concurrently, works done by AUTOMATIC1111 and the r/stablediffusion community have shown us that image generation tools are not just toys. They are powerful productivity tool. With the right tweaks and knobs in place, it can go beyond text-to-image and tweak the image exactly to what you liked with text-guided image-to-image generation, text-guided inpainting, and various other tools (face restoration, super resolution, loopback, prompt matrix and more!). Combining that insight with the technologies I developed in public, Draw Things is my first trial to see if we can bring some of these development to masses. Not many people have powerful NVIDIA cards even if repos like AUTOMATIC1111 makes the installation as smooth as possible. There are many web-based tools available, but they either charge money to cover the expensive server-side GPU cost, or doesn't expose the full capabilities of these models and only allows you to play with text prompts. Similar stories on the mobile landscape, if not even more primitive. Draw Things is a leap from what we have on mobile before. It allows you to generate images from text prompt. But you can also select a toddler's drawing from the Camera Roll and use text-guidance to "beautify" it. You can erase some parts of a photo and fill it in with a dog, a cat or an alien saucer. Besides the official Stable Diffusion model, you can select other models each have their own unique style. This is a personal project without any financial backing or participation of a group. I designed and built it in the past 3 weeks. There are a lot of more features I want to build. As it is, Draw Things is 1% finished.

@liuliu Congratulations on the launch 🚀 Wish this was available as a web-app too. :P

Looks like it would be great, but it doesn’t seem to accept my UK phone number

Nice job!!!

Congrats on the launch!

Hello! Is there any beta test (testflight) builds? It doesn’t work on iPhone SE 2; I wish to help fix it :^)