WTF is that?
Send any picture and it will tell you what it is!
Start new thread
Ming Cheuk

WTF is that? - Send any picture and it will tell you what it is!

by
Gift Insights
•

Add a comment

Replies

Best
Ming Cheuk
Maker
The inspiration behind this bot came from everyday frustrations. I like learning about things. When someone tells me about something unfamiliar, I Google it. When I hear a song on the radio I like, I identify it through Soundhound or Shazam. But how about when I want to know the species of a plant, breed of a dog or model of a car? How am I supposed to describe it to Google? That, is how WTFIT was born! Right now, it works well in identifying every day objects and animals. However as the community grows, the platform will become smarter and smarter, and be able to to identify even the toughest of images!
Tommaso Soru
@techno246 Concerning Google, I wonder how this classifier compares with Google Search by Image. Anyway, good job!
Ming Cheuk
Maker
@mommi84 I've played around with Google search a lot, and it works very well when the image exists on Google images already. However, it doesn't seem to do as well with images you just take a photo, and the similar photos can sometimes be totally off. And thanks!
Dave Byun
Well done... I think this could be really huge if it can find out what brand/model clothing someone is wearing in a photo!
Ming Cheuk
Maker
@bagel_labs It's not the first time someone has suggested that, so definitely sounds like there are opportunities in that space. Will explore, thanks!
KN
This is awesome! Would be amazing if it had an API that can be sent images to return what the object was 👌🏼
Alexandre Vallières-Lagacé
@nagra__ I would have loved to have this in a previous project of mine! :) Great idea!
Ming Cheuk
Maker
@vallieres @nagra__ you guys should check out Microsoft Cognitive Services, Google Cloud Vision and Cloudsight. They all have REST APIs for that purpose!
Alexandre Vallières-Lagacé
@techno246 @nagra__ yes, I did have great success with Caffe from Berkley. Sadly we did not go through with the feature using it. We were hoping to crowdsource 1 year of photo and human taging as a baseline and have it fully automated afterwards.
Slavik Fokin
Well, the recognition algorithm is not perfect. But I know a way you can improve it. I uploaded an image of a potato soup in a plate (the file from Wikipedia had a name Romanian_potato_soup.jpg). At first I thought to rename the file because it would be too easy to know what was there even without looking at the picture. But the answer was too general - "A white plate". It means that the algorithm doesn't take file names into account, when they could be really useful.
Ming Cheuk
Maker
@slavio84 Thanks for the suggestion! At the moment, it doesn't take into account the URL or filename, but great idea.
Scott Ruona
Is it answered by a person? There's a typo in one of the responses.
Ming Cheuk
Maker
@scottruona Not that I know of! I do want to bring in community driven recognition but that's for the next version :)
adam mashaal
@techno246 Very cool concept - I dig it. As mentioned by other commenters, it's pretty accurate in giving a very generalized identification (e.g., photo of a jade plant returned something like "leafy green potted plant"), which is cool, but I'm guessing most people know the generalized identification already -- getting more granular is key. And while I do like the name, you should consider changing it to something a bit more kid-friendly, maybe just "WIT" (What Is That). Gotta love a good double-entendre!! Good luck.
Ming Cheuk
Maker
@adammash Thanks for the feedback. Once we get experts on board the platform, we might be able to begin identifying specific traits of objects like species, etc. The community can patch up things. Out of interest, how willing would you be to contribute back to tagging images? For example if the bot hit you up an image, would you help identify it if you knew what it was? Something we are currently exploring. Oh yes, I have thought about how to make it more kid friendly. Though it's a fun name and resonates with a lot of people, I wonder if I can keep it as a double entendre but have a kid friendly meaning of the acronym. WIT could work... Given W can still be expanded to it's original form, if needed :)
adam mashaal
@techno246 I definitely think asking experts to contribute to tagging is a smart idea. It's how Google images tagged their images -- they had a "game" where people could flip through images and add any tags they think are relevant. I'm guessing they showed each image to multiple people and kept the tags that were suggested more than once. WIT! 😎
Chad Darling
Very fast, it did confuse my putty knife for a spatula but quite impressive.
Ming Cheuk
Maker
@darlingchad perhaps it is suggesting you re-purpose it as a spatula ;) But in all seriousness, thanks for your feedback!
Germán Castaño
Cool and simple... I tried with an animated gif and worked really well... and the use of Facebook messenger makes it accessible... Great idea...
Ming Cheuk
Maker
@germancastano Great to hear you liked it! Simplicity was exactly what I was going for. People don't install as many apps on their phones these days.
Germán Castaño
@techno246 What's technology is behind?... There are many AI API's these days... did you use some of them?
Greg Ellis
Great concept! I immediately thought this would be awesome for giving me dinosaur names. Ever try to figure out the name of an odd looking dinosaur? It can be pretty tough sometimes using google text search. So I gave it a picture of a dilophosaurus and it told me it was a 'brown two legged dinosaur' which is pretty impressive that it counted its legs and knew it was indeed a dinosaur. Then I gave it a stegosaurus and it said it was 'a green dinosaur'. It would be amazing if it could determine the name of the dinosaur somehow, because then when my kids ask me 'what is this?' I can get the answer faster. Impressive none the less :)
Ming Cheuk
Maker
@greg_ellis that was actually one of the reasons I wanted to make this. So I can identify those animal species that look so familiar but I just don't know the name of! That is the eventual goal. To be specific when recognising animals, plants, or branded things. Thanks for your feedback!
shahruz ✵
@techno246 how was the messenger platform review process for you?
Ming Cheuk
Maker
@shahruz It took about 3 weeks in total. 2 weeks after I submitted, I got a message saying it got rejected because they couldn't find the associated page. Don't think they had one when I first submitted. Someone else got that as well. I just resubmitted without changing anything, except providing them with the page, and it went through fine! (week for the re-submission)
123
Next
Last