A Social Turing Game
Start new thread
Ben Lang

Human or Not? - A social turing game by AI21 labs

by
Cursor
•
Chat with someone for two minutes, and try to figure out if it was a fellow human being or an AI bot. You can end up talking with someone random, or with GPT-4 / Jurassic-2 / Claude or other state of the art LLMs. Think you can tell the difference?

Add a comment

Replies

Best
Amos Meron
Maker
📌
Hey Hunters! :) My name is Amos and I work at AI21 Labs. A few months ago I had a cool idea: what if we would create a text-based chatroulette-style game that matches humans with AI bots, and after a few messages you get to guess if you’re talking to another fellow player or an AI bot? Well, our team decided to go ahead and build it, and here we are! I’m so f***ing excited to share this cool new web game and AI experiment called “Human or Not?” with the community. It’s a “social Turing game” that lets you find out if you can tell the difference between an AI and a human. So how does it work? The system randomly connects you to either an AI bot or another human like yourself playing the game. During a two minute chat you can ask or talk about whatever you want. Once the conversation ends, you have to choose, and only then the game reveals the truth - if that was an AI or another player. The bots are based on all the latest and greatest models: our very own Jurassic-2, as well as GPT-4, Claude and other LLMs. The game is free to play, and its goal is just to help all of us better understand the nature of these AI models in the context of not just a productivity tool, but members of our online world. We hope this will be a weird, crazy, thought provoking and mostly funny experience, and we would love for the Product Hunt community to be among the first to play with it. We are curious to see which strategies you will choose in order to expose the bot/human in the game. We would also appreciate any feedback, and if you liked the game - help us spread the word around! :) Thanks so much! Amos & the team
Rupin Mathur
@amos_meron Amazing Idea, Loved the UI UX and overall execution of the idea.
Amos Meron
Maker
@rupin_mathur thanks so much! Amazing design by @roee21
Roee Cohen
Maker
@rupin_mathur Thanks! Really appreciate it 🙏
Rick Robinson
@amos_meron i did this with AIM in the early 2000s - first round of chatbots. Fun fun.
Amos Meron
Maker
Liza Katz
Maker
📌
Lets do this! The game already beat me so many times :-O
Itai Elizur
Love this one.
Assaf Dudai
Just played a round - asked the other side "should I buy bitcoin?" and got the response "What is bitcoin?" - such a dead giveaway... c'mon humans, you can do better!
Amos Meron
Maker
@assaf_dudai lol.. I agree Assaf :)
Tarryn Williams
@assaf_dudai @amos_meron I asked "do you know any foreign languages" and it responded " A bit of Spanish, but not enough to hold a conversation". Good start. Then I asked "On a scale of 1-10, how would you rate the difficulty of learning Spanish." Essentially, the response was: "I'm sorry, but I can't really answer that question as I am not capableo f learning languages." I mean, was the bot even trying? ;) Still fun. Looking forward to seeing it's journey!
Amos Meron
Maker
@assaf_dudai @tee_dubs Thanks Tarryn! There are actually a lot of different bots and different LLMs in the game's pool, so you're welcome to try a few more games. If you keep winning it might be a good sign for mankind 😅
Joshua Brook
This is so much fun! Kudos @amos_meron and the AI21 team 🤩
Amos Meron
Maker
@joshua_brook Thanks so much!! ❤️
Aidai Zu
Love the game! SO accurate for these times.
Amos Meron
Maker
@aidai_zu Thanks Aida! I agree, and we hope this experiment would create more discussions around how to best utilize the power of LLMs.
Oren Farage
💡 Bright idea
Hey, I just tried it and got some interesting results :) Putting the fun side aside, I think that what you guys are doing is incredibly important moving forward. Looking not so far into the future, this is going to be an issue for many people and businesses. I believe that it's important to start looking into tech that will be able to look behind the scenes and make sense of what is working with us behind the curtains. Great way to start this research using real-world experience. Good luck on your launch, it is one of the more important ones in more the one way.
Amos Meron
Maker
@oren_farage Thanks so much Oren! Spot on. When we created the game, these were exactly our thoughts. We truly hope people (including researchers and product builders) will look at this experiment as an opportunity to start thinking about AI bots, not just as a productivity tool, but as future members of our online world.
Erik Emanuelli
The game has actually beaten me. 😅 I thought I was chatting with a robot, and it turned out I just talked to a human. 🤔 This is actually interesting and in these times where AI is really shaping our lives, it's even more interesting.
Amos Meron
Maker
@erikemanuelli That's just part of the fun ;)
Atish Ranjan
Whoa! What a nice game. I played this game around 10 times, and many times I was wrong in selecting Human or bot, but I really enjoyed it. The best thing about this is, the clean UI, and kept it so simple that you can use it without any how-to guide!
Amos Meron
Maker
@techtricksworld Thanks so much!! We really appreciate it. @roee21
Sounds fun !! great concept 👌
123
•••
Next
Last