Theysaid is more than a survey, it's an opportunity to engage your customers, employees, donors, and etc. Training AI takes less than 1 min by pointing it to URL or internal doc. Your audience can answer and ask questions as if they are talking to you!
This is the 4th launch from Theysaid. View more
TheySaid 4.0
Launching today
Put what you’re building in front of real customers or synthetic users trained on them when you need an answer in minutes without leaving Claude, Cursor, or Jira. Nothing ships on a guess.
Free Options
Launch Team / Built With
I'd be interested in the cases where real people and synthetic testers disagree. Those differences sound useful for deciding which assumptions need another look.
@oleksii_sekundant yes, that's honestly my favorite part of the data. in our dyson vs shark study the AI testers kept pushing for hard proof, battery runtime per power mode, actual suction numbers, warranty length. came up in about 7 sessions and most humans just scrolled past it. for a brand that's a pretty clear signal the product page is leaning on vague claims. the humans on the other side brought stuff like strong opinions about dyson or shark from past experience and caring about the color. since synthetic and human responses sit in the same study with a filter, you can line them up and see exactly where they split
@oleksii_sekundant Love this question! The disagreements are often where the most useful insights come from.
@oleksii_sekundant the results are different from what you expect. Here's what happens in almost every head to head study with synthetic vs human audiences:
Humans and Synthetic Identify about 80% of the same issues
Synthetic identifies 10% of issues that humans don't
Humans identify 10% of issues that synthetic don't
So you synthetic audiences end up being a new source of feedback not available previously.
@oleksii_sekundant Great point! What we've found is that it's less about humans and AI disagreeing, and more about how much each one uncovers.
There's a lot of overlap in their findings, but AI can sometimes catch things humans miss, and vice versa. Humans bring real experiences, emotions, and personal context, while AI can explore more paths, dig deeper, and uncover additional issues.
That's what excites me most! It's not human vs. AI, it's human + AI. You get richer insights, broader coverage, and faster validation than relying on either one alone.
We actually published a study comparing the two: https://www.theysaid.io/human-vs-synthetic-testers