Scoops

Helping startups understand their customers

1 follower

Helping startups understand their customers

1 follower

•

•

The world's a complicated place. We figured people (like us) could use a hand in making sense of it all. We make hard things easy to understand, one comic at a time.

Launch tags:Design Tools•User Experience•Prototyping

Launch Team

Render Sandboxes: a computer for every agentGive every agent its own machine. Starts in under a second

Promoted

BodyBarista

Strange last example: 42% saying no whereof 43% is 61-70 years old. That's 18% of all getting the question. Doesn't seem like a random population at all. Or am I doing the statistics wrong?

Report

8yr ago

Vento

Hunter

@peter_falk Apologies, that diagram now I think is confusing. The population isn't comprised of 18% of people aged 61-70. It's simply that of the 61-70yr olds who answered, 43% of them answered "I would Never let strangers stay in my home". Hope that makes sense. Let me know if it doesn't!

Report

8yr ago

BodyBarista

@chris_lee5 What was the standard deviation within the demographics? 43% compare to an average of 42% doesn't seem significant. What kind of analysis are you using? Or does the survey constructor make sub-questions for any parameter (age, income, education, nationality) before hand? Specifically setting a followup question for 61-70yr etc?

Report

8yr ago

Vento

Hunter

@peter_falk Hi Peter! Not quite understanding. Are you asking about the significance of these surveys? The panel is randomly sourced and selected (literally, we use ads that target all demographics) - and following the Central Limit Theorum, if the sample is random if you increase in size it should follow a normal distribution. (though you could argue our sample is still too small, to which I’d say we’re working on getting a $124 for 1000 responses package!) If you were looking at significance for a specific age group, say 61-70, you could run a hypothesis test (using a categorical variables correlation instead of a Pearson correlation) with a confidence level to determine if in fact it’s significant. We don’t currently do this test for you in the UI, however we give you all the data after the survey so you can manipulate it however you want :). The UI just tells you of demographic group X, n% chose to answer A. Doesn’t mean it’s significant, it’s just the raw data, interpreting it (at the moment anyway) is up to you!

Report

8yr ago

BodyBarista

@chris_lee5 I'm asking. What is your sigma if the automated analysis thinks that a 1% deviation from the average (43% for the subgroup compared to the 42% average) stands out.

Report

8yr ago

Vento

Hunter

@peter_falk Hi Peter! I could be wrong but in this case the sigma (std dev) should just be included in a categorical variables correlation (since the observations are not 1 to -1 and you can't use a regular Pearson's correlation with a p-value) if you wanted to determine if the mean of the subgroup was significantly different from the average or it was just by chance. We could absolutely do that IF our automated analysis was smart 😄 . To answer your question, right now, it's not - as in our algorithm does not try to detect which subgroup statistics to show and which not to. It simply shows all (the mock above is altered so you can see different demographic variables, in the real thing you'll see all the age ranges). So what you'll see is 61-70 had 43%, 51-60 had 80%, and so on. We're not picking and choosing which data to show at the moment, we know we're not experts in statistics so we'd rather leave the interpreting of it to folks such as yourself for now. It's a really interesting topic though, would love to chat about it further or to get your thoughts on what a smart algorithm that only shows you the most standout stats SHOULD look like. Feel free to DM me!

Report

8yr ago

Hey @chris_lee5, While I think this is an interesting solution to a problem, I don't know if I agree with the basic premise of this product. Your claim that "Products solve problems, not people!" seems flawed. Products solve problems for specific types of people. Not every product is going to be right for every person. That's why creators design with a specific customer in mind. If the product doesn't do well with that customer base, you're not meeting their pain points, or are targeting the wrong customer base. But creating something without a customer base in mind seems like a good way to fail. I noticed that in your landing page mockup, only 12% of people who answered a question come from the United States. Where are most of the people that are answering the questions coming from Chris?

Report

8yr ago

Vento

Hunter

@tom26454633 Totally fair - The argument we're making is that being 35 and a professional doesn't cause you to want pizza - being hungry, and in a rush does. Even in specific scenarios where you are building software only for lawyers, focusing on the attributes of the lawyers won't help you design great solutions. Focusing on the problem (managing billing), does. Simply, often times people mistake who they THINK suffer from the problems from the people who actually do. And that's where we can help. If you're curious, I write more in detail about it here on our blog! https://blog.scoops.io/your-defi... You're right though that not every product is going to be right for every person. We totally acknowledge that for a lot of vertical products, having SOME specificity of demographics will help significantly (e.g. yes you want to focus on a lawyer's problems, but since it's legal software you may want to only talk to lawyers). To that point, I'm going to have to say we're working on it, but we don't have a sufficient panel size yet 😞 However, if you are building software to manage a law firm's billing, is that a product that can also help accountants? or freelancers? If so, we can help you avoid that bias! Re: the %12, that's %12 of people from the United States answered that way, not that the panel is made up of %12 of people from the US. Apologies if that's not clear! (In fact, last I checked over 75% of the panel is from the US, then Canada, then the UK as it stands) Hope that makes sense, please keep challenging us if you disagree - we need all the feedback we can get!

Report

8yr ago

I would like to try this. But the sign up with Facebook/Google is off putting. I get you want the data, perhaps another way?

Report

8yr ago

Vento

Hunter

@nico_private actually it has nothing to do with the data :( It was actually just faster to build since Netlify has auth. Really sorry! We've got it on our backlog to build though, thanks for letting us know.

Report

8yr ago

Vento

Hunter

@nico_private Hey there Nicholas! Just wanted to let you know we're now accepting email/password signups :)

Report

7yr ago

Definitely a useful service. But there are so many amazing communities on FB, PH, IH apart from the niche ones where you get tons of feedback from legit people for free. Keeping that in mind, do you think Scoops is only for those who don't want to go through the trouble of posting their ideas in these communities and gathering feedback? Just curious! Congrats on the launch!

Report

8yr ago

Vento

Hunter

@irhymeth Totally right. Yes I think Scoops is absolutely for those people, but to also structure the research in an organized way. You could certainly run surveys on those sites, but it would take time, you may not get enough responses, you won't get demographic data, and if you try to follow up with additional questions & interviews you're likely to hit a low response rate. That's from our own experience of trying to validate our ideas anyhow. Great question though!

Report

8yr ago

@chris_lee5 Right, gotcha. Thanks for your response! How can one sign up to be a respondent? And do they get paid?

Report

8yr ago

Vento

Hunter

@irhymeth You can sign up here! https://club.scoops.io/ We do donate $.05-$.1 per question on their behalf or let them accrue towards Amazon gift cards. But we're trying to move away from money and more towards making the experience fun & rewarding for respondents to avoid response bias. (we're completely transparent about this, you can calculate our margin if you'd like!) - we also regularly scramble answers and see if panelists answer the same way to ensure data fidelity.

Report

8yr ago

@chris_lee5 Thanks for the response and appreciate the transparency! Will definitely spread the word! Good luck to you and the team!

Report

8yr ago

This is a really interesting product - I love the idea of validating ideas before you spend time building them. Couple questions: 1. Who do you consider a competitor? 2. How'd you validate this idea before you built it? 3. What's next for Scoops?

Report

8yr ago

Vento

Hunter

@realevanbrown great questions! 1. surveymonkey, pollfish, zoho surveys, there's a lot! 2. we built an email list for panelists and made a Ship product hunt page 😄 3. A lot.. at the moment, hard to say for certain, just taking in everyone's feedback while we think of what to focus on next! If you have any suggestions let us know 😉

Report

8yr ago

Vento

Hunter

Hi Product Hunt! Paul & I have each individually built many products, and the problem is, most of the time nobody wants them 😞. That's time & money down the drain. Scoops was built to be an affordable way to validate some key assumptions about your market early and fast without sinking all of that energy into actually building something. The premise is pretty simple - we want to create a way to do qualitative research on a quantitative scale. You can use this research to see if people actually have the problem you're trying to solve, or even if some high level version of your idea resonates. 1. For $12, ask 100 random people a question 2. Then, once the answer, find out whether there are demographic trends in how people answered. 3. Armed with that data, follow up with additional questions & even interview them to really get to the bottom of your market assumptions. Thanks for all the help, hope to be able to chat with you all individually on whether this service was helpful! 🙏

Report

8yr ago

@chris_lee5 Since you’re casting a wide net wouldn’t 100 be too small of a sample?

Report

8yr ago

Vento

Hunter

@howwhowhen Totally. Working on making it bigger 😄 . We also just want to keep it affordable for makers, which is why we're starting this way. The beta customers have found less value so far in the proportion of people answering certain way - it's moreso at this point binary validation as to whether or not ANYBODY has the problem you're trying to solve. But feel free to challenge us on this 👍 . Always looking for ways to improve!

Report

8yr ago

Vento

Hunter

@chris_lee5 @howwhowhen Hey Hao! we now allow up to 250 respondents to be targeted at once :) Just thought you'd want to know!

Report

7yr ago

I love the idea and the content on your website (How do you stop people from stealing my ideas?) :) but I think you have some more info to you website (about us, contact). Good luck

Report

8yr ago

1 2

Reviews

No reviews yetBe the first to leave a review for Scoops