Answer Socrates generates hundreds of questions for almost any topic, in many languages. You can use these questions to write authoritative, thorough content, to brainstorm product ideas, and see what real Google users are searching for.
π»π· Tech stack
π¨ Frontend
The frontend is implemented using Svelte and Sapper, going against the grain of popular frontend development and using a compiler to produce plain JavaScript that runs without any runtime dependencies, resulting in a small and snappy bundle. Styling is done using Tailwind 2.0, which has been a pleasure to use.
β¬οΈ Backend
On the backend a NodeJS server is gathering the data by scraping and storing it in a cache. The asynchronous nature of JavaScript makes it easy to run all scraping in parallel.
πππ Scraping / Proxies
We developed our own tooling to make most efficient use of proxies, preventing rate limits by carefully planning how often any individual proxy is used. This allows us to keep operating costs low so we can offer a free product.
Cheap scraping at scale requires lots of "internet street smarts" not taught in school. We're considering building a product that intelligently selects the right proxy so that developers don't have to spend time benchmarking various subnets and cloud providers. APIs like this already exist but are too expensive to use at scale.
π Network
Cloudflare takes care of SSL and caching. Using a Page Rule we're able to cache not only images but also API responses on the edge, for free. This Page Rule "Cache Everything" isn't talked about often, but in my opinion it's one of Cloudflare's best offerings. The app runs on a single bare-metal server in a single location, but data is cached in over 200 cities for a snappy performance from anywhere in the world.
βWhat should we build next?
Answer Socrates is far from being finished. What feature would you like to see?
- JSON, CSV export
- More word modifications to generate even more content ideas
- Historical data & alerts when new content ideas are discovered
- An API to integrate the data into your workflow
- APIs to build similar products (proxy rotation, Google suggestion, translation, etc)
Ok this is sick. Quick one, I am based in South Africa, so I input "health insurance" for that specific country, and some of the results generated seem to be a mix batch including other countries, e.g, questions about health insurance in Alabama or questions asking for agents in Oregon, that seems as though it is picking up questions from Americans?
How does it work when selecting a specific country, is it picking up questions asked from people in that country at the time?
@stuart_wilson4 I'll have a look. Unless there's a bug on our end, it should show Google results for the selected country; odds are, these American questions are ranking in South Africa.
Report
@stuart_wilson4@ytspar Ok cool, so safe to assume majority of questions though, are South Africans asking questions.
ThatΒ΄s such a great idea for making content and SEO, thanks guys!
Out of my curiosity, I tried the Polish market/language, too, and at first, it was giving me no or quite random results but after a few minutes of trying, it started working fast and properly.
Also, I wanted to contact you but the contact button on your website doesnΒ΄t work - maybe worth fixing @ytspar?
@ytspar@maja_paluchiewicz thanks :) where were the random looking results, on the home page or on the SERP/query page?
Contact button is working for me, it should pop open your email client. What happened when you clicked it?
Report
@ytspar On the home page. It started working properly after a few times I typed in various topics. It works now, too, I double-checked again just now.
Email - it just opens my mailbox and nothing else happens.. If itΒ΄s just my case, maybe just email me hello@joinly.xyz ?
@sandochee Thank you, glad to hear you like it! We noticed on ProductHunt that trends-products seem to be trending and wanted to exploit it by adding trends data. Looks like it is working :)
@chhabra_ankit good idea - would it be useful to have results in the same language or different ones for each country?
Report
@ytspar Thanks :)
Language shouldn't make any difference I believe. Because at the end of the day Answer Socrates is letting people know the questions so even if it is in English but from different countries, the native non english people would be able to comprehend easily.
Iβd love to see this integrated into a Quora bot lol. Would be cool to see how many of the questions actually generate conversations which could lead to prelaunching quality content.
@jakecreps Interesting, never considered integration with Quora bots (didn't even know Quora bots exist). What could a possible integration look like?
Report
@refuseillusion well essentially you create a bot to ask/submit questions on Quora then you set it to notify you if a question meets a certain threshold (letβs say 10 answers). Then, you take those top questions and create long form content for them.
@refuseillusion@jakecreps I see. That bot could also be used to participate in the Quora Partner Program, which pays for asking "good" questions. I'm intrigued that there is a market for that - a person that asks questions all day long but might not even be interested in the answers per se.
The questions currently generated are pre-validated in the sense that there already is search traffic for them
We might add Quora as a data source, scraping questions that have already been asked. Theoretically I'd assume that by the time a question shows up in Google Suggestions, someone already asked it on Quora too, but I could be wrong about that
Report
This is amazing! Super helpful for coming up with content ideas.
I would love an "export" feature where I could send my query to a csv file or similar. That would be awesome π
Well done, team!
Answer Socrates
Answer Socrates
Answer Socrates
Answer Socrates
Answer Socrates
Answer Socrates
Llamao
Answer Socrates
Llamao
Llamao
Answer Socrates
Answer Socrates
Answer Socrates
Answer Socrates
Answer Socrates
Answer Socrates