for People who use scrapers a lot, what are the most common pain points?
by•
recently i was checking out the scraper services and it seemed like easy to build at first but when i thought about scaling it, that's when it got really difficult.
still i wanted to know the opinions of the people who use the scraper services and what services do they use commonly in general and their pain point, that way i will just focus on those points and try to build the first iterations.
really appreciate your thoughts on this matter.
26 views
Replies
Proxy management and blocked requests are probably the two things I'd want a service to handle for me. I'd rather pay for that infrastructure than spend days maintaining it myself.
Another interesting angle could be vertical specific scraping . Instead of scrape anything something like product data real estate listings, or job postings could make the value proposition much clearer