Web Scraping for Beginners: Learn web scraping hacks to scrape pretty much any website

Hey PH community! Long time lurker via Twitter first time posting. I'm excited to share the Web Scraping for Beginners course. After I was laid off by Twitter, I focused on a side project I never finished. I wanted to build a jobs board where you can search jobs using fuzzy search queries. In order to make this work I needed data, lots of data. An MVP with 10 job postings wasn't going to cut it. Jobs API endpoints were no help. Few existed. The data companies with endpoints wanted $100k+ to grant access. No thanks, too expensive. I decided to give web scraping a try because all the data i wanted was public. I needed at least 1000 job posts to reach my vision. For the next 6 months all I did was learn how to scrape websites. And I went deep! At first it was difficult. Not a single technique always worked. Every website was unique. However, with every smaller website I scraped, I wrote down the working technique. Over time instead of banging my head against the wall with bad code, I would run a series of quick tests to determine if it was possible to get the data. With this approach my success rate went up 10 fold. At the end of my focus period I scraped over 70,000 jobs from 2,500+ job boards for TechStackLeads.com! With these techniques, I went on to scrape 50,000 digital marketing companies from Clutch.co. I even scraped 3,000 companies from Crunchbase. As my datasets grew, I knew I had a winning method to share with other developers to level up their web scraping skills. The video course teaches you same series of hacks I use to successfully scrape public website data, even if they are protected by anti-bot detection software. I hope you enjoy the course. Let me know what you think!