All activity
After months of development, polishing, and community feedback, Crawlee for Python is leaving beta and entering a production/stable development status.
We are happy to announce Crawlee for Python v1.0.0.
Check out all the new features and updates now!

Crawlee for Python v1.0Crawlee for Python is now out of beta with new features!
We are launching Crawlee for Python, an open-source library for web scraping and browser automation.
Quickly scrape data, store it, and avoid getting blocked, headless browsers, and smart proxy rotation.

Crawlee for PythonBuild reliable scrapers in Python
Ondra Urbanleft a comment
Hey everyone, I'm Ondra, one of the early maintainers of Crawlee. This project really is a culmination of 4 years of work trying to make the best library for web scraping in production. Web scraping is a very dynamic environment and what works today might not work tomorrow, so we had to go through a lot of trial and error to figure out the most reliable and convenient ways of crawling the web...

CrawleeBuild reliable web scrapers and robots, fast!
Crawlee is an intuitive, customizable open-source library for web scraping and browser automation.
Quickly scrape data, store it, and avoid getting blocked with auto-generated human-like fingerprints, headless browsers, and smart proxy rotation.
Quickly scrape data, store it, and avoid getting blocked with auto-generated human-like fingerprints, headless browsers, and smart proxy rotation.

CrawleeBuild reliable web scrapers and robots, fast!

