Marvin.Z

Marvin.Z

Author of Crawlab

Forums

Marvin.Z

5yr ago

Crawlab - Web crawler admin platform for any framework or language

Crawlab is a Golang-based distributed web crawler management platform, supporting various languages including Python, NodeJS, Go, Java and various web crawler frameworks including Scrapy, Puppeteer, Selenium. It currently has 6k+ stars on Github.