Toyo

Maker

📌

Morning makers 🌅 We found current web crawlers clunky, slow and expensive to use for scraping content for AI. All we want is an easy fast way to scrape any website's content to Markdown so we can use it in ChatGPT, Langchain or any LLM RAG pipeline. We built UseScraper to be super fast, simple and scalable. Pop in any website URL and we'll auto detect the best way to scrape it. We run multiple simultaneous headless browser instances for each job. The results are saved to plaintext or markdown, and you can download them via the UI as a single Markdown file or JSONL file. There's an API if you want to do everything programmatically. It only costs $0.30 per 1,000 web pages and you get $25 credits free when you sign up. We've written guides for using UseScraper with [OpenAI GPTs](https://usescraper.com/blog/uplo...) and [Langchain](https://usescraper.com/blog/lang...). Drop us an email (hi at usescraper) or DM with your thoughts and feature requests 🙏

Report

2yr ago

UserLoop

I've been looking for a service like this for getting organised data into my app to use with OpenAI, excited to give it a try!

Report

2yr ago

Epic tool - crazy fast and brilliant for training ML models

Report

2yr ago

UseScraper Crawler

The web crawler made for AI

The web crawler made for AI