OpenFetcher

OpenFetcher

Turn entire websites into RAG-ready Markdown — automatically

5 followers

Visit website
OpenFetcher is an LLM-native web crawler built for the RAG era. It crawls full domains (even without sitemaps) and converts pages into clean, structured Markdown optimized for embeddings and AI agents. Designed as a lightweight alternative to Firecrawl and Jina Reader, it focuses on signal over noise. Perfect for building chatbots, knowledge bases, and AI search. Its is open source and alternative to jina and firecrawl
OpenFetcher gallery image
OpenFetcher gallery image
OpenFetcher gallery image
OpenFetcher gallery image
Free
Launch tags:Developer Tools•GitHub•Tech
Launch Team / Built With
Flowstep
Flowstep
Generate real UI in seconds
Promoted

What do you think? …

Prem Chaurasiya
Maker
📌
Hey Everyone 👋 I built OpenFetcher to solve a problem I kept hitting while building RAG apps: getting clean, structured web data without overpaying or over-scraping. OpenFetcher is an LLM-native crawler that converts full domains into RAG-ready Markdown, even when sitemaps are broken or missing. It’s optimized for signal over noise, so your embeddings and agents actually work. ⚠️ Current Limitations (being transparent) Hosted version has page limits due to free-tier infra 🚀 Power users: run it locally If you want unlimited pages, faster crawling, and full control, you can deploy OpenFetcher locally or on your own server: No crawl limits Higher concurrency Perfect for large knowledge bases and internal docs This project is built in the open, and feedback means everything 🙏 Happy to answer questions, compare with Firecrawl/Jina, or help you plug it into your RAG pipeline.