Prem Chaurasiya

Prem Chaurasiya

Builder
#86813813 followers2 following
5 points
👑 10 day streak

Badges

Tastemaker
Tastemaker
Gone streaking 10
Gone streaking 10
Gone streaking
Gone streaking
Gone streaking 25
Gone streaking 25
View all badges

Maker History

Forums

OpenFetcherp/openfetcherPrem Chaurasiya•

28d ago

How are you currently turning websites into RAG-ready data?

While building OpenFetcher, I noticed a common pain point across RAG projects:

Most web crawlers give you raw HTML, broken text, or too much noise and fixing it costs time and tokens.

OpenFetcher approaches crawling differently:

  • Crawls full domains (even when sitemaps are missing or broken)

  • Converts content into clean, structured Markdown

  • Optimized for embeddings, agents, and context windows

Prem Chaurasiya•

27d ago

OpenFetcher - Turn entire websites into RAG-ready Markdown — automatically

OpenFetcher is an LLM-native web crawler built for the RAG era. It crawls full domains (even without sitemaps) and converts pages into clean, structured Markdown optimized for embeddings and AI agents. Designed as a lightweight alternative to Firecrawl and Jina Reader, it focuses on signal over noise. Perfect for building chatbots, knowledge bases, and AI search. Its is open source and alternative to jina and firecrawl
Prem Chaurasiya•

4mo ago

Vyapari AI - Create invoices, manage customers, and grow smarter with AI

Running a business is tough, especially for small owners and MSMEs. Vyapari AI is your smart, AI-powered assistant to simplify daily tasks: 🧾 Generate invoices instantly 👥 Manage customers ; contacts 📊 Get smart business insights 🎙️ Perform tasks by voice
View more