Launched this week
Webpage Text Extractor
Extract clean text and Markdown from public web pages
16 followers
Extract clean text and Markdown from public web pages
16 followers
Turn public web pages into clean text, article text, or Markdown for LLM prompts, RAG inputs, content review, and exports. Add URLs, choose the text shape, and get page text with metadata, headings, links, counts, redirects, and timestamps.
Love how the output bundles the metadata, headings, and link counts right alongside the cleaned text instead of burying them in a separate panel. Makes it dead simple to drop straight into a RAG pipeline without extra cleanup.
The option to pick clean text, article text, or Markdown before you scrape is a really thoughtful touch, it saves a whole preprocessing step on the way into a prompt. Nice work making metadata and headings just part of the default payload too.
How does it handle pages that are mostly JavaScript rendered, like SPAs or sites that lazy load content?
The metadata + heading breakdown alongside the cleaned text is such a thoughtful touch, makes feeding context to LLMs way less painful than scraping manually.
The metadata alongside the extracted text is a really thoughtful touch, makes it way more useful for RAG pipelines than just dumping content.