Webᵀ Crawl by Web Transpose

Realtime web data for LLMs.

53 followers

Realtime web data for LLMs.

53 followers

•

•

✨ Turn full websites into datasets for building custom LLMs with Webᵀ Crawl. Give us just 1️⃣ URL and let Webᵀ Crawl handle the rest. Quickly turn full websites & content (like PDFs, FAQ, etc.) into • Prompts for fine-tuning • Chunks for vector databases

Webᵀ Crawl by Web Transpose gallery image

Free Options

Launch tags:Developer Tools•Artificial Intelligence•GitHub

Launch Team

AWS Startup AdvisorPersonalized AWS guidance that meets you where you’re already building

Promoted

Webᵀ Crawl by Web Transpose

Maker

📌

Hey everyone! I'm Mike – I'm working on 🟪 Web Transpose, a collection of tools to make the web yours. → https://webtranspose.com/ I'm excited to share my first tool – 🟪 Webᵀ Crawl. I had quite a few friends building chatbots from websites so I decided to build a tool to streamline the process. I also made a few tutorials about finetuning and vector databases for LLMs here: → https://www.webtranspose.com/blog 🙆‍♂️ I'd love for you to check 🟪 Webᵀ Crawl out and have a play. Let me know what you end up building. Would love all of your feedback. I'm excited to chat about all things web data / web scraping / web crawling in the comments! orthogonally ❤️ Mike mike@webtranspose.com

Report

3yr ago

ShortVideoGen

Hey Mike, this is a really cool tool - do you plans for an API too? I'd like to think that it'd help many devs including me who want to automate the chatbot-building process :)

Report

3yr ago

Webᵀ Crawl by Web Transpose

Maker

@asaxena1415 Absolutely! API coming soon.

Report

3yr ago

Webᵀ Crawl by Web Transpose

Maker

@asaxena1415 Thanks for checking out Webᵀ Crawl!

Report

3yr ago