Best Products
Launches
Launch archive
Most-loved launches by the community
Launch Guide
Checklists and pro tips for launching
News
Newsletter
The best of Product Hunt, every day
Stories
Tech news, interviews, and tips from makers
Changelog
New Product Hunt features and releases
Forums
Forums
Ask questions, find support, and connect
Streaks
The most active community members
Events
Meet others online and in-person
Advertise
Subscribe
Sign in
Clear text
recent
p/general
by
Andres Vlaeminck
•
10mo ago
RAG Frustration: Is Vector Search Giving Your LLM Junk Context?
... Makers & Builders using LLMs! Anyone else building cool stuff like PDF Q&A or custom bots with RAG, but finding the context
retrieval
step... frustrating? Most AI app data stacks these days use vector search (Pinecone, Weaviate, etc.) to grab text chunks for the LLM. But sometimes it feels like it finds stuff that's keyword-similar while totally missing the actual point the user asked for. Leads to those slightly weak or "confidently wrong" LLM answers ... ... vector similarity? Getting re-ranking right? What part is giving you the most trouble? (Context: We hit this wall hard internally. Similarity search wasn't cutting it for the precision we needed, so we ended up building our own
retrieval
0
11
Subscribe
Sign in