Winnow compresses RAG prompts before they hit your LLM, cutting token costs 50%+ while preserving meaning. Uses question-guided filtering + LLMLingua-2 for semantic accuracy.
Key features:
⢠FastAPI server with OpenAI-compatible proxy
⢠Batch compression API
⢠Question-aware filtering keeps answer-relevant tokens
⢠Docker self-hosting, pip-installable SDK
⢠MIT licensed