Launching today

ChorusGraph
Native agent runtime with semantic cache one pip install
9 followers
Native agent runtime with semantic cache one pip install
9 followers
ChorusGraph is a native agent graph runtime (Apache-2.0) — BSP scheduler plus a local semantic cache that skips redundant LLM calls when similar routing already happened. One pip install; not a LangGraph wrapper. this is an alternative with amazing benefits over LangGraph! https://insightitsgit.github.io/ChorusGraph/benchmarks.html see the numbers and never use langgraph to save your llm cost. https://insightitsgit.github.io/ChorusGraph/






How does the semantic cache actually detect similarity across different prompt phrasings, and what's the hit rate you're seeing in real workloads versus the benchmarks?
pip install was painless and the semantic cache actually cut repeat routing calls on my agent loop, pretty noticeable drop in token spend.