Launching today
ChorusGraph
Native agent runtime with semantic cache one pip install
11 followers
Native agent runtime with semantic cache one pip install
11 followers
ChorusGraph is a native agent graph runtime (Apache-2.0) — BSP scheduler plus a local semantic cache that skips redundant LLM calls when similar routing already happened. One pip install; not a LangGraph wrapper. this is an alternative with amazing benefits over LangGraph! https://insightitsgit.github.io/ChorusGraph/benchmarks.html see the numbers and never use langgraph to save your llm cost. https://insightitsgit.github.io/ChorusGraph/
How does the semantic cache actually detect similarity across different prompt phrasings, and what's the hit rate you're seeing in real workloads versus the benchmarks?
How does the semantic cache actually decide when two prompts are similar enough to skip the LLM call? Curious if that ever bites you with subtle differences in routing intent.
pip install was painless and the semantic cache actually cut repeat routing calls on my agent loop, pretty noticeable drop in token spend.
the semantic cache hitting on redundant routing is genuinely clever, that's the kind of thing that adds up fast in real agent workloads