joshua Nishanth

joshua Nishanth

AI Engineer and Co- Founder

Forums

joshua Nishanth

16h ago

TraceOps - TraceOps! Understand every decision your LLM makes.

TraceOps brings the VCR.py pattern to LLM agents but at the SDK level, not the HTTP level. It intercepts openai.chat.completions.create, anthropic.messages.create, tool calls, and agent decisions, recording the full execution trace as a YAML cassette. On replay, it injects recorded responses without making any real API calls giving you zero-cost, millisecond-execution, fully deterministic agent tests. Contribute to ioteverythin/TraceOps development by creating an account on GitHub.