Need feedback from AI Agent builders
by•
Recently setup openclaw on my mac studio, and spent almost $30 in openai api credits in just two days. I had no idea where the tokens were used.
I had similar issue when building n8n workflows with OpenAI nodes.
To get a sense of where the costs are high I am building an arena to compare model costs. Is this a useful utility for other AI agent builders? Anything more it should have?
5 views
Replies
The way I am thinking of doing this is by keeping the existing workflow as is, and instead of pointing to api.openai.com, I point to ai gateway api end point. The ai gateway should have to ability to run a shadow experiment with original model and the shadow model, so I can do cost comparison and tracing of what is going on.