All activity
Phasio brings Jest-style testing to LLM prompts. Write test cases with contains, notContains, and llmJudge validators. Run evals across OpenAI and Anthropic in one command. Catch regressions in CI before your users do.
PhasioTest your LLM prompts before they break production
Yagnesh Khamarleft a comment
Hey PH 👋 I'm Yagnesh, co-founder at AppUnik. I built Phasio after watching a prompt change silently break a customer-facing AI feature in production. No alert. No test. Nothing. Just users seeing garbage output. The problem: we unit test code religiously, but prompts? We were shipping them blind. Phasio fixes that. It's the Jest for LLM prompts — same describe/test API you already know, but for...
PhasioTest your LLM prompts before they break production
Yagnesh Khamarstarted a discussion
Try testing your PROMPT output before you go prod
So, I found that each time we update any prompt in prod it may break due to some type of negligence. So to address this, I found that I can test the Prompts before going to prod, but I didn't find anyone with proper npm package to make it happen locally and no extra steps to configure. So I have built this phasio.dev to solve this particular issue from my end. Please give it a try and all kind...