Michael Seibel

Vocera - Launch voice agents faster with simulation & monitoring

Vocera helps AI developers build production-ready voice agents 10X faster. It generates adversarial scenarios, simulates realistic calls and gives actionable insights to your agents. It also monitors production calls to ensure complete reliability.

Add a comment

Replies

Best
Sidhant Kabra
Maker
📌
Hi Product Hunt Fam 👋 - Shashij, Sidhant, and Tarush here from Vocera AI. Vocera lets you test and monitor your AI Voice Agents automatically. We are in the current YC Fall 2024 batch! Why did we build Vocera? 💡 Six months ago, we were building voice agents in healthcare 🏥 and spent too much time testing them manually. Yet, some of our calls failed in production. Vocera was born from that experience Team Background 👥 Shashij has published a paper on AI systems testing from his research at ETH Zurich and Google. Tarush has developed simulations for ultra-low latency trading, and I have led product and growth teams before, including a conversational AI company. All of us met at IIT Bombay and have been friends for the last 7 years. Problem: Anything can go wrong in production 🚨 🛑 Demonstrating reliability to a customer before going live is challenging. ⚠️ Manually calling & testing your AI voice agents is incomplete and error-prone. 🔎 Identifying all the edge cases in your workflow is difficult ⏳ Monitoring all production calls manually is time consuming. Our Solution: End-to-end testing and observability for all your calls ✅ 1. Simulate Conversations: Our AI recreates realistic interactions using a library of workflows and personas. 2. Automated Scenario Generation: Pass in your call script/recording, and our AI will generate 100+ possible scenarios. 3. Customization: Custom personas and evaluation metrics to cater to your client's priorities. 4. Monitoring: Monitor & analyze all your production calls. Who is this for? Anyone building Voice AI agents. If you want to make your voice agents reliable or in general want to chat about Voice AI, book my calendar here 🗓️ or reach out to sidhant@vocera.ai 📧. Demo 🎥 You can check out our demo video here. If you'd like to engage in a fun roleplay, you can talk with our agent here: You will act as a customer support representative and our agent will call you for a refund, order status, and product recommendation. After the call, we will give you an evaluation. Please note: In reality, we generate hundreds of simulations automatically and provide detailed analytics on your AI agent's performance as demonstrated in the demo video. Shoutout 🙌 Thanks to Michael Seibel for hunting us and Steven Pham for helping us with the launch. 🎉
Jan
@mwseibel @svkpham @kabra_sidhant Congrats on launching Vocera AI! 🚀 The option to automatically generate and test hundreds of scenarios is next level for ensuring reliability before deployment. Really great idea!
Raju Singh
@mwseibel @svkpham @kabra_sidhant Congrats for the launch folks. Curious to know what sort of third party integrations do you support and what languages have you covered for simulations?
Kunal Sinha
@mwseibel @svkpham @kabra_sidhant This really sounds exciting, curious to test this Product. It will definitely be super helpful for sure :)
Tarush Agarwal
@jan_ber Thanks Jan. Looking forward to collaborating
Tarush Agarwal
@imraju Thanks Raju. We support all major platforms to build voice agents including Vapi, Retell, Pipecat. And we are multi-lingual.
Tarush Agarwal
Super excited to share Vocera with everyone. It is the product of 9 months of grind, endless failures and the energy to get back up. With Vocera, we want everyone to feel as confident in their voice agents as we are. Whether you’re a startup founder, developer, or someone in customer success, our goal is to make your journey smoother and more predictable. We've seen firsthand how much difference robust testing and monitoring can make, and we’re thrilled to empower others to do the same. Thank you for the support and feedback; we can’t wait for you to experience it!
Sidhant Kabra
@tarush_ Lets go!!
Anjali
Congrats on the launch guys!🎉 Having worked in the testing infra domain, I understand how important these use cases are. This is going to be a really useful product.
Sidhant Kabra
Thanks @anjali19_
Anirudh Amudan
What kind of support does your team offer if something goes wrong during the setup process?
Tarush Agarwal
@anirudhamudan This is actually a huge pain point for a lot of our customers. We provide active alerting if something goes wrong in production using our evaluation agents.
Shreyash Seth
What’s the most surprising insight you’ve seen from Vocera’s analysis on agent performance?
Tarush Agarwal
@shreyash_seth1 One of the most surprising insights from Vocera’s analysis has been how frequently small conversational nuances can significantly impact the effectiveness of voice agents. For example, we’ve seen that slight variations in phrasing can either build trust or unintentionally create frustration for the caller. In one case, an agent’s repetitive language caused a drop in customer satisfaction scores, which our analysis identified as a pattern.
Kwindla Kramer
Excited to see this from the Vocera team. They've been active and helpful members of the Voice AI community in San Francisco and online. I was just talking to a friend today about how important testing and evaluation tools are for realtime AI.
Sidhant Kabra
@kwindla thanks for your kind message. Always love interacting with you and Daily team.
Soham Ganatra
Using Vocera was really impactful for us in getting our voice agents to next level.
Sidhant Kabra
@soham_ganatra3 thanks Soham. Loved our interactions!
vagish dilawari
How much setup time does Vocera usually require before we can start testing voice agents?
Sidhant Kabra
@vagish_dilawari You can start in 5 mins. You just have to share some of your call recordings or bot prompt. Just based on this context, we can generate automated scenarios for you along with our standard evaluation metrics
Nimish Gahlot
How accurate are Vocera’s simulations when compared to real customer interactions?
Sidhant Kabra
@nimishg That is a very good question! We evaluate our simulations and production calls on the same metrics, and have observed that the performance is consistent. I would like to add one point, though: monitoring real customer interactions helps us improve the simulation environment as well!
Menelaos Kotsollaris
This is slick. Are you using Twillio under the hood or did you build this from scratch?
Tarush Agarwal
@mkotsollaris We are actually using Twillio for network orchestration. Our main work has gone into perfecting the scenario creation simulating real world as closely as possible.
Shashwat Kapoor
Congratulations on the launch guys! Had a doubt, are there specific personas for testing that mimic high-stress or emotionally charged situations?
Sidhant Kabra
@shashwat_kapoor Yes, we have irritated/high stress personalities as well as those who are in deep grief
Shuvam Manna
Interesting project. Taking it for a spin.
Sidhant Kabra
sure @shuvam_manna, let us know your feedback!
Evelyn Kumsah
Congratulations on your launch 🚀, “Vocera seems like a powerful tool for accelerating voice agent development! Question: How does Vocera handle ongoing improvements for voice agents in production? Does it adapt based on real-time call data to continuously refine the agent’s performance?
Tarush Agarwal
@evelyn_kumsah That's actually a great question and the direction we want to develop further as AI becomes better. Currently, it does keep giving better suggestions as the real-time data starts pouring improving both simulation and monitoring environments.
Huzaifa Shoukat
Congrats on the launch! This looks like a game-changer for AI voice dev. How do you see it impacting the industry?
Tarush Agarwal
@ihuzaifashoukat Thanks Huzaifa. Call centres in the US alone are a $130B market. Being able to automate that reliably is the key. The impact is going to be huge.
Akash Shrivastava
Really cool product, I see this perfectly fit in a space with tons of data and getting actionable.
Tarush Agarwal
@akashs Thanks Akash. Yes, data and simulations are going to be the key.
Aditi Kabra
This seems like a super cool idea! Congratulations on the launch! With the advent on AI on almost all domains, this product will definitely catch an eye of those looking for innovation! 🎉
Sidhant Kabra
@aditi_kabra07 Thanks Aditi!
Yigit Ihlamur
@kabra_sidhant congrats about the launch. It's such an excellent idea... how does the pricing structure look like? also, is there any impact on the performance?
Sidhant Kabra
@yigit, thanks for your support. Pricing is based on the number of simulations required. If I understand your question correctly, you wanted to understand the simulation's impact on actual call performance. We have already seen our clients go from 30-40% accuracy to 90%+ by running simulations on our platform
Yigit Ihlamur
@kabra_sidhant clear, thank you! I thought that it was real-time monitoring the calls, but now I understand that it's simulated. That makes sense. Do you have real-time or retrospective analysis (say a week worth's call gets monitored after we deploy the agents)? Curious about the pricing for the simulation as well. What's the cost per simulation?
Tarush
@kabra_sidhant @yigit It is actually both, testing and monitoring. So before going live, you can simulate on our platform. Once live, you can monitor their performance as well. And yes, we do provide analysis over time frames.
Fenil Suchak
This is so cool, I can see so many usecases for this! Great team and product!
Sidhant Kabra
@fenil_suchak1 Thanks Fenil. Looking forward to use Openfunnel for insights
Rimple
congrats! this is slick.
Sidhant Kabra
@rimple Thanks Rimple!
Shashij Gupta
After 9 months of relentless iteration and countless setbacks, I'm thrilled to introduce Vocera – born from our unwavering commitment to transform voice AI testing. We built Vocera because we believe everyone deserves to deploy voice agents with absolute confidence, whether you're scaling a startup, crafting code, or elevating customer experience. This journey taught us that reliable testing isn't just a feature – it's the foundation of exceptional voice AI. Now, we're turning those hard-earned lessons into your competitive advantage. Every test, every monitoring insight, and every performance metric in Vocera has been battle-tested to ensure your voice applications don't just work – they excel. To everyone who shared feedback and supported us along the way: your input has been invaluable. Today marks just the beginning of our mission to make voice AI deployment as seamless as it is powerful. Take Vocera for a spin – we think you'll hear the difference.