I run an AI services company and we've built voice bots for multiple clients. Is there a way for us to evaluate the agents on Vocera (these are custom builds not VAPI or Synthflow etc)
Given the size of the niche (developers building voice agents), do you find there's a lot of demand for testing and observability? From my anecdata, many of the voice AI agent builders are using SDKs and builder tools (Voiceflow, Vapi, Bland, Vocode, etc). Observability is usually already baked-in pattern with these SDKs (testing I'm not so sure of).
One conversation I had with a voice agent builder: "Our product is complex enough where external testing tools don't make sense. And we know when things are not working because we have close relationships with power users and companies." Whose problem are you solving?
Your tool looks very powerful, but might the broader opportunity be just to use your evals to roll out the best voice agents yourself?
Great question! We've seen significant demand for testing and observability across sectors like healthcare, insurance, home services, and e-commerce. You’re correct—many of our customers also rely on tools like Voiceflow, Vapi, and others to build their agents.
What they love about our platform is having both testing and observability in one place. Observability helps identify issues while testing allows them to simulate and prevent those problems before they escalate. This dual approach is especially helpful for teams dealing with voice-specific challenges, industry-specific nuances, or company-specific edge cases.
Our tool is particularly valuable for teams stuck with manual testing—it saves time in iterating the bot and ensure the edge cases are taken care of
Do you have a flow/customization where the customer asks to wait for X seconds? And is this just telephony over Websocket or is a WebRTC stream supported as well?
I was able to easily flip the script on the return scenario to convince the rep that they were the one calling me to return - and then flipped it again. The quality of the voice was great, though.
Thats great. We also generate adversarial scenarios for our customer's voice agents like you did. The roleplay example was made for you to get a sample evaluation of your performance. In reality, we generate simulations automatically and provide analytics on your AI agent's performance, as demonstrated in the demo video.
Great to see the focus on robust and exhaustive evaluations. With large-scale usage of products, everything that can go wrong usually does so such evals will go a long way!
Thanks a lot. The focus currently is to link the observability and testing environment so that test sets can automatically be created based on findings in actual production calls. Currently, it requires human intervention to create a scenario for testing based on findings of production calls.
Having some experience with the healthcare industry, seeing the name Vocera here is incredibly confusing.
Vocera is a very common communication platform and set of devices used in hospitals: https://vocera.stryker.com/s/product-hub/vocera-smartbadge These things are everywhere in healthcare already. If someone came to me and suggested using “Vocera” for a healthcare related tech thing, my mind would assume it’s the Stryker product. It’s that common.
So unfortunately I’d recommend a name change as a high priority. Dealing with healthcare tech is difficult enough, but using the same name as a very popular and established healthcare tech product is going to be an unnecessary obstacle in getting traction. Not to mention that Stryker’s Vocera division will have some things to say about this.
You are right. We were unaware of Stryker's Vocera prominence when we chose the name. Healthcare voice agents are a huge space. We have 6 clients in healthcare already.
We will discuss and evaluate the name internally to avoid confusion or potential issues. Thanks a lot for your feedback
I want to say, this comes across as 3 founders who don't have real-world experience in the hospital field. As a buyer in healthcare, this basic of an error would signal to me that this company is not ready for the enterprise stage.
Came here to say this exactly - any nurse, PA, or other hospital staff person likely has heard of "Vocera" the hospital communication platform.
Beyond just accidental confusion, I'd be worried about real legal issues with trademark infringement. Trademarks primarily exist to prevent customers from being confused about which business they're interacting with, and this is a great example of the types of things they're trying to prevent. (I am not a lawyer, so take this with a grain of salt.)
Can users customize scenario generation to focus on specific conversational intents or user behaviors?
I run an AI services company and we've built voice bots for multiple clients. Is there a way for us to evaluate the agents on Vocera (these are custom builds not VAPI or Synthflow etc)
Congrats on the launch!
Given the size of the niche (developers building voice agents), do you find there's a lot of demand for testing and observability? From my anecdata, many of the voice AI agent builders are using SDKs and builder tools (Voiceflow, Vapi, Bland, Vocode, etc). Observability is usually already baked-in pattern with these SDKs (testing I'm not so sure of).
One conversation I had with a voice agent builder: "Our product is complex enough where external testing tools don't make sense. And we know when things are not working because we have close relationships with power users and companies." Whose problem are you solving?
Your tool looks very powerful, but might the broader opportunity be just to use your evals to roll out the best voice agents yourself?
Great question! We've seen significant demand for testing and observability across sectors like healthcare, insurance, home services, and e-commerce. You’re correct—many of our customers also rely on tools like Voiceflow, Vapi, and others to build their agents.
What they love about our platform is having both testing and observability in one place. Observability helps identify issues while testing allows them to simulate and prevent those problems before they escalate. This dual approach is especially helpful for teams dealing with voice-specific challenges, industry-specific nuances, or company-specific edge cases.
Our tool is particularly valuable for teams stuck with manual testing—it saves time in iterating the bot and ensure the edge cases are taken care of
Do you have a flow/customization where the customer asks to wait for X seconds? And is this just telephony over Websocket or is a WebRTC stream supported as well?
This market will be killed by Twilio soon
I was able to easily flip the script on the return scenario to convince the rep that they were the one calling me to return - and then flipped it again. The quality of the voice was great, though.
Thats great. We also generate adversarial scenarios for our customer's voice agents like you did. The roleplay example was made for you to get a sample evaluation of your performance. In reality, we generate simulations automatically and provide analytics on your AI agent's performance, as demonstrated in the demo video.
Glad you liked the voice quality.
Ahh ok, understood. Thank you.
Congrats on the launch!
Great to see the focus on robust and exhaustive evaluations. With large-scale usage of products, everything that can go wrong usually does so such evals will go a long way!
How do you intend to grow the product?
Thanks a lot. The focus currently is to link the observability and testing environment so that test sets can automatically be created based on findings in actual production calls. Currently, it requires human intervention to create a scenario for testing based on findings of production calls.
This is super dope! Are you looking to hire? Your product made me super excited.
Thanks a lot.
Yes, we will be hiring for founding engineers pretty soon. Please reach out to founders@vocera.ai if you are interested
Is there any way to sign up and try this without going through the sales call/demo?
Our onboarding currently includes a quick demo to ensure users get the most value out of the tool and understand its capabilities in detail.
Having said that we have a role play which you can try. In roleplay, you talk with our AI and then we evaluate your performance.
> We were working on voice agents in healthcare
Having some experience with the healthcare industry, seeing the name Vocera here is incredibly confusing.
Vocera is a very common communication platform and set of devices used in hospitals: https://vocera.stryker.com/s/product-hub/vocera-smartbadge These things are everywhere in healthcare already. If someone came to me and suggested using “Vocera” for a healthcare related tech thing, my mind would assume it’s the Stryker product. It’s that common.
So unfortunately I’d recommend a name change as a high priority. Dealing with healthcare tech is difficult enough, but using the same name as a very popular and established healthcare tech product is going to be an unnecessary obstacle in getting traction. Not to mention that Stryker’s Vocera division will have some things to say about this.
You are right. We were unaware of Stryker's Vocera prominence when we chose the name. Healthcare voice agents are a huge space. We have 6 clients in healthcare already.
We will discuss and evaluate the name internally to avoid confusion or potential issues. Thanks a lot for your feedback
I want to say, this comes across as 3 founders who don't have real-world experience in the hospital field. As a buyer in healthcare, this basic of an error would signal to me that this company is not ready for the enterprise stage.
It's prominently displayed as the top result when googling "Vocera". Unsure how this was missed by the founders or anyone involved in the YC network.
It’s a valid critique. In hindsight, this should have been caught earlier.
This is the first thing I thought too, the name confused me with the company and brand Vocera, I thought it was from them.
Feedback taken. Thanks for your input. Definitely we will evaluate this
Came here to say this exactly - any nurse, PA, or other hospital staff person likely has heard of "Vocera" the hospital communication platform.
Beyond just accidental confusion, I'd be worried about real legal issues with trademark infringement. Trademarks primarily exist to prevent customers from being confused about which business they're interacting with, and this is a great example of the types of things they're trying to prevent. (I am not a lawyer, so take this with a grain of salt.)
Congrats on the launch. For a sec, I thought this was related to the healthcare comms firm owned by Stryker.
https://www.stryker.com/us/en/portfolios/medical-surgical-eq...
yeah, we are Vocera AI.
Vocera is a company that already exists in healthcare and you have some potential legal issues with keeping this name.