voicechat2
Open source voice chat infra that rivals GPT-4o
Start new thread
Chris Messina

voicechat2 - Open source voice chat infra that rivals GPT-4o

by
Raycast
•
AI voice chat infrastructure that uses WebSockets. It can achieve voice-to-voice latency as low as 300ms (what GPT-4o does) without a unified voice codec. Everything runs on a single high-end consumer GPU.

Add a comment

Replies

Best
Chris Messina
Hunter
📌
A fast, fully local AI voicechat app that runs WebSockets! Check it out! 🤓 git clone https://github.com/lhl/voicechat2
Tony Han
How would someone deploy this on the cloud? I assume you would need to rent GPUs on the cloud and run this?
Leonard
Maker
Tony Han
@lhl thanks!
Kyrylo Silin
Hey, I'm curious about the scalability. How many concurrent users can it support on a single GPU? Do you have any plans to develop a hosted version for those who might not want to set it up themselves? Congrats on the launch!
Leonard
Maker
@kyrylosilin thanks for the well wishes. if you do scalability testing, feel free to post that info, I'm sure others might curious about the answer as well. I have no plans for hosting this myself, but as this code is permissively licensed, anyone can adapt or deploy it how they want! (there are so many existing inferencing endpoints w/ cracked teams and deep pockets, its hard to recommend that as a smart business idea though)
Salar Davari
Sounds like a cool tool. Well done guys.
Toshit Garg
Smart Chat GPT rival.... Congrats
Sahir Maharaj
Congratulations on the fantastic app! The performance is top-notch, and I love how responsive it is. The user interface is simple yet effective, which makes it a pleasure to use. I’ll be sharing this with my friends and would be happy to connect on LinkedIn.
Krishna
Do we have an api for this?
Nick Bradford
nice!
Sahiiii
I sadly can't afford GPUs but love the idea, congratulations guys!
Ankit Vansekar
Cheers to voicechat2 on launch!! 🚀🎉 Your innovative AI voice chat infrastructure is setting new standards with ultra-low latency. This technological innovation is sure to benefit countless users.
12
Next
Last