Sun - Collaborative voice API for agents
by•
Sun is a voice first AI model built specifically for real‑time collaborative voice interaction, not just one‑on‑one chat.
ChatGPT Realtime and Gemini Live were built for one user talking to AI. Sun is built for collaboration — meetings, group calls, multi-agent debates, classrooms.
One API, multi-speaker awareness, 10× the context window.
Replies
Does it mean that by using this, we can make our internal meeting agent talk in meetings about what is happening in meetings ? Like talking fireflies or otter ?
@regaldreamtech Exactly — that's the core use case Sun was built for.
Fireflies and Otter listen silently. With Sun, you can build an agent that listens, knows who's saying what, and actually speaks up at the right moment — to summarize, answer a question, surface a related decision from earlier in the meeting, or even moderate.
how does it know when to interrupt and when to not? Also, is there way to make it speak only when explicitly asked?
@ashishkingdom Yes, you can actually give trigger words or names to the agent. The agent will then respond only when called with the name (and is asked a question), not when passively mentioned in a conversation. It also looks at voice activity to see if someone is actively speaking to avoid interrupting them.
Does it take audio in or should we give transcribed text as inputs ?