Mercury
The First Commercial-Scale Diffusion LLM
86 followers
The First Commercial-Scale Diffusion LLM
86 followers
Mercury,from Inception Labs, is the first commercial diffusion LLM. Up to 10x faster than autoregressive models, with comparable or better quality on coding tasks.
This is the 2nd launch from Mercury. View more
Mercury 2
Launching today
Mercury 2 ditches sequential decoding for parallel refinement. As the first reasoning diffusion LLM, it generates tokens simultaneously to hit 1,000+ tokens/sec. This delivers reasoning-grade quality inside tight latency budgets for your agentic loops.
Free Options
Launch Team
Flowtica Scribe
Hi everyone!
Diffusion models, or dLLMs, are currently one of the most promising paths outside the standard autoregressive route. Everyone is exploring this space right now, from @Seed Diffusion to @Dream 7B and even @Gemini Diffusion. But the standout player is definitely Inception with their Mercury series, and they just pushed their second generation live.
The architectural shift changes everything about latency. Mercury 2 abandons standard left-to-right sequential decoding. Parallel refinement drives the generation instead. Think of the model less like a typewriter printing one token at a time and more like an editor revising a full draft simultaneously.
This parallel approach makes the inference insanely fast. Hitting over 1,000 tokens per second gives you a 5x speedup over leading speed-optimized models. This fundamentally alters the equation for multi-step agentic loops or real-time voice apps where latency compounds across every single step.
The API is strictly OpenAI compatible, so you do not need to rewrite any code. You can apply for early access to the API or just chat with it right now to feel the raw speed of a next-gen diffusion model.
Fluent
@zaczuo Incredible stuff. Just applied for early access!
Parallel refinement instead of sequential decoding is a bold technical shift. 1,000+ tokens per second with reasoning grade quality is not a small claim, especially for agentic loops where latency compounds fast.
From a positioning angle, though, the speed story is clear, but the practical transformation could be sharper. Is the real win lower infra cost, smoother agent chains, or enabling use cases that were previously too slow to ship?
You could test framing Mercury 2 around one concrete before and after scenario, like what becomes possible at 1,000 tokens per second that was painful before.
Curious, what is the first production use case where teams feel this speed difference most viscerally?
Adjust Page Brightness - Smart Control
this is just awesome!