AI that truly understands video. Uses multimodal models (Marengo/Pegasus) to search, analyze & generate text from video content at scale.
This is the 7th launch from TwelveLabs. View more
Pegasus 1.6 by TwelveLabs
Launching today
Pegasus 1.6 is the TwelveLabs model that understands video from a first-person point of view, built for the egocentric and teleoperated footage robotics and physical AI teams already collect. It recognizes entities more accurately, and produces persistent metadata across segment types. Point it at raw teleoperation or wearable footage and get back labeled, timestamped, robot-ready data. No manual labeling pass required.
Launch Team
Hi everyone, I'm Aiden, co-founder and CTO at TwelveLabs. Excited to share Pegasus 1.6 with you today.
Every robotics and physical AI team we talk to is sitting on the same problem: hours of first-person footage that's the raw material for action labeling and next-action prediction, and no foundation model actually built to understand it. General-purpose video models are trained on broadcast and third-person footage. Point them at a wearable or a robot's own camera and they miss what's actually happening.
Pegasus 1.6 is our answer. It's the first TwelveLabs model built for egocentric (first-person) video understanding. Pegasus 1.6 expands on Pegasus 1.5's Time-Based Metadata (TBM), which extracts timestamped, structured metadata from custom schemas, by adding support for egocentric video and task narration. We've also sharpened detailed recognition of hand, tool, and object interactions , while speeding up processing for high-volume video workloads.
As an update to 1.5’s capabilities, we also have improved performance on in-depth metadata extraction and on grounded entity recognition, the ability to name a character based on context clues in the video.
Concretely, for robotics and data teams that means: point Pegasus at raw egocentric clips and get back structured action labels, compliance ratings, and timestamps you can use directly in a training pipeline instead of a manual labeling pass that costs $4–$22/hour of footage.
Physical AI is a new domain for us, so if you're working with egocentric (human or teleoperated) data and hit edge cases, I want to hear about them. Thanks!
had a blast collaborating with @c3lim and the @TwelveLabs team on this new launch. S/O for the great work, ?makers