Magma
Foundation Model for Multimodal AI Agents.
65 followers
Foundation Model for Multimodal AI Agents.
65 followers
Magma, the flagship project form Microsoft Research, is the first-ever foundation model for multimodal AI agents, designed to handle complex interactions across both virtual and real environments!
Flowtica Scribe
Hi everyone!
Sharing Magma, a new open-source foundation model from Microsoft Research, and it's a big deal for AI agents. Unlike most multimodal models, Magma isn't just for understanding images and text, it's designed to act in both digital and physical environments (think UI navigation and robot manipulation).
It's all based on a new pretraining approach using Set-of-Mark (SoM) and Trace-of-Mark (ToM) to connect vision, language, and actions. They've achieved SOTA results on UI navigation and robotics tasks, and it performs well on standard vision-language benchmarks.
Seems like AI agents are getting closer to actually understand and intereact with real world?🤔
Multi dimensional product with complex real time approach through virtual medium will set a true benchmark on operations ease.