Allen Institute of Artificial Intelligence
AI for the Common Good.
280 followers
AI for the Common Good.
280 followers
Objaverse is A massive dataset with 800k+ annotated 3D objects. Objaverse improves upon present day 3D repositories in terms of scale, number of categories, and in the visual diversity of instances within a category.
This is the 9th launch from Allen Institute of Artificial Intelligence. View more
Olmo Hybrid
Launching today
Olmo Hybrid is a fully open 7B model that combines transformer attention with linear RNN layers. Utilizing a 3:1 pattern of Gated DeltaNet to attention, it matches the accuracy of Olmo 3 on MMLU while using 49% fewer tokens.
Free
Launch Team
Flowtica Scribe
Hi everyone!
AI2’s new Olmo Hybrid is the first hybrid 7B that clearly beats a pure transformer baseline (Olmo 3) in a fair fight.
Same size as Olmo 3, trains at the same speed, but matches its accuracy with half the data and crushes long-context evals. The 3:1 RNN+attention mix just works.
Super clean weights on HF. And you can even run the full model 100% locally in your browser on WebGPU!