Best Products
Launches
Launch archive
Most-loved launches by the community
Launch Guide
Checklists and pro tips for launching
News
Newsletter
The best of Product Hunt, every day
Stories
Tech news, interviews, and tips from makers
Changelog
New Product Hunt features and releases
Forums
Forums
Ask questions, find support, and connect
Kitty Points Leaderboard
The highest scoring community members
Streaks
The most active community members
Events
Meet others online and in-person
Advertise
Subscribe
Sign in
Clear text
recent
p/osaurus
by
tpae
•
3d ago
New support for Bonsai 27B models (perfect for 24GB RAM!)
... Quick follow-up from the Osaurus team. On Tuesday, PrismML released
Bonsai
27B, a big open source AI model compressed to a fraction of its normal size. A model like this usually needs 54 GB of memory, which means expensive cloud servers or a maxed-out workstation. This one fits in under 8 GB. That's small enough for a regular MacBook. Why this matters: the models keep getting smaller while staying smart. Every time that happens, "AI that runs ... ... closing fast. The catch was that the standard tools on Mac can't actually run models compressed this way yet. So we did the conversion work ourselves and shipped it. If you tried Osaurus during our launch this week,
Bonsai
3
14
Subscribe
Sign in