Rifky Bujana Bisri

Rifky Bujana Bisri

Kolosal AIKolosal AI
Optimizing LLM Deployment on device
14 points

Forums

Rifky Bujana Bisriβ€’

12mo ago

Kolosal AI - Train and run LLMs on your device

Open-source platform to train, download, and run LLMs on device. Kolosal is designed to be fast, lightweight, and sustainable. It’s only 20 MB in size, yet it can run LLMs just as quickly or even faster than other competitors.