238 followers
What do you think? …
Osaurus
nanochat is Andrej Karpathy's capstone project for LLM101n by Eureka Labs.
It's a full-stack LLM implementation in ~1000 lines of clean, hackable code (Python, Rust, HTML, Shell).
You can run the entire pipeline—tokenization, pretraining, finetuning, evaluation, inference, and web UI—on a single 8XH100 node for under $1000.
It achieves competitive performance (~4e19 FLOPs, $100 tier model) without massive frameworks.
Its purpose is to make LLMs accessible and understandable for developers who want to learn by doing!
nice concept. can i run on macbook m1 pro? if i can, it might be awesome.
Amazing concept—democratizing LLMs at this price point is a founder’s dream!!
Osaurus
nanochat is Andrej Karpathy's capstone project for LLM101n by Eureka Labs.
It's a full-stack LLM implementation in ~1000 lines of clean, hackable code (Python, Rust, HTML, Shell).
You can run the entire pipeline—tokenization, pretraining, finetuning, evaluation, inference, and web UI—on a single 8XH100 node for under $1000.
It achieves competitive performance (~4e19 FLOPs, $100 tier model) without massive frameworks.
Its purpose is to make LLMs accessible and understandable for developers who want to learn by doing!
nice concept. can i run on macbook m1 pro? if i can, it might be awesome.
Amazing concept—democratizing LLMs at this price point is a founder’s dream!!