SCAO — Optimizer
I built a 2nd-order optimizer for LLMs.
2 followers
I built a 2nd-order optimizer for LLMs.
2 followers
54% faster LLM training. SCAO is a sparse, second-order PyTorch optimizer designed as a high-throughput, drop-in replacement for AdamW. - whispering3/scao
SCAO — Optimizer Reviews
Wispr FlowStop typing. Start speaking. 4x faster.
Reviews
Most Informative