Launched this week
SCAO — Optimizer

SCAO — Optimizer

I built a 2nd-order optimizer for LLMs.

2 followers

Visit website
54% faster LLM training. SCAO is a sparse, second-order PyTorch optimizer designed as a high-throughput, drop-in replacement for AdamW. - whispering3/scao

SCAO — Optimizer makers

Here are the founders, developers, designers and product people who worked on SCAO — Optimizer

Danilo Souza
Danilo SouzaFullstack Developer
SCAO — OptimizerSCAO — Optimizer