Leiolai runs inference across devices people already own instead of data centers. It saves water with inference and pays users for the computation their devices provide. The free app gives users access to leiolai-1, with an 11-million-token context window and continuous generation. Developers can use the model through an OpenAI-compatible API starting at $0.01 per million input tokens and $0.02 per million output tokens.
