Ghostlink
Run local LLMs across heterogeneous clusters
11 followers
Run local LLMs across heterogeneous clusters
11 followers
Distributed LLM inference fabric for heterogeneous local clusters. Features zero-copy SPSC ring buffers, automated tuning, and an OpenAI-compatible API. - rwilliamspbg-ops/Ghostlink
Ghostlink Reviews
Reviews