GPUStack

GPUStack

Manage GPU clusters for running LLMs

About

GPUStack, an open-source GPU cluster manager for running Large Language Models (LLMs). GPUStack allows you to create a unified cluster from any brand of GPUs in Apple MacBooks, Windows PCs, and Linux servers. Administrators can deploy LLMs from popular repositories such as Hugging Face. Developers can then access LLMs just as easily as accessing public LLM services from vendors like OpenAI or Microsoft Azure.

Badges

Tastemaker
Tastemaker
Gone streaking
Gone streaking

Maker History

  • GPUStack
    GPUStackgpustack/gpustack: Manage GPU clusters for running LLMs
    Jul 2024
  • 🎉
    Joined Product HuntJune 24th, 2024

Forums

GPUStack

1yr ago

GPUStack - gpustack/gpustack: Manage GPU clusters for running LLMs

GPUStack, an open-source GPU cluster manager for running Large Language Models (LLMs).
View more