OpenAI+Azure Load Balancer
OpenAI + Azure load balancer and fail safe for GPT requests
1 follower
OpenAI + Azure load balancer and fail safe for GPT requests
1 follower
The OpenAI Load Balancer is a Python library designed to distribute API requests across multiple endpoints (supports both OpenAI and Azure). It implements a round-robin mechanism for load balancing and includes exponential backoff for retrying failed requests.
OpenAI+Azure Load Balancer launches
Launch date
Open Source OpenAI+Azure Fail SafeOpenAI + Azure load balancer and fail safe for GPT requests
Launched on November 22nd, 2023