Hi Hunters,
I’m Nicholas, co-founder of GPUDeploy.
GPUDeploy is like DoorDash or Airbnb for GPUs. You can launch an instance of on-demand A100s right now at $1.28/GPU/hour.
The previous iteration of this startup was a robotics company (drone delivery), which did not work out. However, training our RL models, we were renting GPUs and realized that what's out there is counterintuitive to use and overpriced - plus, the GPUs you want are always booked out.
Meanwhile, there are hundreds of unutilized, high-quality, cheap Nvidia GPU clusters out there. We have written software to make them available on-demand. We have GPUs online from data centers in Europe and the US and are offering them on-demand for wholesale prices that you would normally have to negotiate.
Any session you launch comes with ssh and Jupyter notebook access and is ready to be used for your machine learning needs immediately. I recently trained Andrej Karpathy's nanoGPT to plagiarize Shakespeare for <$0.20 on an RTX 4090.
We have H100s at $3.45, A100s at $1.28 and RTX 4090s at $0.49 available right now.
If you own any of these GPUs (AI company/hobbyist/data center), it is also super easy to take them online on our site and earn money. You can get in contact with us at contact@gpudeploy.com for custom onboardings or onboard yourself at www.gpudeploy.com/control. It takes 5 minutes and we are very flexible: you can take your node online and schedule offline time at any time. We are however opinionated on a high degree of reliability, while your node is online.
Compared to what's out there:
- we make it super simple to launch GPUs at wholesale prices now, no reservations, sales calls or the likes required.
- we have a very clean, to-the-point user experience.
- we don't put huge markups on the GPU prices.
Try it out!
Report
Hi Nicholas, congratulations on the launch of GPUDeploy! The concept of making high-quality GPUs accessible on-demand is brilliant. Your solution addresses the common pain points of high costs and limited availability, especially with top-tier GPUs like A100s and RTX 4090s. I appreciate the straightforward pricing and seamless user experience you've crafted. The flexibility for GPU owners to earn money is a fantastic addition. Looking forward to seeing how this evolves!
Report
Nicholas, GPUDeploy sounds like a game-changer for ML practitioners. The ability to access high-quality GPUs like A100s and H100s on-demand at such competitive prices is incredible. The ease of launching instances without the usual reservations and sales calls is a huge plus. Your focus on reliability and user experience is evident. Looking forward to seeing how this reshapes the GPU rental market!
Report
Nicholas, this is a game-changer for the AI community! The seamless integration of on-demand GPU access without the hassle of reservations or high markups is a much-needed solution. The ability to train models affordably and efficiently, as you demonstrated with nanoGPT, is impressive. Excited to see how GPUDeploy can revolutionize access to high-quality GPUs for everyone. Well done!
Report
@nicholas_waltz Cheers to a successful launch! Wishing you impactful and rewarding experiences. What feature are you most proud of?
Report
I wish you much success.
I am curious whether private people can also contribute (as a provider) or not and if yes what security steps do you take when dealing with private people as appose to companies?
Report
This is very much needed - how did you solve the cold start problem of curating supplies (assuming that's what you need to start with?). One thing I noted is the price doesn't specify the unit (per hour). I guess most folks in the industry understands, but it never hurts to lay it out clearly.
Also noticed you have a second hand marketplace for GPUs, what prompted you to do this?
I see that 4090's are in the list too - any thoughts on expanding this into the gamers' communities?
Congrats on launching this cool marketplace though @nicholas_waltz and team! Sorry the robotics project didn't work out, but glad to see something great coming out of it! #pivot
Report
Congrats on the launch of GPUDeploy! The ability to get on demand GPUs without the hassle of reservations or high prices is a huge win.
Report
Oh man, this is really amazing!
It's the marketplace similar to crypto mining but custom for AI.
Amazing thinking!
Report
Congrats on the launch @nicholas_waltz and Lukas Schneider - this will be awesome for all startups trying to train models and struggling to get GPU allocation right now!
Report
Hi, Nicholas, 😃 great launch and want to have a try, the launch title Airbnb for GPUDeploy made me think it's a decentralized service,where people can let their spare gpus make money for accelerating ai applications in a serverless/stateless style, I wish the onboarding process can be more easily for individuals who may only one or two or gpus or just even embedded devices
GPUDeploy