Is running hosted open-source AI models really cheaper than paying for API calls?

My monthly api bills for proprietary models are getting pretty high as a solo dev. Thinking about switching to hosted llama or mistral on cloud servers but I'm worried about server upkeep and paying for idle GPU time. Not sure if the monthly server bill actually ends up saving anything. For anyone running self-hosted models are you actually saving money compared to normal api keys?