One thing I underestimated when I started building with AI was how quickly API costs could become an important part of the business.
Getting an AI feature working is relatively straightforward. Making sure it remains affordable as more people start using it is a different challenge.
While working on my project, I started paying closer attention to how often the application makes requests, how much each interaction costs, and what happens when users become more active.