Open AI's API is very easy to use and largely just works. We used GPT 4o-mini for this because it's dirt cheap, fast and works very well for this use case.
There's nothing like it out there. Without Gandalf, Heimdall won't be possible. There's no way to securely request end-user data across platforms like Amazon, Instacart etc.
Vercel's AI SDK (especially the chatbot template) is the easiest way to get started building end-user applications with AI. It's very much in line with what Vercel is known to be good at - taking care of all the "muck" and letting you focus on what you want to build.
Heimdall 2.0
