Peter Wang

Peter Wang

Just a lazy guy building lazy tools
12 points
All activity
Peter Wangstarted a discussion

How We Built a Solution Runs Long-Lived LLM Agents

Introduction Most cloud platforms—AWS, GCP, Azure—are optimized for stateless web apps or short-lived serverless functions. But deploying long-lived, stateful LLM agents is another beast entirely. You need durability, resilience, and observability. When we tried to push our own multi-agent AI system to production, we hit walls with all the complex infrastructure work that not only took hours...

Peter Wangstarted a discussion

Anyone else running into same problem deploying long-running AI agents?

I’ve been working on some AI projects recently — things like scheduled agents, API responders, and multi-agent systems that need to run continuously. One of the biggest headaches I’ve run into is deployment. Most cloud platforms (AWS, GCP, etc.) are built for stateless apps or short-lived functions. But for long-running, stateful agents, the kind that need to persist data, auto-recover from...