As pointed out by The Roundup, the inference space is booming right now.
Last week, @Baseten raised $300M at $5B valuation. They just announced the acquihire of @Inferless to "accelerate innovation in inference infrastructure."
One of the toughest engineering challenges we tackled at Inferless was Cold Starts a critical factor in evaluating true Serverless AI inference platforms.
Check out the video to learn how we made that happen along with a real example: Watch the demo here