Desktop AI for ops is still subsidized. What happens when users pay the bill?

by

I'd like to share an opinion on the current situation in AI ops, not the coding/tech side.

Right now the market has a pretty clear pattern. Big labs like OpenAI, Anthropic and xAI are building their own desktop AI and computer-use apps. The trick is they still treat this segment as Growth. Maturity is far away. So the biggest players burn money acquiring customers and giving them huge subsidies on tokens vs real cost.

Today the world is getting a huge AI bill, mostly paid by investors. We're running on debt. If there is no real breakthrough, math doesn't lie, there will have to be a cost-effective compromise. Using heavy models for coding is justified. Using them for the simplest things in operations is not, economically.

Our tests: open source models like GLM or Kimi, hosted by big US inference providers, do fine on day-to-day work and are sometimes 5x-7x cheaper (depends on config and model).
Benchmarks made by Artificial Analysis:

Our bet is simple. The AI bill will move from investors to users (mostly B2B). Companies will need an app like GPT Desktop, Claude Desktop, Grok Bot, with enterprise-grade integrations, but with the option to use open source and self-hosted models. The big labs can't really agree to that, they lose the token margin.

Worth mentioning Cursor here. Building a BYOK software wrapper without your own lab is an endless chase for margin, walking a thin line. Even at their scale it ended with an acquisition by a lab.

PS. I think it was a brilliant move by xAI/SpaceX. They got the data and the distribution, which in their case will be priceless.

Building this kind of software for daily ops work is not easy. Nobody said it was impossible and we will try to build --

36 views

Add a comment

Replies

Be the first to comment