The screen that confuses your AI agent also confuses your new users

Something we keep running into on client work, and I haven't seen anyone name it.

When you paste a screenshot into Cursor or Claude and ask for a change, the agent sometimes edits the wrong element. Everyone treats this as a model problem. Crop harder, describe the element in text, wait for better models.

But watch which screens it happens on. It's never the simple ones. It's the dashboard with 5 competing panels, the settings page with 3 things called "Account", the pricing section where 2 buttons look equally important. The agent picks the most visually dominant element and gets it wrong because the screen has no clear hierarchy.

New users fail on those exact screens. Same reason. They can't tell what matters either.

We've started using this as a cheap audit on client products: if the agent keeps getting a screen wrong, we look at the hierarchy before blaming the model. It has caught real design problems faster than user testing did.

Anyone else noticed this overlap? Curious whether it holds outside the products we work on.