I did not check my analytics for six weeks and my retention increased.

This is completely counterintuitive, and here’s why. I was monitoring the dashboard on a daily basis and whenever I saw a drop, I acted on it. Whether it was a new tooltip, or an email, or any other little push that felt right.

But together all these pushes made the product look unstable – like something that could not decide what it wants from its users at the moment.

I stopped looking at it every day, and delivered only what I truly believed in – namely, a digest that users have asked for several times in their emails. And retention gradually started going up, not because of the digest, but because of the absence of action.

And while I’m definitely not saying you should ignore your data, it could very well be that acting on every little dip in your chart is even worse than doing nothing at all.

Have you ever done the same thing?