Anyone else realize that moving faster can sometimes create more work?

When started I thought the best way to make progress was to keep shipping. If something wasn’t working build a new version add the feature try another idea and keep moving. But after a while i noticed that moving too fast can create its own problems. Unfinished work piles up old decisions become harder to change and suddenly you’re spending more time cleaning things up than actually moving forward. How do you know when you’re moving fast enough and when slowing down would actually help you get further?