When does getting feedback stop helping and start slowing you down?

I used to ask half a dozen people for their thoughts every time I built a new feature thinking it would save me from making mistakes. Instead, I usually ended up with three totally opposite directions and spent all my time second-guessing my original plan. At some point you just have to stop polling people and ship the thing.

How do you filter out the noise when everyone around you has a different opinion on what you should build next?