Does offering infinite customization options secretly ruin the user experience for everyone else?

We wanted to please every enterprise customer so we built settings and toggles for literally everything. But every new toggle added technical debt and made the interface cluttered for standard users who just wanted things to work out of the box. We realized that true product confidence is knowing what not to build.
How do you decide when a customer request is a core product need versus a custom edge case?