Why do 99% of finance apps force you to link your bank account?

Every budgeting app I look at requires you to log in and sync your bank account. I know it's for automation, but it completely kills the privacy aspect.

I've been building a local-first web app with zero database precisely because of this. I'd much rather manually enter my numbers for 2 minutes than hand over my financial API keys to a third-party server.

Am I the only one who thinks "auto-sync" is a massive privacy trade-off that nobody talks about? How do you guys handle this?