The staging cron job that sent 5,000 real push notifications

by•

Restored a production database snapshot onto our staging server to debug a data edge case.

Completely forgot that staging had an active cron job that sends daily digest notifications. Because the staging database had real user push tokens, the test server triggered thousands of live notification pings to actual users with mock text.

Had to write an apologetic post-mortem to the entire product team before lunch.

1 view

Add a comment

Replies

Be the first to reply

Have a question or a thought to share? Add a comment above to start the conversation.