The staging cron job that sent 5,000 real push notifications
by•
Restored a production database snapshot onto our staging server to debug a data edge case.
Completely forgot that staging had an active cron job that sends daily digest notifications. Because the staging database had real user push tokens, the test server triggered thousands of live notification pings to actual users with mock text.
Had to write an apologetic post-mortem to the entire product team before lunch.
1 view
Replies
Be the first to reply
Have a question or a thought to share? Add a comment above to start the conversation.