Extracted Post Text

How I Accidentally DDoS'd Our Production Database (and What I Learned) So last Tuesday at 3am I got paged because our Postgres CPU was at 100%. Turns out my "harmless" migration script had a missing WHERE clause on an UPDATE statement. It was updating every row in the users table with a bcrypt hash. Every. Single. Row. Here's what happened and how we recovered.

Breakdown