Ever been greeted by something very wrong bright and early in the morning? I checked my email this morning when I got up … no new messages. First thought … oh sh*t … what broke? Checked the mail logs and they were full of errors. Joy. Re-build postfix (after reminding myself what version of berkeley db to compile against). That fixes errors. Thunderbird tells me I have 3 new emails. Oh sh*t … they’re empty! Log into firewall and block incoming smtp for the time being. Check the processes that should be running and discover that SpamAssassin was broken. Determined that I really should have followed the post-install instructions for upgrading perl last night. D’oh. Run post-install scripts while pondering who the hell hard-codes a perl version into their scripts. Restart SpamAssassin and test. Re-enable incoming smtp and test. Send out outage message about the problem (yay, at least mailman still works).