For some reason, blacklists aren't applied after rebooting kiki / herb (and perhaps others).
https://github.com/metabrainz/fabric-ip-blacklist