I also love this quote from the same post for how it emphasises just how rare it is even on (non-naive) utilitarian grounds that serious rule-breaking is Good:
I worry that in the Peter Singer brand of altruism—that met with the Lesswrong Sequences which had a lot more Nozick libertarianism in it, and gave birth to effective altruism somewhere in the middle—there is too much Good and not enough Law, that it falls out of second-order rule utilitarianism into first-order subjective utilitarianism, and rule utilitarianism is what you ought to practice unless you are a god.
I also love this quote from the same post for how it emphasises just how rare it is even on (non-naive) utilitarian grounds that serious rule-breaking is Good: