Thanks for the feedback, and I’m sorry that it’s harsh. I’m willing to believe that it wasn’t conscious intent at publication time at least.
But it seems quite likely to me from the outside that if they thought the numbers were underestimating they’d have fixed them a lot faster, and unless that’s not true it’s a pretty severe ethics problem. I’m sure it was a matter of “it’s an error that’s not hurting anyone because charity is good, so it isn’t very important”, or even just a generic motivation problem in volunteering to fix it, some kind of rationalisation that felt good rather than “I’m going to lie for the greater good”- the only people advocating that outright seem to be other commenters- but it’s still a pretty bad ethics issue for an evaluator to succumb to the temptation to defer an unfavourable update.
I think some of this might be that the EA community was overly aggressive in finding them and sort of treating them as the animal charity GiveWell, because EA wanted there to be one, when ACE weren’t really aiming to be that robust. A good, robust evaluator’s job should be to screen out bad studies and to examine other peoples’ enthusiasm and work out how grounded it was, with transparent handling of errors (GiveWell does updates that discuss them and such) and updating in response to new information, and from that perspective taking a severely poor study at face value and not correcting it for years, resulting in a large number of people getting wrong valuations was a pretty huge failing. Making “technically correct” but very misleading statements which we’d view poorly if they came from a company advertising itself is also very bad in an organisation whose job is basically to help you sort through everyone else’s advertisements.
Maybe the sensible thing for now is to assume that there is no animal charity evaluator that’s good enough to safely defer to, and all there are are people who may point you to papers which caveat emptor, you have to check yourself, for now.
Copying my post from the Facebook thread:
Some of the stuff in the original post I disagree on, but the ACE stuff was pretty awful. Animal advocacy in general has had severe problems with falling prey to the temptation to exaggerate or outright lie for a quick win today. especially about health, and it’s disturbing that apparently the main evaluator for the animal rights wing of the EA movement has already decided to join it and throw out actually having discourse on effectiveness in favour of plundering their reputation for more donations today. A mistake is a typo, or leaving something up accidentally, or publishing something early by accident, and only mitigation if corrective action was taken once detected. This was at the minimum negligence, but given that it’s been there for years without making the trivial effort to fix it should probably be regarded as just a lie. ACE needs replacing with a better and actually honest evaluator.
One of the ways this negatively impacted the effectiveness discourse: During late 2015 there was an article written arguing for ethical offsetting of meat eating (http://slatestarcodex.com/.../vegetarianism-for-meat-eaters/), but it used ACE’s figures, and so understated the amounts people needed to donate by possibly multiple orders of magnitude.
More concerning is the extent to which the (EDIT: Facebook) comments on this post and the previously cited ones go ahead and justify even deliberate lying, “Yes, but hypothetically lying might be okay under some circumstances, like to save the world, and I can’t absolutely prove it’s not justified here, so I’m not going to judge anyone badly for lying”, as with Bryd’s original post as well. The article sets out a pretty weak case for “EA needs stronger norms against lying” aside for the animal rights wing, but the comments basically confirm it.
I know that answering “How can we build a movement that matches religious movements in output (http://lesswrong.com/.../can_humanism_match_religions.../), how can we grow and build effectiveness, how can we coordinate like the best, how can we overcome that people think that charity is a scam?” with “Have we considered /becoming pathological liars/? I’ve not proven it can’t work, so let’s assume it does and debate from there” is fun and edgy, but it’s also terrible.
I can think of circumstances where I’d void my GWWC pledge; if they ever pulled any of this “lying to get more donations” stuff, I’d stick with TLYCS and a personal commitment but leave their website.