We have found this exceptionally difficult due to the diversity of GFI’s activities and the particularly unclear counterfactuals.
Perhaps I am not understanding but isn’t it possible to simplify your model by honing in on one particular thing GFI is doing and pretending that a donation goes towards only that? Oxfam’s impact is notoriously difficult to model (too big, too many counterfactuals) but as soon as you only look at their disaster management programs (where they’ve done RCTs to showcase effectiveness) then suddenly we have far better cost-effectiveness assurance. This approach wouldn’t grant a cost-effectiveness figure for all of GFI, but for one of their initiatives at least. Doing this should also drastically simplify your counterfactuals.
I’ve read the full report on GFI by ACE. Both it and this post suggest to me that a broad capture-everything approach is being undertaken by both ACE and OPP. I don’t understand. Why do I not see a systematic list of all of GFIs projects and activities both on ACE’s website and here and then an incremental systematic review of each one in isolation? I realize I am likely sounding like an obnoxious physicist encountering a new subject so do note that I am just confused. This is far from my area of expertise.
However, this approach is a bit silly because it does not model the acceleration of research: If there are no other donors in the field, then our donation is futile because £10,000 will not fund the entire effort required.
Could you explain this more clearly to me please? With some stats as an example it’ll likely be much clearer. Looking at the development of the Impossible Burger seems a fair phenomena to base GFI’s model on, at least for now and at least insofar as it is being used to model a GFI donation’s counterfactual impact in supporting similar products GFI is trying to push to market. I don’t understand why the approach is silly because $10,000 wouldn’t support the entire effort and that this is somehow tied to acceleration of research.
Regarding acceleration dynamics then, isn’t it best to just model based on the most pessimistic conservative curve? It makes sense to me to think this would be the diminishing returns one. This also falls in line with what I know about clean meat. If we eventually do need (might as well assume we do for sake of being conservative) to simulate all elements of meat we’ll also have to go beyond merely the scaffolding and growth medium problem and also include an artificial blood circulation system for the meat being grown. No such system yet exists and it seems reasonable to suspect that the closer we want to simulate meat precisely the more our scientific problems rise exponentially. So a diminishing returns curve is expected from GFI’s impact—at least insofar as its work on clean meat is concerned.
This is a great post and I thank you for taking the time to write it up.
I ran an EA club at my university and ran a workshop where we covered all the philosophical objections to Effective Altruism. All objections were fairly straightforward to address except for one which—in addressing it—seemed to upend how many participants viewed EA, given what image they thus far had of EA. That objection is: Effective Altruism is not that effective.
There is a lot to be said for this objection and I highly highly recommend anyone who calls themselves an EA to read up on it here and here. None of the other objections to EA seem to me to have nearly as much moral urgency as this one. If we call this thing we do EA and it is not E I see a moral problem. If you donate to deworming charities and have never heard of wormwars I also recommend taking a look at this which is an attempt to track the entire debacle of “deworming-isn’t-that-effective” controversy in good faith.
Disclaimer: I donate to SCI and rank it near the top of my priorities, just below AMF currently. I even donate to less certain charities like ACE’s recommendations. So I certainly don’t mean to dissuade anyone from donating in this comment. Reasoning under uncertainty is a thing and you can see these two recent posts if you desire insight into how an EA might try to go about it effectively.
The take home of this though is the same as the three main points raised by OP. If it had been made clear to us from the get-go what mechanisms are at play that determine how much impact an individual has with their donation to an EA recommended charity, then this EA is not E objection would have been as innocuous as the rest. Instead, after addressing this concern and setting straight how things actually work (I still don’t completely understand it, it’s complicated) participants felt their initial exposure to EA (such as through the guide dog example and other over-simplified EA infographics that strongly imply it’s as simple and obvious as: “donation = lives saved”) contained false advertising. The words slight disillusionment comes to mind, given these were all dedicated EAs going into the workshop.
So yes, I bow down to the almighty points bestowed by OP:
many of us were overstating the point that money goes further in poor countries
many of us don’t do enough fact checking, especially before making public claims
many of us should communicate uncertainty better
Btw, Scope insensitive link does not seem to work I’m afraid (Update: Thanx for fixing!)