Thank you for sharing this clear write-up with many lessons and best practices/âtips that seem valuable for other organisations as well.
Iâve personally been consistently impressed with AACâs work and the way you are evaluating and constantly improving on your programmes over the past years, and very excited to see where youâll be going next!
Thanks a lot for doing this evaluation, Joel! Youâve been great to work with throughout the process, e.g. respectful of our time but also asking some good, challenging questions. I hope weâll see more external evaluations from CEARCH (and others) of effective giving organisations in the near future, as I think it will benefit the whole space in multiple ways (increased transparency and accountability, shared learnings, information for potential donors, etc.).
Thanks Elizabeth, Owen, Brad and Kirsten for the constructive feedback! I agree that the post in its current form doesnât live up to the epistemic standards we aspire to at GWWC, for many of the reasons you mention. My apologies for this.
The research team usually reviews any public impact claims we make, but this post slipped through the cracks of our review process in part because the main topic (i.e. âmisconceptions about the pledgeâ) didnât immediately seem research-related. Weâll tighten up the process to prevent this from happening in the future. Iâve now also reviewed and weâll edit the post on the points you mentioned + a few others. Weâll post here once thatâs done.
Thanks again for holding us accountable!
Congratulations both to Zach for taking on this important role and to CEA for finding such a capable candidate! Based on my personal interactions with Zach, Iâm excited to see where heâll lead CEA and optimistic about him contributing to a strong, principles-based EA community. He seems to me a person both of high integrity and professionalism, who deeply cares about making the world a better place, and who is able to set and execute on a vision. From a GWWC perspective, also looking forward to collaborating with him in his new capacity on making effective giving and effective altruism principles more broadly more of a global norm!
Agreed (though personally I might be willing to make a bet if e.g. fund manager selection is done well)
Very excited about this, both about the clarification of scope and the scope itself.
I strongly agree there is currently a gap in terms of principles-first EA funders, and also largely agree with the way youâve outlined âprinciples-first EAâ here. I think this new scope will make me seriously consider becoming a donor to the EAIF in the new year.
Thatâs great to hear Jonas, please let us know if we can do anything else to help! As mentioned in our reports and back when we announced the project, part of the motivation for doing this work is to support other effective giving organisations like Giv Effektivt to be able to make more informed decisions on their recommendations.
And yes, agree that these comments provide a bit of the next layer⌠letâs see where it stops!
Thanks Andrew. I hope I answered most of your question by my response to MHR above, but on the EV part: (caveating that I am not speaking on behalf of EV here nor have legal expertise on the governance question, but giving my personal understanding of the situation here)
GWWC and EA Funds are separate projects within EV; are managed separately; and communicate separately. I would be surprised if we were to discontinue supporting the EA Funds on our donation platform, given they clearly meet our inclusion criteria, but there is no need/âpressure for us to recommend EA Funds (e.g. we currently donât recommend the EA GHD Fund nor the EA Infrastructure Fund, as we havenât looked into them yet). We acknowledge the conflict of interest, but I hope our reports on the EA AWF and EA LTFF show we are not holding back on pointing out where we think EA Funds can improve.
As I understand it, there are legal restrictions EV (including GWWC and EA Funds) has to obey, and if EA Funds would ever allocate funding in ways that arenât in accordance with EVâs stated purpose that would obviously have consequences, but Iâd expect those types of situations wonât have much to do with GWWC in particular.
Thatâs about as much as I know to say on this; hope it answers your question!
Thank you! Great question. I canât speak on behalf of EA Funds and their plans going forward, but I can say our new GWWC cause area funds are meaningfully different from their funds (at least as theyâve been operating so far).
The biggest differences IMO are
The EA Funds generally (with the exception of the GHD Fund) only make grants to organisations that apply for funding with them.
The EA Funds are managed by a limited set of expert grantmakers.
Our GWWC cause area funds, on the other hand, ultimately aim to cover recommendations and grantmaking by nearly all impact-focused evaluators and grantmakers, based on our evaluations of these evaluators, but we donât accept any grant applications ourselves.
For instance, EA Funds currently doesnât consider any of Founders Pledgeâs or Longviewâs evaluations or active search for high-impact opportunities to inform their grantmaking, whereas our GWWC Funds do (or will do in the case of Founders Pledge) and additionally consider EA Funds as a grantmaker/âevaluator.
For the EA GHD Fund and the GWWC GH&W Fund in particular, the difference is currently less pronounced. This is because we ended up working with GiveWell based on our initial evaluations, and EA Funds has historically asked them to advise their fund as well. However, this could easily change in the short- to medium-term, e.g. we hope to evaluate both Happier Lives Institute and Founders Pledge next year as candidates for evaluators informing our GH&W Fund grantmaking in addition to GiveWell.
Hope that clarifies a bit! Happy to elaborate further on the differences if helpful.
Thank you! As we mention in the report, weâre grateful for how youâve engaged with our evaluations process, and I think this comment is a good illustration of the open, constructive and collaborative attitude youâve had throughout it. We look forward to re-evaluating ACEâs work next year, and in the meantime remain excited to host many of ACEâs funds and recommendations on our donation platform as promising opportunities for donors to consider.
Hi Moritz, yes if you ask me personally, I would currently lean towards recommending MG over a randomly picked ACE recommended charity, though Iâm far from confident in this /â itâs not a claim I would be able to justify to the extent we usually want to justify our recommendations as GWWC. Itâs mainly based on my view that the difference between the AWF and MG is fairly small (both are broadly trying to make cost-effective grants and are getting promising applications on the margin), whereas our criticism of ACEâs charity evaluations process a bit more fundamentally challenges it coming up with highly cost-effective donation opportunities on the margin (though I also donât want to overstate our conclusion there). I would furthermore guess that MG is/âwill be more funding-constrained relative to its aims/âapplications than most of ACEâs individual charity recommendations. (but really, this is a guess: note that I havenât looked into the charity recommendations individually!)
Thanks for your question!
The important nuance here is that while we did not think ACEâs current charity evaluation process measures marginal cost-effectiveness to a sufficient extent to directly rely on ACEâs recommendations, that isnât the same as the (stronger) claim that its recommendations are necessarily worse donation opportunities than the AWF or THLâs corporate campaigns, and it also isnât the same as claiming that ACEâs process doesnât track marginal cost-effectiveness at all.
We canât say confidently how ACEâs (other) recommendations compare to the AWF or THLâs corporate campaigns, as we havenât individually evaluated and compared them. So we want to offer donors who have the time and expertise to look into these promising individual charities the opportunity to do so and potentially donate to them if they find them to be maximising impact by their worldview, as we do for many more charities and funds on our platform that we canât currently justify recommending (for instance because they havenât been evaluated (yet)).
You may also be interested in our answer to this somewhat related question under the AMA post.
Thank you, Peter, weâre obviously very happy to hear this!
So by default, GFI, Sinergia, Fish Welfare Initiative, Kafessiz and DVF were all excluded from potentially being identified (which seems illogical, as there is no obvious reason to think that charities evaluated in 2022 would be less cost-effective)
Yes they were, as were any other charities than the three charities we asked ACE to send us more information on (based on where they thought they could make the strongest case by our lights). Among those, we think ACE provided the strongest case for THLâs corporate campaigns, and with the additional referral from Open Phil + the existing public reports by FP and RP on corporate campaigns, we think this is enough to justify a recommendation. This is what I meant by there indeed being a measurability bias in our recommendation (which we think is a bullet worth biting here!): we ended up recommending THL in large part because there was sufficient evidence of cost-effectiveness readily and publicly available. We donât have the same evidence for any of these other charities, so they could in principle be as or even more cost-effective than THL (but also much less!), and without the evidence to support their case we donât (yet) feel justified recommending them. We donât have capacity to directly evaluate individual charities ourselves (including THL!), but continue to host many promising charities on our donation platform, so donors who have time to look into them further can choose to support them.
To put this differently, the choice for us wasnât between âevaluating all of ACEâs recommendationsâ and âevaluating only THL /â three charitiesâ (as we didnât have capacity to do any individual charity evaluations). The choice for us was between âonly recommending the AWFâ and ârecommending both the AWF and THLâs corporate campaignsâ because there happened to already be sufficiently strong evidence/âevaluations available for THLâs corporate campaigns. For reasons explained earlier, we stand by our decision to prefer the latter over the former, even though that means that many other promising charities donât have a chance to be recommended at this point (but note that this is the case in charity evaluation across cause areas!).
Given you only looked at three of the ACE 2023 recommendations (and you didnât say which ones), Iâm wondering how you can make such a strong claim for all of ACEâs recommended charities?
Could you clarify which âstrong claim for all of ACEâs recommended charitiesâ you are referring to? From the executive summary of our report on ACE:
We also expect the gain in impact from giving to any ACE-recommended charity over giving to a random animal welfare charity is much larger than any potential further gain from giving to the AWF or THLâs corporate campaigns over any (other) ACE-recommended charity, and note that we havenât evaluated ACEâs recommended charities individually, but only ACEâs evaluation process.
On a slightly unrelated point: For the referral from OP, I would be curious to hear if you asked them âWhat is the most cost-effective marginal giving opportunity for farmed animal welfareâ (to which they replied THLâs corporate campaigns) or something closer to âDo you think THL is a cost-effective giving opportunity on the margin?â
The latter, because a referral by OP on its own wouldnât have been sufficient for us to make a recommendation (as we havenât evaluated OP): for recommending THLâs corporate campaigns, we really relied on these four separate pieces of evidence being available.
I should have said âOne of the top 2 marginal giving opportunitiesâ but I still think I stand by my point that many experienced animal advocates would disagree with this claim, and itâs not clear that your charity recommendation work has sufficient depth to challenge that (e.g. you didnât evaluate groups yourself), in which case itâs not clear why folks should defer to you over subject-matter experts (e.g. AWF, OP or ACE).
Weâre not even claiming it is one of the top 2 marginal giving opportunities, just that it is the best recommendation we can make to donors based on the information available to us from evaluators. If you could point us to any alternative well-justified recommendations/âevaluators for us to evaluate, weâd be all ears.
And we donât claim people should defer to us directly on charity evaluations (again, we donât currently do these ourselves!). Ultimately, our recommendations (including THL!) are based on the recommendations of the subject-matter experts you reference. The purpose of our evaluations and reports is to help donors make better decisions based on the recommendations and information these experts provide.
Thanks Harfe, I think itâs technically captured by the framework (e.g. one can promote earning to give either through pledges or broad fundraising), but it doesnât fit neatly into it /â come out of it naturally, so thanks for pointing it out! See also this other memo I wrote for my broader thoughts on this topic :).