Evidence of effectiveness and transparency of a few effective giving organisations
Summary
Effective giving can be quite impactful.
I estimated the factual non-marginal multipliers until 2021 of Ayuda Efectiva (Spain), Doebem (Brazil), Effektiv Spenden (Germany), and Giving What We Can (GWWC), i.e. how much donations they moved per dollar spent. Those of Ayuda Efectiva (1.34) and Doebem (5.53) are much lower than those of Effektiv Spenden (61.2) and GWWC (135).
However, the results might differ accounting for future donations (received after 2021, but caused until then), counterfactuals, diminishing marginal returns, cost-effectiveness of caused donations, and indirect impacts of effective giving. Furthermore, the organisations were at different levels of maturity. Consequently, my estimates for the factual non-marginal multipliers are not directly comparable, and I do not know which of the 4 organisations are more effective at the margin.
I did not find any proper cost-effectiveness analyses of Ayuda Efectiva, Doebem or Effektiv Spenden. I encourage these and other effective giving organisations as well as their funders (namely, Open Philanthropy) to do and publish cost-effectiveness analyses of their work (ideally including the indirect impacts of effective giving), as GWWC has done.
Introduction
Effective giving can be quite impactful:
Supporting with 0.399 $/âyear the corporate campaigns for chicken welfare of The Humane League might be enough to neutralise the suffering of factory-farmed animals caused by a random person[1]. This estimate can easily be off by a factor of 10, but illustrates that the (financial and non-financial) costs/âsavings of switching to a fully plant-based diet may well be much higher[2].
Helen Keller Internationalâs vitamin A supplementation program has a cost-effectiveness of 3.5 k$ per life saved, i.e. one can save 13.8 lives (= 48.3/â3.5) for the average transaction price of new cars in the United States in April 2023 of 48.3 k$.
So there are good reasons for giving effectively and significantly to become a cultural norm. This is a primary goal of effective giving organisations, and I have estimated the factual non-marginal multiplier of a few of them to get a sense of whether they are accomplishing it effectively. To clarify:
A factual non-marginal multiplier of x means the effective giving organisation moved x $ of donations (hopefully to effective organisations) for each dollar it spent.
A counterfactual non-marginal multiplier of y means the effective giving organisation caused y $ of donations for each dollar it spent.
A counterfactual marginal multiplier of z means the effective giving organisation would have caused z $ of donations for each additional dollar it had spent.
y < x because effective giving organisations do not cause all the donations they move[3], and z < y owing to diminishing marginal returns. The effective giving organisations is underfunded if z > 1, as long as the counterfactual marginal multiplier includes all relevant effects.
I was curious about Ayuda Efectiva and Doebem because their results could be more generalisable to Portugal (where I am from). I looked into Effektiv Spenden owing to it being regarded as a successful example of effective giving, and included GWWC as a major reference in this space.
Methods
I calculated the factual non-marginal multipliers from the ratio between donations received to be directed towards effective organisations and costs[4]. I neglected future donations, and did not account for the opportunity cost of workers and volunteers. The greater the future donations, the greater my underestimation of the factual multipliers. The greater the opportunity cost, the greater my overestimation of the factual non-marginal multipliers[5]. I converted all values to 2021-USD, using exchange rates from OECD, and inflation data from The World Bank[6].
I did not study the counterfactual donations, i.e. how much donations would have been made in the absence of the effective giving organisation. As an example of why this matters, it might be the case that the early donations of new effective giving organisations are mostly caused by GWWC or effective altruism, with only a small fraction being due to new donors or increased donations (as a consequence of tax benefits) from people who were already effective givers.
I have not adjusted the amount of donations for their effectiveness[7]. I have also not modelled the indirect impacts of effective giving:
Advocating for effective altruism.
Improving effective altruism culture.
Indirectly moving money to effective charities.
However, I believe the above may be the major driver for the impact of effective giving organisations.
My calculations are in this Sheet (see tab âTOCâ).
Results
Ayuda Efectiva
Year | Factual non-marginal multiplier | ||
|---|---|---|---|
2019 | 0.578 | 0[10] | 0 |
2020 | 85.2 | 56.3 | 0.660 |
2021 | 156 | 268 | 1.72 |
2019 to 2021 | 242 | 324 | 1.34 |
Doebem
Year | Costs[11] (k$) | Donations[11] (k$) | Factual non-marginal multiplier |
|---|---|---|---|
2017 | 0.364 | 0.726 | 1.99 |
2018 | 4.07 | 5.63 | 1.38 |
2019 | 0.592 | 3.44 | 5.82 |
2020 | 0.692 | 12.6 | 18.2 |
2021 | 0.596 | 12.6 | 21.1 |
2017 to 2021 | 6.32 | 35.0 | 5.53 |
Effektiv Spenden
Year | Factual non-marginal multiplier | ||
|---|---|---|---|
2019 | 67.6 | 426 | 6.30 |
2020 | 154 | 3.49 k | 22.7 |
2021 | 207 | 22.3 k | 108 |
2019 to 2021 | 429 | 26.2 k | 61.2 |
Giving What We Can
Year | Costs[13] (k$) | Factual non-marginal multiplier | |
|---|---|---|---|
2009 | 0 | 70.8 | Infinity |
2010 | 0 | 269 | Infinity |
2011 | 0 | 1.19 k | Infinity |
2012 | 75.6 | 1.83 k | 24.2 |
2013 | 151 | 3.30 k | 21.8 |
2014 | 151 | 7.99 k | 52.8 |
2015 | 101 | 14.1 k | 140 |
2016 | 50.4 | 13.1 k | 260 |
2017 | 89.9 | 16.1 k | 179 |
2018 | 89.9 | 19.1 k | 213 |
2019 | 89.9 | 33.3 k | 371 |
2020 | 307 | 39.7 k | 130 |
2021 | 392 | 51.7 k | 132 |
2009 to 2021 | 1.50 k | 202 k | 135 |
Discussion
Factual non-marginal multipliers
The factual non-marginal multiplier until 2021 of Ayuda Efectiva (1.34) and Doebem (5.53) are much lower than those of Effektiv Spenden (61.2) and GWWC (135). However, the results might differ accounting for future donations (received after 2021, but caused until then), counterfactuals, diminishing marginal returns, cost-effectiveness of caused donations, and indirect impacts of effective giving. Furthermore, the organisations were at different levels of maturity in 2021:
Ayuda Efectiva spent 273 k$ until then, and professionalised in 2020.
Doebem spent 6.32 k$ until then, and professionalised in 2023.
Effektiv Spenden spent 429 k$ until then, and professionalised in 2019.
GWWC spent 1.50 M$ until then, and professionalised in 2012.
Consequently, my estimates for the factual non-marginal multipliers are not directly comparable, and I do not know which of the 4 organisations are more effective at the margin. Nevertheless, the counterfactual marginal multipliers adjusted for cost-effectiveness and indirect impacts should ideally be equal. In other words, donating to any effective giving organisation should be similarly effective taking into account all effects.
Cost-effectiveness
The donations until now of Ayuda Efectiva, Doebem and Effektiv Spenden went almost exclusively to organisations working on global health and development, animal welfare and climate change[15]. The cost-effectiveness of these areas is quite unclear to me[16] (see also section 4.2 of Mogensen 2019). Additionally, 81.0 % (= 207107.47/â255640.20) of Doebemâs donations have gone to Brazilian organisations, which are arguably closer to neutral than GiveWellâs top charities (for better or worse[17]). Focussing on donations to local organisations could make sense if Brazilian donors would hardly be persuaded to do otherwise.
In contrast, 11 % and 15 % of GWWCâs pledge and non-pledge donations went towards the area of creating a better future, which I think is much more effective. I do not think this corresponds to an extreme position. For example, Benjamin Todd âwould donate [in November 2021] to the Long Term Future Fund over the global health fund, and would expect it to be perhaps 10-100x more cost-effective (and donating to global health is already very good)â. 80,000 Hours thinks global health is âimportant and underinvested inâ, but it is not one of the 18 areas which are part of its list of the most pressing problems.
Evidence of effectiveness and transparency
I did not find any proper cost-effectiveness analyses of Ayuda Efectiva, Doebem or Effektiv Spenden. Ayuda Efectiva has an impact page, but it does not include any information about giving multipliers. Sebastian Schwiecker and Anne Schulze suggest Effektiv Spendenâs non-marginal counterfactual multiplier is âbetween 11 and 91â based on other models, but these do not study the counterfactuality of Effektiv Spendenâs donations. GWWC says Founders Pledge âhas conducted an extensive evaluation highlighting its [Effektiv Spendenâs] cost-effectiveness as part of its work on Giving Multipliersâ, but I only found one unrelated occurrence of âEffektiv Spendenâ in its report[18]. Sjir Hoeijmakers commented Founders Pledge has an interval evaluation on Effektiv Spenden.
The funders of effective giving organisations have published little/âno information about their cost-effectiveness. Here is Open Philanthropyâs write-up recommending a grant of 2.18 M$ to Effektiv Spenden in November 2022:
Open Philanthropy recommended a grant of âŹ2,180,000 (approximately $2,120,000 at the time of conversion) to Effektiv Spenden for general support. Effektiv Spenden works to communicate ideas related to effective altruism and effective giving to German-speaking audiences.
This falls within our focus area of growing and empowering the EA community.
Open Philanthropy has similar write-ups recommending grants of 225 k$ to Ayuda Efectiva in February 2023, and 2.36 M$ to GWWC in the same month. Founders Pledge does not have a write-up for the grant of 179 k$ they made to Effektiv Spenden in January 2023.
I encourage Ayuda Efectiva, Doebem, Effektiv Spenden and other effective giving organisations as well as their funders to do and publish cost-effectiveness analyses of their work (ideally including the indirect impacts of effective giving), as GWWC has done.
We [GWWC, but the points hold more broadly] have several reasons for doing this:
To provide potential donors with information about our past cost-effectiveness.
To hold ourselves accountable and ensure that our activities are providing enough value to others.
To determine which of our activities are most successful, so we can make more informed strategic decisions about where we should focus our efforts.
To provide an example impact evaluation framework which other effective giving organisations can draw from for their own evaluations.
One could argue cost-effectiveness analyses of past work are not informative for effective giving organisations which only recently professionalised. Nonetheless, forecasting future costs and donations (and thus cost-effectiveness) could still be valuable in those cases.
Questions for reflection
Some questions to think about:
Does the factual non-marginal multiplier correlate well with the counterfactual marginal multiplier?
Is the direct impact of effective giving organisation a good proxy of their overall impact?
If yes is a reasonable answer to the questions above, how high does the factual non-marginal multiplier have to be for the counterfactual marginal multiplier to exceed 1?
Should effective giving organisations do and publish cost-effectiveness analysis? How early and often?
Is GWWC well positioned to assess the cost-effectiveness of other effective giving organisations (even if the onus is arguably on their funders), given its experience running their own, and plans to evaluate evaluators?
Should funders provide more information about their grants, at least for large ones?
Acknowledgements
I had the initial idea for this post chatting with JosĂŠ Oliveira. Thanks to Sebastian Schwiecker (Effektiv Spenden), JosĂŠ, Luan Paciencia (Doebem), Joan Montoya (Ayuda Efectiva), and Francisco Martins for feedback on the draft[19]. Thanks to Michael Townsend and Luke Freeman for feedback on GWWCâs costs. Thanks to Sjir Hoeijmakers (GWWC) for clarifying that Founders Pledge conducted an internal evaluation of Effektiv Spenden. Thanks also to Luan for meeting with me to present Doebemâs history and future plans[20].
- ^
Search for â0.399â here. I like to present numbers with 3 significant digits in order not to propagate rounding errors, not because they have low uncertainty.
- ^
From Faunalyticsâ post on Springmann 2021:
In high-income and upper-middle-income countries, flexitarian, vegetarian, and vegan diets were less expensive than the typical diet (the reduction ranged from 12 to 34%). In these countries, the pescatarian diet was about as expensive. In contrast, in lower-middle-income and low-income countries, all alternative diets were more expensive than the typical diet (the increase ranged from 18 to 45%).
- ^
For context, GWWC estimates it only caused 26 % of its pledge donations from 2020 to 2022 (which would correspond to y/âx = 0.26).
- ^
Note the donations received to be directed towards effective organisations are classified as costs in the financial reports of effective giving organisations. The costs I present in this post, and use to compute the factual marginal multiplier exclude such donations.
- ^
To illustrate, if 2 effective giving organisations A and B moved the same amount of donations, and had the same costs, they would have the same factual non-marginal multiplier. Nonetheless, if the workers and volunteers of A could do something almost as impactful in the absence of A, whereas the workers and volunteers of B would not do something nearly as impactful in the absence of B, A would be less effective than B. In other words, although A and B moved the same amount of donations, the existence of B would be more important than that of A. In its last impact evaluation, GWWC accounted for the opportunity cost of workers, but not volunteers. âWhile the time of our volunteers is valuable, we suspect the opportunity cost here is cancelled out by the fact that there are significant positive externalities to volunteering. For example, several volunteers have since gone on to do other valuable work that they may only have been able to do due to their earlier volunteeringâ.
- ^
Data from The World Bank only goes up to 2021, so I used in2013dollars for 2022 (as GWWC estimated their costs for 2020 and 2021 in 2022-USD).
- ^
If 2 effective giving organisations A and B had the same counterfactual marginal multiplier, but those caused by A went to organisations 2 times as effective as those caused by B, donating to organisation A would be 2 times as effective as to B.
- ^
Sum of the values of points 8 (personnel costs) and 9 (other costs) of âCUENTA DE RESULTADOS MODELO ABREVIADOâ.
- ^
Taken from the figure here.
- ^
Ayuda Efectiva was founded in 2019, but only started operating in June 2020.
- ^
Provided by Luan Paciencia, Doebemâs research director.
- ^
Taken from the blogposts linked in the last sentence of the page.
- ^
From GWWCâs previous impact report, âGiving What We Canâs total monetary costs up to the end of 2014 were ÂŁ208,000. Up to the middle of 2012, Giving What We Can was run entirely by volunteersâ. So I set the costs from 2009 to 2011 to 0, considered the cost from 2012 to 2014 to be 208 k 2013-ÂŁ, and allocated 20 % to 2012, 40 % to 2013, and 40 % to 2014. â[Michael Townsend would] guess itâs best to assume something like 2015â˛s budget was 67% of 2014â˛s, and 2016â˛s was 33% of 2014â˛s, but really thatâs a pure guess [which nevertheless âclosely matchesâ Luke Freemanâs âbest guessesâ] and even a bit of desk research to estimate the FTE in those times would lead to better informed guessesâ. I supposed the costs in 2015 and 2016 to be 2â3 and 1â3 that of 2014. In addition, â[according to Michael, GWWCâs] best-guess is that the costs from 2017-2019 were ~$250,000 USD if you include the EA Funds donation platform as part of GWWC (if you donât, I think the costs might be closer to ~$50,000 USD per year)â. I assumed a cost of 83.3 k 2018-USD/âyear (= 250â3) from 2017 to 2019. I took the costs for 2020 and 2021 from GWWCâs last impact report.
- ^
Donations calculated in the context of my impact assessment of GWWC.
- ^
- ^
I believe there are cost-effective interventions in these areas, namely ones which emphasise learning more, and keeping options open. Nevertheless, I think these are mostly not being targeted.
- ^
Because I am unsure about whether GiveWellâs top charities are beneficial or harmful (see links in the 2nd sentence of this paragraph).
- ^
âEffektiv Spenden, The Life You Can Save, and Effective Altruism Australia are examples of this [âstraightforward fundraisingâ] modelâ.
- ^
Names ordered by descending relevance of contributions.
- ^
I have not described such history and future plans here, but Doebem intends to post about them in the future.
- ^
Taken from the blogposts linked in the last sentence of the page.
- ^
Provided by Luan Paciencia, Doebemâs research director.
- doebem: CharÂity EvalÂuÂaÂtion and EffecÂtive GivÂing in Brazil by (30 Oct 2023 16:14 UTC; 61 points)
- 's comment on EffekÂtiv SpenÂdenâs ImÂpact EvalÂuÂaÂtion 2019-2023 (exec. sumÂmary) by (4 Dec 2023 15:54 UTC; 6 points)
- 's comment on ImÂpact EvalÂuÂaÂtion in EA by (29 Oct 2023 18:39 UTC; 4 points)
- 's comment on Kaleemâs Quick takes by (11 Dec 2023 9:40 UTC; 3 points)
Finally, I think you acknowledge but probably underweight the importance of giving more weight to recent performance. For many organisations, the ârevenue curveâ of donations will start out low but then grow rapidly. So the relevant thing for me is the direction of travel of Ayuda Efectiva, not its performance as an average of its first three years. You can see the value of looking at the direction of travel if you look at the performance of Effektiv Spenden and, to some extent, Giving What We Can (although GWWC had significant âunfair advantagesâ in its early years). In each case, their performance has improved substantially over time.
Thanks for noting that, Jack!
Note the factual non-marginal multipliers I present for the whole period (e.g. 2019 to 2021 for Ayuda Efectiva) are not the mean across the factual non-marginal multipliers for the years of that period. I calculate the factual non-marginal multiplier for a given period from the ratio between donations received to be directed towards effective organisations and costs, so the years with greater volume of donations and costs will have a larger weight. This explains why Ayuda Efectivaâs multiplier for 2019 to 2021 (1.34) is not too different from that for 2021 (1.72).
It would be nice if effective giving organisations forecasted their future costs, donations received, and multipliers, thus doing a prospective cost-effectiveness analysis.
Thanks for this Vascoâalways a useful exercise to look at cost-effectiveness, especially in an area like effective giving, where the money-moved is quite easily measured.
Some thoughts on this, which Iâll split into different comments for ease of discussion:
This seems very unlikely to be true in practice, but also Iâm not sure it should be true in an ideal world either. Effective giving organisations should vary according to many factorsâtarget market, costs of operating in various jurisdictions, competition being higher in some jurisdictions than others, the effectiveness of the team and strategy etc..
For example, it would be naive to assume that an effective giving org targeting Ultra High Net Worth Individuals (e.g. LongView, Effective Giving, Founderâs Pledge) would have the same ROI as one targeting grassroots givers (e.g. One for the World). Some types of outreach/âdonor will have much higher ROI than others.
The reason I think it isnât even âidealâ for all organisations to have the same ROI is that there is value to having a variety of approaches, because:
Certain types of outreach are crowded (e.g. it seems silly repeatedly to set up a ânew Founderâs Pledgeâ, or a new â10% pledgeâ organisation)
Certain types are too specialist or need special expertise that isnât available to every organisation (e.g. itâs very hard to gain access to Ultra High Net Worth givers)
If we all did one type of fundraising, it would decrease the diversity of our funding base and increase our risk
Iâd also submit that the relative impact of effective-giving organizations nearer the âgrassrootsâ level will likely be underestimated by looking solely at money moved. For example, grassroots effective-giving campaigns provide people with accessible ways to take action, which itself can spur greater commitment and downstream positive actions that arenât captured well by a money-moved analysis alone. In contrast, money moved likely does a better job capturing the bulk of the impact from UHNW outreach.
Agreed, Jason! On the other hand, I would expect effective giving organisation to be tracking such indirect impacts if they represented an important part of their theory of change and overall impact. My impression is that the 4 organisations I analysed are not assessing much such indirect impacts. They were also not covered in GWWCâs last impact analysis (see here).
They seem rather difficult to capture and evaluate at a high level of specificity. Itâs unclear if attempting to better measure and quantify that portion of ROI was the best use of these orgâs resources a year ago, or even now in a tighter funding picture.
Per the first linked source: âIn the 2020 EA Survey, 21% of respondents reported that Giving What We Can was important for them getting involved in EA.â Doubtless the percentage would be higher for all effective-givingish organizations (especially if GiveWell were included, my own entry point). Even concluding that 2.5 percent of 21 percent of EA activity should be âcreditedâ to grassroots effective giving would be pretty significant additional impact for the fairly low spend involved.
I think there is a tension between:
People getting involved with EA is a major driver of our impact.
We do not measure how much we are responsible for people getting involved with EA.
These imply a major driver of impact is not being measured, which seems strange (specially for the larger effective giving organisations). Note that I am not suggesting investing tons of resources into quantifying indirect impact. Just asking a few questions once a year (e.g. did you apply to any job thanks to becoming aware of EA via our effective giving organisation?) would take little time, and provide useful information.
I agree GWWCâs indirect impact has been quite important:
On the other hand, I would say âgetting involved in EAâ is a little too vague. I think effective giving can be considered being involved in EA, so, from what you quoted alone, it is unclear whether there have been indirect impacts besides donations.
This is not obvious to me, because I think GWWC and GiveWell have much stronger ties to EA than the mean effective giving organisation. I also expect effective giving to disproportionally select for people who will end up engaged with neartermist interventions, which I think have very unclear impact.
Donor time/âattention is a precious commodity to fundraisers, so I wouldnât expect organizations to have expended much of it on this topic without a specific business justification. Itâs plausible to me that the funders thought (and may still think) that each orgâs easily-quantifiable output was sufficient to fill room for more funding, and that the orgs didnât (and donât) think more precise measurement of indirect impact would materially change org strategy (e.g., because those impacts are attainable by the org only as a byproduct of doing the orgâs standard work).
Thanks, Jack! It is always good to receive feedback on such exercises too!
I agree with all the points you make. As I said:
However, although it is fine for the (all things considered) factual non-marginal multipliers to be different, the (all things considered) counterfactual marginal multipliers should be the same. If the marginal cost-effectiveness of donating to X is higher than that of donating to Y, one should donate more to X at the margin (which does not mean one should donate 0 to Y).
I donât think this position is âextremeâ but it is certainly highly debatable. Longtermist giving has fewer donation opportunities; can absorb less extra funding and deploy it effectively; and has very long feedback loops, which are hard to measure and have untested theories of change. In the case of AI safety, it also seems to have become subject to the forces of mainstream capitalism in a way that makes it less funding constrained and considerably less tractable (e.g. can even Open Philanthropy, with >$10bn to spend, really slow the pace of capabilities research?).
I think a better way to think about this is to look at Open Philanthropy, a specialist giving org which maintains worldview diversity because there is really genuine debate about how to allocate funding between different cause areas. I find them a lot more authoritative than comments from individuals in EA who donât do grantmaking, even highly respected ones like Ben.
(You also note 80kâs list of the most pressing problems, but you should note here that 80k has one of the most maximalist longtermist positions in EA.)
Thanks for the comment, Jack!
Could you clarify what do you mean by donation opportunities? The way I think about it, it makes sense for small donors to donate to whatever organisation/âfund they think is more cost-effective at the margin (for large donors, diminishing marginal returns are important, so it makes sense to follow a portfolio approach).
Personally, I would say interventions around biosecurity and pandemic preparedness and civilisation resilience can aborb and deploy funding much more cost-effectively that GiveWellâs top charities, whose sign of impact is unclear to me.
There is a sense in which feedback loops are short. Some examples:
Outcome: decreasing extinction risk from climate change. Goal: decreasing emissions. Nearterm proxy: adoption of a policy to decrease emissions.
Outcome: decreasing extinction risk from nuclear war. Goal: decrease number of nuclear weapons. Nearterm proxy: agreements to limit nuclear arsenals.
Outcome: decreasing extinction risk from engineered pandemics. Goal: increase pandemic preparedness. Nearterm proxy: ability to rapidly scale up the production of vaccines.
You can think about it in another way. Can projects funded by Open Philanthropy (or other) meaningfully increase the tiny amount of people working on AI Safety (90 % confidence interval, 200 to 1 k), or improve their ability to do so?
I agree there is lots of uncertainty, but I do not think one should assume Open Philanthropy has figured out the best way to handle it. I believe individuals could use Open Philâs views as a starting point, but then should (to a certain extent) try to look into the arguments, and update their views (and donations) accordingly. Personally, I used to distribute all my donations evenly across the 4 EA Funds (25 % each), but am now directing 100 % of my donations to the Long-Term Future Fund. This does not mean I think neartermist interventions should receive 0 donations. Even if I thought the optimal fraction of longtermist donations in the portfolio was only 1 pp higher, since my donations are much smaller than 1 % of the overall donations, it makes sense for me to direct all my donations to the longtermist projects.
There is an important distinction between what small donors and Open Philanthropy should do:
Small donations have a negligible impact on the marginal cost-effectiveness of the organisations/âfunds receiving them. So it makes sense for me to donate to the organisation/âfund which I view as most cost-effective at the margin.
Large donations can shift the marginal cost-effectiveness quite a lot. So it makes much more sense for Open Philanthropy to follow a portfolio approach.
I do not know to which extent the fraction of Open Philâs donations going to each of their worldviews was defined by lots of people, or only a few. As far as I know, Open Phil has not clarified that. I believe it would be good if Open Phil could describe more of their process (besides what they outlined 6 or 7 years ago in the worldview diversification post).
I think 80,000 Hours is not at the very end of the longtermist spectrum. For example, the 80,000 Hours Podcast has had many episodes related to neartermist causes, and the 80,000 Hours Job Board has many positions on these too.
Thanks for engaging so positively here.
A couple of quick reactions:
This is a very bold claim, made quite casually! Especially in light of:
I would evaluate these options through the GiveWell criteriaâevidence of effectiveness, cost-effectiveness and room for more funding.
For the GiveWell charities, they score very highly on each metric. For example, they are each supported by multiple randomised control trials. By contrast, the indicators you mention are weak proxy indicators (I think you should also have added âcounterfactualâ to each oneâa new arms control treaty isnât an achievement for a donor unless it would likely not have happened without extra funding).
If I could challenge you, I think this looks like motivated reasoning, in that I think these are probably âdecent proxy indicators if youâve already decided to donate solely within longtermismâ. But I think itâs very tough to maintain that longtermist giving opportunities stack up next to neartermist ones, if compared on the same metrics.
To summarise: global health giving opportunitiesâexceptionally strong evidence of effectiveness; rigorous cost-effectiveness analyses; room for more funding updated annually with high levels of transparency.
Longtermist giving opportunities (as mentioned here) - some (weak) proxy indicators show progress, some donât (e.g. Iâm not aware of any counterfactual nuclear arms control treaties in the past 10 years); therefore speculative cost-effectiveness, because little evidence of effectiveness; individual projects likely to have room for more funding, but as a sector much less room for more funding (e.g. you could deploy billions via GiveDirectly, but Open Phil only managed to deploy <$1bn to longtermist causes last year).
As effective giving organisations should (at least in theory) be agnostic about cause area and focussed on âeffectivenessâ, I would be surprised if any raised the majority of their donations for longtermist causes, which have significant challenges around evidence of effectiveness/âtractability.
Likewise!
Sorry. I had given some context in the post (not sure you noticed it). You can find more in section 4 of Mogensen 2019 (discussed here):
You say that:
I believe those criteria are great, and wish effective giving organisations applied them to their own operations. For example, doing retrospective and prospective cost-effectiveneness analyses.
My concern is that GiveWellâs metrics (roughly, lives saved per dollar[1]) may well not capture most of the expected effects of GiveWellâs interventions. For example:
From Mogensen 2019:
Feel free to check section 4.1 for many positive and negative consequences of increasing and decreasing population size.
Note I am not saying the relationships are simple or linear, just that they very much matter. Without nuclear weapons, there would be no risk of nuclear war. In any case, I agree the correlation between longtermist outcomes (e.g. lower extinction risk) and the measurable outputs of longtermist interventions (e.g. less nuclear weapons) will tend to be lower than the correlation between neartermist outcomes (e.g. deaths averted) and the measurable outputs of neartermist interventions (e.g. distributed bednets). However, my concern is that the correlation between neartermist outcomes (e.g. deaths averted) and ultimately relevant outcomes (welfare across all space and time, not just very nearterm welfare of humans) is quite poor.
Fair! For what is worth, I was not commited to donating solely to longtermist interventions from the onset. I used to split my donations evenly across all 4 EA Funds, and wrote articles about donating to GiveWellâs top charities on the online newspaper of my former university.
I agree longtermist organisations should do more to assess their cost-effectiveness and room for more funding. One factor is that longtermist organisations tend to be smaller (not Nuclear Threat Initiative), so they have less resources to do such analyses (although arguably still enough).
In reality, according to GiveWellâs moral weights, the value of saving lives increases until an age of around 10 (if I recall correctly), and then starts decreasing. Economic benefits are also taken into account.
Do you mean z > 1?
Thanks, David! Corrected.