Agreed! I think our views on the issue are quite similar then :)
Luis Mota Freitas
This is a great post, thanks for writing this up!
I agree with the main point, and 80,000 Hours’ webpage does make it clear that their top career recommendations (and the specific jobs in these areas that are highly concentrated in a few organizations) are pretty competitive, and most people on the EA movement are not going to be able to get into one of those. When planning my career, I factor in this possibility, but one problem I face is that I don’t feel I know enough about these other possibilities, and so there is a lot of uncertainty when I think about what should I do outside of the top career paths and top organizations.
I don’t think the solution to this problem is for 80,000 Hours to try to discuss other problem areas and mention other EA-aligned organizations in more detail, because that would take a lot of effort. One thing that could be helpful, though, is to emphasize more the process people should go through when planning their careers, with more guidance on how to tackle problem areas that haven’t been explored in much detail, how to explore areas that an EA think might be relevant but hasn’t been explored at all, how to find organizations to work for in the problem areas they are interested in, and what to do if you can’t get a job at an organization you really want to work for in the long term.
I believe it would also help to share the trajectories of people in the EA community who have done some innovative work, or people who managed to find jobs at EA-aligned organizations that the movement was previously unaware of, emphasizing how they approached the task. Facilitating networking between people in a certain problem area could also prove really helpful.
I’m not saying there isn’t any content in these topics, just that in my experience writing up and improving my own career plan over a few years I found it much easier to find EA material on why should I take a certain career path than on how to do it more concretely (besides working at top career paths and organizations), and that based on my experience I believe emphasizing more these aspects could go a long way into helping people structure better career plans.
I want that doc to be shareable outside the EA community, but I appreciate people posting related links here!
Thanks again for your comments, Sjir! Both of your points are great, and the second one which has led me to think LPR is more important than I thought before.
I still stand by the approach to doing LPR that I propose in the post. Given that there are cases where LPR is highly likely to be effective, I believe that starting with these cases, learning from them, and subsequently determining the best strategy for other situations is a great compromise between the risks and benefits involved. That said, I do think that LPR has the potential to be really successful and get a lot of people involved.
Addressing the specific advantages of LPR you outlined:On the first two points, my intuition is that local groups could learn enough about that without getting anywhere near the work required for charity recommendations. Alejandro’s analysis is an example of the type of research that I believe moves in this direction, though a more comprehensive exploration is likely warranted.
On the last point, this could indeed be one of the main benefits of LPR. However, prioritization research based on geographic location is not the only way to train people for GPR charity evaluation. Some examples, which I consider to be GPR, include replicating GiveWell’s work, or identifying the best donation opportunities from a non-welfarist perspective (such as those that promote justice).
On the “contextualization research” term, I think I’m a bit more satisfied with it than you are, but I also recognize that it isn’t the ideal name. Suggestions for a better alternative are welcome!
I also like it!
Thanks, Vaidehi!
The possibility of confusion is the worst thing about me using the term “local priorities research” to refer so something that was used in a broader sense before. My hunch is that it’s worth it, because it seems to me to be by far the most accurate description of what I call LPR. I really hope this won’t prove to be too confusing, and I wouldn’t want to trouble those who have written before to make changes in response to this. But I think that in a number of cases the term was used to refer to both LPR and CR, in an ambiguous way.
My guess is that the best thing to do (if people agree with the distinction I’ve made) is to use LPR in the narrower sense from now on, and maybe making an edit or adding a comment explaining the usage of the term in past posts when authors see fit.
Thanks! :)
Thanks for the detailed comment, Geoffrey!
First off, there is a point worth clarifying here. Scope insensitivity makes it impossible to have feelings that adequately scale with the number of beings affected, and I don’t think that there is much that can be done here (sidenote: this Wait But Why post and its sequel are the best ways I’m aware of to try to get an intuitive sense for the magnitude of large numbers). On the other hand, we can get a very good sense for the intensity of suffering in situations that are presented to us, which is what you point out as being the problematic part.
My sense is that it would be a really bad idea to try to get people to have a very intuitive grasp of intense suffering, for all of the problems you point out. I think that maybe the idea here is to try to give people some sense for it, but in a very small dose, which is sufficient to allow people to relate to other’s suffering but not nearly enough to cause them harm. Of course, there isn’t a right level for everyone (I think that watching the White Christmas/Black Museum episodes of Black Mirror was an adequate level of this for me, in that sense), but I think that a small enough dose here would be beneficial, and my claim is that this dose can be higher than simply “hundreds of thousands of people die of malaria every year”. Make-a-Wish does make some effort into describing the children’s situation, but they don’t go as far as describing the details of their suffering in a way that could be traumatizing, even though that’s possible to do in many cases.
And yes, there are definitely ways to frame this in a more positive and inspirational way, which I strongly favor!
When I wrote the post, the framing I used was focused on the differences in direct impact of focusing on local causes. This meant not mentioning a number of other important considerations, both positive and negative. Since writing the post, I’ve had the opportunity to talk more to others, and to reflect some more on what these other considerations are. Below, I highlight some that I consider particularly important (see Sjir’s comment for some others).
Getting people involved with effective interventions for local problems can serve as a way to get more people involved with effective global interventions. This can happen because it will be easier for some people to get involved with a local problem first before getting involved with a global problem, and also because working on local-level interventions can increase the popularity of EA in the region. I’ve recently learned that GiveDirectly’s US cash transfer program appears to have led to a really large increase to their international donations to people in extreme poverty, due to these two channels. They claim that this was the case, and a quick look at their funding from previous years shows no signs of such a large increase in (international) donations in 2020. If this increase in international donations was indeed not caused by something else, then this example makes me a lot more optimistic about this indirect benefit of doing LPR. Relevantly, I should note that GiveDirectly (1) first consolidated their international transfers program before starting their US transfer program, and (2) tried to emphasize international transfers following the media attention they obtained for US transfers.
A second point in favor of LPR is that, in practice, it doesn’t need to be the case that resources directed to local causes come at the expense of resources for the global cause. If an EA group already has a well-developed core group, and can already do outreach to those interested in the global cause, then the group might be able to start dedicating resources to LPR at a relatively low cost. As long as this doesn’t compromise the group’s ability to do outreach for global issues properly, I think that LPR might become a valuable activity for EA groups to engage in.
It’s also worth highlighting some downsides:
Value drift: if research and outreach of local problems comes at the expense of global ones, then this could be a reason for the group to lose most of their impact. And, as the number of people working on local priorities increases, this could attract even more people with a local focus, in a gradual drifting process that might result in a group that’s much more focused on local problems than the ideal.
Research costs: high-quality research requires a lot of time, as well as specific research skills. There’s already a lot of research available on the most relevant global issues, but for the local problems the group’s countries would have to mostly do this themselves. The opportunity cost is doing direct work, doing context-specific GPR[1] that’s not LPR, or doing outreach for global problems, which is quite a high bar.
Low-quality research has a really large cost in expectation. If the recommended charities aren’t among the best local opportunities, then this further increases the gap in effectiveness of local vs global interventions.[2] Furthermore, it opens up space for large damage to the group’s reputation, such as negative media coverage.
These considerations highlight a timing aspect of the overlap between LPR and context-specific GPR. They suggest that LPR is generally better suited for more mature EA groups, which have already consolidated their outreach structure for people willing to work on global problems. Depending on how high the benefits of LPR turn out to be, this could mean that at some point we would want to do LPR even in the US. But there’s still a lot of uncertainty, and I think that more information on the benefits and costs of LPR can be quite valuable. I would feel excited about attempts to get a sense for the magnitude of some effects mentioned here, such as by evaluating the GiveDirectly US transfers case more carefully, and looking for other related cases. And I’m excited about EA doing some work on LPR for the information value, particularly in the countries where it’s most likely to be the best local opportunity, such as India.
- ^
This is the same concept as what I refer on the post as contextualization research; see Vaidehi’s comment.
- ^
Given a heavy-tailed distribution of impact at the local level, redirecting donations from the average charity to a better-than-median but not great charity is also likely to have negative impact in counterfactual terms. I won’t explain why here, but you can read about properties of heavy-tailed impact in this paper.
Thanks a lot for sharing your experience, Austin! I’ve added a link to your comment in the post. I’m not surprised that it didn’t do great for getting more donations to the charities (as the post suggests), but I’m intrigued by your impression that it didn’t do well in allocating money to different charities. What was your expectation regarding how allocations would be made, and how were they actually made instead?
And it’s really interesting to know that Gitcoin is also de-emphasizing quadratic funding. Their website still mentions quadratic funding quite a lot; do you know if they have written this down somewhere?
As for fancy funding methods, I agree that the s-process looks interesting on the face of it. But I don’t think my opinion here is more valuable than anyone else’s, and I don’t know how it compares to other mechanisms in this space. It would be great if someone thought through the theoretical considerations in that case, and try to get a sense for how participants/funders feel about it (like this testimony). This feels relevant given how much money the SFF has moved to date.
Thanks for the comment, John! I agree with your point about preference aggregation as a main drawback, and I wish that EAs would appreciate this point more. The reason why I chose not to make it a drawback is because this criticism applies to most of the public goods provision literature, as opposed to applying specifically in the case of QF. But hopefully my points in the discussion about potential applications and your comment will bring more attention to this issue.
Thanks for the comment! On the point of making this information more well-known, is there an easy way to do so, given that I have very little familiarity with these communities?
Showing endogenous CQF is (in)efficient under complete information sounds relatively easy, right? I would love it if someone did this or explained why my intuition about hardness is wrong!
I haven’t tried it, and it could turn out to be quite easy, but I think it’s probably not so trivial to prove the result either way.
As this post explains, the main study that people cite when saying that “superforecasters are better than experts” comes from a competition where the aggregation methods for the two groups was different (Good Judgment Project’s aggregation algorithm versus prediction market with low liquidity for amateur forecasters and experts, respectively). Prediction markets for forecasters and experts had similar performance.
Thanks, JP!
I guess I feel like I’m less compelled by analyses of optimal performance and more like, what system will work in practice.
My impression is that these theoretical properties are the main reason why people are excited about QF. For example, you would prefer it over 1:1 donation matching because it is a more “principled” matching rule, which should lead to an allocation that’s closer to the efficient level than 1:1 donation matching. So if not for these properties, I don’t see why people should expect this mechanism to work particularly well in practice.
More generally, I agree that full on efficiency shouldn’t be thought of as a strictly necessary condition mechanisms to be useful in practice. For example, majority voting works relatively well in practice, despite not being efficient. But efficiency is nevertheless still a central concept, as it is the very motivation behind the public goods provision property (it’s basically the only problem with providing public goods privately). The framing I would use here is that increasing efficiency, while satisfying other (context-dependent) considerations, should be considered a key goal of public good provision mechanisms.
Great point!
The correspondence between theoretical and practical efficiency is definitely not perfect. Theoretical efficiency guarantees that individuals are properly incentivized. Practical efficiency may not follow because of things like computational costs, and the extent to which this will be a problem will depend on the specific mechanism and the situation in question. For example, in the computational cost case, the actions of large companies would probably be closer to optimal behavior than individual actions.
My hunch would be that proving theoretical efficiency is generally a relatively good proxy for practical efficiency in most cases, but these other practical considerations should be considered in addition to it, as further constraints that one is trying to satisfy. But this is an empirical question, and I’m also relatively uncertain here.
Thanks, David! My first reaction your points:
I don’t know, your guess is probably as good as mine here
I broadly agree with you about this point. The whole exercise of public good provision is trying to improve over the welfare level of private provision, but it’s not as if falling short from full efficiency makes a mechanism undesirable. Higher efficiency is one of the things we should aim for relative to existing solutions; perhaps the most important one, but not necessarily the dominant consideration, and improvements to various degrees seem valuable. I emphasize “full” efficiency in this writeup because it’s a major ground that’s given to justify the perspective that QF is promising.
Not quite sure I understand your point about it being a different extreme assumption. It is a generalization because the complete information case can be seen as a particular case of the setting we use. For example:
When every individual only has a single type
When only a single type occurs with positive probability
When types are perfectly correlated with each other
I wouldn’t necessarily think investing in the marketing of EA orgs is a no-brainer. The comparative advantage of EA orgs is that they are effective, but overall they don’t fare very well when it comes to emotional appeal. Investing more explicitly in emotionally appealing marketing could help them somewhat, but the biggest and more well funded traditional charities already optimize to a large extent in appealing to people, so I think it would be very hard for EA non-profits to compete in that front. Therefore, even with this kind of marketing, I doubt it would be able to make these orgs get significantly more funding from non-EAs.
What I think could be the main advantage of EA non-profits spending money on emotionally appealing marketing is that it could help people who are already interested in effectiveness to get more motivated for the cause. This includes both non-EAs who are interested in EA ideas, but it could also include people who are members of the movement, because this emotional connection could have a boosting effect on their motivation that volunteers of traditional charities usually already have. In turn, if what we are proposing in the post is successful, it could be the case that this gain in motivation by EAs and EA-aligned people would lead them be more eager to learn more about EA, donate more, and maybe even change their career plans to work on EA cause areas.