This type of reasoning seems to imply that everyone interested in the flourishing of beings and thinking about that from an EA perspective should focus on projects that contribute directly to AI safety. I take that to be the implication of your comment because it is your main argument against working on something else (and could equally be applied to any number of projects discussed on the EA Forum not just this one). That implies, to me at least, extremely high confidence in AI safety being the most important issue because at lower confidence we would want to encourage a wider range of bets by those who share our intellectual and ideological views.
If the implication I’m drawing from your comment matches your views and confidence, can you help me understand why you are so confident in this being the most important issue?
If I’m misunderstanding the implication of your comment, can you help me understand where I’m confused?
Thanks for the detailed response kokotajlod, I appreciate it.
Let me summarize your viewpoint back to you to check I’ve understood correctly. It sounds as though you are saying that AI (broadly defined) is likely to be extremely important and the EA community currently underweights AI safety relative to its importance. Therefore, while you do think that not everyone will be suited to AI safety work and that the EA community should take a portfolio approach across problems, you think it’s important to highlight where projects do not seem as important as working on AI safety since that will help nudge the EA community towards a better-balanced portfolio. Outside of AI safety, there are a few other things that you think are also important, mostly in the existential risk kind of category but also including improving collective sanity/rationality/decision-making and maybe others. Therefore, the critique of QRI is mostly part of the activity to keep the portfolio properly balanced, however, you do have some additional skepticism that learning about what we mean by happiness and suffering is useful.
Is that roughly right?
If that is approximately your view, I think I have a couple of disagreements/things I’m confused about.
A. Firstly, I don’t think the WW2 example is quite right for this case. I think in the case of war, we understand the concept well enough to take the relevant actions and we don’t predict defining the concept to change that. I don’t think we understand the concepts of suffering or happiness well enough to take similar actions as in the WW2 case.
B. Secondly, I would have guessed that the EA community overweights AI safety so I’m curious as to why you think that is not the case. It could be that my intuitions are wrong about the focus it actually receives (vs the hype in the community) or it could be that I think it should receive less focus than you do. Not so much compared to its importance, more like its tractability when factoring in safety and the challenges of coordination. I worry that perhaps we overly focus on the technical side such that there’s a risk that we just speed up development more than we increase safety.
C. While I don’t know much about QRI’s research, in particular, my concerns from point B make me more inclined to support research in areas related to social sciences that might improve our understanding of and ability to coordinate.
D. And finally, why include “improving collective sanity/rationality/decision-making” in the list of other important things but exclude QRI? Here I’m not necessarily disagreeing, I just don’t quite get the underlying model that generates existential threats as the most important but then includes something like this and then excludes something like QRI.
To be clear, these are not confident viewpoints, they are simply areas where I notice my views seem to differ from many in the EA community and I expect I’d learn something useful from understanding why that is.