I don’t think that peculiarities of what kinds of EA work we’re most enthusiastic about lead to much of the disagreement. When I imagine myself taking on various different people’s views about what work would be most helpful, most of the time I end up thinking that valuable contributions could be made to that work by sufficiently talented undergrads.
I agree we have important disagreements other than what kinds of EA work we’re most enthusiastic about. While not of major relevance for the original issue, I’d still note that I’m surprised by what you say about various other people’s view on EA, and I suspect it might not be true for me: while I agree there are some highly-valuable tasks that could be done by recent undergrads, I’d guess that if I made a list of the most valuable possible contributions then a majority of the entries would require someone to have a lot of AI-weighted generic influence/power (e.g. the kind of influence over AI a senior government member responsible for tech policy has, or a senior manager in a lab that could plausibly develop AGI), and that because of the way relevant existing institutions are structured this would usually require a significant amount of seniority. (It’s possible for some smart undergrads to embark on a path culminating in such a position, but my guess this is not the kind of thing you had in mind.)
I am pretty skeptical of this. Eg I suspect that people like Evan (sorry Evan if you’re reading this for using you as a running example) are extremely unlikely to remain unidentified, because one of the things that they do is think about things in their own time and put the results online. [...]
I am not intending to include beliefs and preferences in my definition of “great person”, except for preferences/beliefs like being not very altruistic, which I do count.
I don’t think these two claims are plausibly consistent, at least if “people like Evan” is also meant to exclude beliefs and preferences: For instance, if someone with Evan-level abilities doesn’t believe that thinking in their own time and putting results online is a worthwhile thing to do, then the identification mechanism you appeal to will fail. More broadly, someone’s actions will generally depend on all kinds of beliefs and preferences (e.g. on what they are able to do, on what people around them expect, on other incentives, …) that are much more dependent on the environment than relatively “innate” traits like fluid intelligence. The boundary between beliefs/preferences and abilities is fuzzy, but as I suggested at the end of my previous comment, I think for the purpose of this discussion it’s most useful to distinguish changes in value we can achieve (a) by changing the “environment” of existing people vs. (b) by adding more people to the pool.
Could you name a profile of such a person, and which of the types of work I named you think they’d maybe be as good at as the people I named?
What do you mean by “profile”? Saying what properties they have, but without identifying them? Or naming names or at least usernames? If the latter, I’d want to ask the people if they’re OK with me naming them publicly. But in principle happy to do either of these things, as I agree it’s a good way to check if my claim is plausible.
I think my definition of great might be a higher bar than yours, based on the proportion of people who I think meet it?
Maybe. When I said “they might be great”, I meant something roughly like: if it was my main goal to find people great at task X, I’d want to invest at least 1-10 hours per person finding out more about how good they’d be at X (this might mean talking to them, giving them some sort of trial tasks etc.) I’d guess that for between 5 and 50% of these people I’d eventually end up concluding they should work full-time doing X or similar.
Also note that originally I meant to exclude practice/experience from the relevant notion of “greatness” (i.e. it just includes talent/potential). So for some of these people my view might be something like “if they did 2 years of deliberate practice, they then would have a 5% to 50% chance of meeting the bar for X”. But I know think that probably the “marginal value from changing the environment vs. marginal value from adding more people” operationalization is more useful, which would require “greatness” to include practice/experience to be consistent with it.
If we disagree about the bar, I suspect that me having bad models about some of the examples you gave explains more of the disagreement than me generally dismissing high bars. “Functional programming” just doesn’t sound like the kind of task to me with high returns to super-high ability levels, and similar for community building; but it’t plausible that there are bundles of tasks involving these things where it matters a lot if you have someone whose ability is 6 instead of 5 standard deviations above the mean (not always well-defined, but you get the idea). E.g. if your “task” is “make a painting that will be held in similar regards as the Mona Lisa” or “prove P != NP” or “be as prolific as Ramanujan at finding weird infinite series for pi”, then, sure, I agree we need an extremely high bar.
For what it’s worth, I think that you’re not credulous enough of the possibility that the person you talked to actually disagreed with you—I think you might doing that thing whose name I forget where you steelman someone into saying the thing you think instead of the thing they think.
Thanks for pointing this out. FWIW, I think there likely is both substantial disagreement between me and that person and that I misunderstood their view in some ways.
I agree we have important disagreements other than what kinds of EA work we’re most enthusiastic about. While not of major relevance for the original issue, I’d still note that I’m surprised by what you say about various other people’s view on EA, and I suspect it might not be true for me: while I agree there are some highly-valuable tasks that could be done by recent undergrads, I’d guess that if I made a list of the most valuable possible contributions then a majority of the entries would require someone to have a lot of AI-weighted generic influence/power (e.g. the kind of influence over AI a senior government member responsible for tech policy has, or a senior manager in a lab that could plausibly develop AGI), and that because of the way relevant existing institutions are structured this would usually require a significant amount of seniority. (It’s possible for some smart undergrads to embark on a path culminating in such a position, but my guess this is not the kind of thing you had in mind.)
I don’t think these two claims are plausibly consistent, at least if “people like Evan” is also meant to exclude beliefs and preferences: For instance, if someone with Evan-level abilities doesn’t believe that thinking in their own time and putting results online is a worthwhile thing to do, then the identification mechanism you appeal to will fail. More broadly, someone’s actions will generally depend on all kinds of beliefs and preferences (e.g. on what they are able to do, on what people around them expect, on other incentives, …) that are much more dependent on the environment than relatively “innate” traits like fluid intelligence. The boundary between beliefs/preferences and abilities is fuzzy, but as I suggested at the end of my previous comment, I think for the purpose of this discussion it’s most useful to distinguish changes in value we can achieve (a) by changing the “environment” of existing people vs. (b) by adding more people to the pool.
What do you mean by “profile”? Saying what properties they have, but without identifying them? Or naming names or at least usernames? If the latter, I’d want to ask the people if they’re OK with me naming them publicly. But in principle happy to do either of these things, as I agree it’s a good way to check if my claim is plausible.
Maybe. When I said “they might be great”, I meant something roughly like: if it was my main goal to find people great at task X, I’d want to invest at least 1-10 hours per person finding out more about how good they’d be at X (this might mean talking to them, giving them some sort of trial tasks etc.) I’d guess that for between 5 and 50% of these people I’d eventually end up concluding they should work full-time doing X or similar.
Also note that originally I meant to exclude practice/experience from the relevant notion of “greatness” (i.e. it just includes talent/potential). So for some of these people my view might be something like “if they did 2 years of deliberate practice, they then would have a 5% to 50% chance of meeting the bar for X”. But I know think that probably the “marginal value from changing the environment vs. marginal value from adding more people” operationalization is more useful, which would require “greatness” to include practice/experience to be consistent with it.
If we disagree about the bar, I suspect that me having bad models about some of the examples you gave explains more of the disagreement than me generally dismissing high bars. “Functional programming” just doesn’t sound like the kind of task to me with high returns to super-high ability levels, and similar for community building; but it’t plausible that there are bundles of tasks involving these things where it matters a lot if you have someone whose ability is 6 instead of 5 standard deviations above the mean (not always well-defined, but you get the idea). E.g. if your “task” is “make a painting that will be held in similar regards as the Mona Lisa” or “prove P != NP” or “be as prolific as Ramanujan at finding weird infinite series for pi”, then, sure, I agree we need an extremely high bar.
Thanks for pointing this out. FWIW, I think there likely is both substantial disagreement between me and that person and that I misunderstood their view in some ways.