Are you aware of any surveys or any other evidence supporting this? (I’d accept “most people in AI safety that I know started working in it because EA investigative work convinced them that AI safety matters” or something of that nature.)
I’m endorsing this, and I’m confused about which part you’re skeptical about. Is it the “many EAs” bit? Obviously the word “many” is pretty fuzzy, and I don’t intend it to be a strong claim. Mentally the numbers I’m thinking of are something like >50 people or >25% of committed (or “core”, whatever that means) EAs. Don’t have a survey to back that up though. Oh, I guess I’m also including people currently studying ML with the intention of doing safety. Will edit to add that.
Why are you trying to answer this, instead of “How should I update, given the results of all available investigations into AI safety as a cause area?”
There are other questions that I would like answers to, not related to AI safety, and if I trusted EA consensus, then that would make the process much easier.
For this question then, it seems that Paul Christiano also needs to be discounted (and possibly others as well but I’m not as familiar with them).
I’m endorsing this, and I’m confused about which part you’re skeptical about.
I think I interpreted your statement as saying something like most people in AI safety are EAs, because you started with “One very brief way you could describe the development of AI safety” which I guess made me think that maybe you consider this to be the main story of AI safety so far, or you thought other people considered this to be the main story of AI safety so far and you wanted to push against that perception. Sorry for reading too much / the wrong thing into it.
There are other questions that I would like answers to, not related to AI safety, and if I trusted EA consensus, then that would make the process much easier.
Ok I see. But there may not be that much correlation between the trustworthiness of EA consensus on different topics. It could easily be the case that EA has done a lot of good investigations on AI safety but very little or poor quality investigations on other topics. It seems like it wouldn’t be that hard to just look at the actual investigations for each topic, rather than rely on some sense of whether EA consensus is overall trustworthy.
I’m endorsing this, and I’m confused about which part you’re skeptical about. Is it the “many EAs” bit? Obviously the word “many” is pretty fuzzy, and I don’t intend it to be a strong claim. Mentally the numbers I’m thinking of are something like >50 people or >25% of committed (or “core”, whatever that means) EAs. Don’t have a survey to back that up though. Oh, I guess I’m also including people currently studying ML with the intention of doing safety. Will edit to add that.
There are other questions that I would like answers to, not related to AI safety, and if I trusted EA consensus, then that would make the process much easier.
Indeed, I agree.
I think I interpreted your statement as saying something like most people in AI safety are EAs, because you started with “One very brief way you could describe the development of AI safety” which I guess made me think that maybe you consider this to be the main story of AI safety so far, or you thought other people considered this to be the main story of AI safety so far and you wanted to push against that perception. Sorry for reading too much / the wrong thing into it.
Ok I see. But there may not be that much correlation between the trustworthiness of EA consensus on different topics. It could easily be the case that EA has done a lot of good investigations on AI safety but very little or poor quality investigations on other topics. It seems like it wouldn’t be that hard to just look at the actual investigations for each topic, rather than rely on some sense of whether EA consensus is overall trustworthy.