Is there an equally high level of expert consensus on the existential risks posed by AI?
There isn’t. I think a strange but true and important fact about the problem is that it just isn’t a field of study in the same way e.g. climate science is — as argued in this Cold Takes post. So it’s unclear who the relevant “experts” should be. Technical AI researchers are maybe the best choice, but they’re still not a good one; they’re in the business of making progress locally, not forecasting what progress will be globally and what effects that will have.
Thanks! I agree—AI risk is at a much earlier stage of development as a field. Even as the field develops and experts can be identified, I would not expect a very high degree of consensus. Expert consensus is more achievable for existential risks such as climate science and asteroid impacts that can be mathematically modeled with high historical accuracy—there’s less to dispute on empirical / logical grounds.
A campaign to educate skeptics seems appropriate for a mature field with high consensus, whereas constructively engaging skeptics supports the advancement of a nascent field with low consensus.
There isn’t. I think a strange but true and important fact about the problem is that it just isn’t a field of study in the same way e.g. climate science is — as argued in this Cold Takes post. So it’s unclear who the relevant “experts” should be. Technical AI researchers are maybe the best choice, but they’re still not a good one; they’re in the business of making progress locally, not forecasting what progress will be globally and what effects that will have.
Thanks! I agree—AI risk is at a much earlier stage of development as a field. Even as the field develops and experts can be identified, I would not expect a very high degree of consensus. Expert consensus is more achievable for existential risks such as climate science and asteroid impacts that can be mathematically modeled with high historical accuracy—there’s less to dispute on empirical / logical grounds.
A campaign to educate skeptics seems appropriate for a mature field with high consensus, whereas constructively engaging skeptics supports the advancement of a nascent field with low consensus.