I agree pretty strongly with this. I think it especially matters since, in my cause prio, the case for working on AI x-risk is much higher than other causes of x-risk even if level of x-risk they posed were the same because I’m not convinced that the expected value of the future conditional on avoiding bio and nuclear x-risk is positive. More generally I think the things that it’s worth focusing on from a longtermist perspective compared to just a “dying is bad” perspective can look different within cause areas especially AI. For instance, I think it makes governance stuff and avoiding multi-agent failures look much more important.
I agree pretty strongly with this. I think it especially matters since, in my cause prio, the case for working on AI x-risk is much higher than other causes of x-risk even if level of x-risk they posed were the same because I’m not convinced that the expected value of the future conditional on avoiding bio and nuclear x-risk is positive. More generally I think the things that it’s worth focusing on from a longtermist perspective compared to just a “dying is bad” perspective can look different within cause areas especially AI. For instance, I think it makes governance stuff and avoiding multi-agent failures look much more important.
Huh, this is an interesting angle! Thanks :)