I really like that you’ve chosen this topic and think it’s an important one! I wrote my MA Philosophy thesis on this (in 2019, now outdated).
On the margin[1], it is better to work on reducing the chance of our[2] extinction than increasing the value of futures where we survive
I want to flag that I disagree with this framing, as it’s very anthropocentric. There are futures in which we go extinct but that are nevertheless highly valuable (happy sentient AI spreading via VNM probes). Perhaps more empirically relevant, I expect almost all effects to go via making the transition to superintelligence go well, and the most distinct action is focusing on digital sentience (which has little effect on extinction risk and much effect on the value of the future).
Does footnote #2 on the debate statement cover this? “Our” and “We” are supposed to refer to “earth-originating intelligent life”, so “happy sentient AI spreading via VNM probes” would be included.
PS- would it still be worth sharing the thesis, or some thoughts from it? You could claim late draft amnesty if you’d like to post it without editing it :)
I really like that you’ve chosen this topic and think it’s an important one! I wrote my MA Philosophy thesis on this (in 2019, now outdated).
I want to flag that I disagree with this framing, as it’s very anthropocentric. There are futures in which we go extinct but that are nevertheless highly valuable (happy sentient AI spreading via VNM probes). Perhaps more empirically relevant, I expect almost all effects to go via making the transition to superintelligence go well, and the most distinct action is focusing on digital sentience (which has little effect on extinction risk and much effect on the value of the future).
Does footnote #2 on the debate statement cover this? “Our” and “We” are supposed to refer to “earth-originating intelligent life”, so “happy sentient AI spreading via VNM probes” would be included.
[edit- I’m very open to rephrasing it if not]
Ah yeah that seems fine then! “Life” is an imprecise term and I’d prefer “sentience” or “sentient beings” but maybe I’m overdoing it
PS- would it still be worth sharing the thesis, or some thoughts from it? You could claim late draft amnesty if you’d like to post it without editing it :)
It’s here!