I agree that in deciding how much to prioritise averting extinction vs improving worlds in which we persist, it’s important to think about the difference in value between (non-existence)(default survival)(actual utopia). But that argument has been around a long while. I think Ben Garfinkel was advancing the idea that (actual utopia) - (default survival) might be much larger than (default survival) - (non-existence) in the late 2010s. I’m interested in what’s changed that’s affected discourse. It’s possible the answer is ‘more people have read arguments of this form’. But in that case people who had already read those arguments should update less than if the change is eg us getting more info about how difficult alignment is.
I agree that in deciding how much to prioritise averting extinction vs improving worlds in which we persist, it’s important to think about the difference in value between (non-existence)(default survival)(actual utopia). But that argument has been around a long while. I think Ben Garfinkel was advancing the idea that (actual utopia) - (default survival) might be much larger than (default survival) - (non-existence) in the late 2010s. I’m interested in what’s changed that’s affected discourse. It’s possible the answer is ‘more people have read arguments of this form’. But in that case people who had already read those arguments should update less than if the change is eg us getting more info about how difficult alignment is.