I think it’s an open question whether “even if you want to create lots of happy lives, most of the relevant ways to tackle that problem involve changing the direction in which the future goes rather than whether there is a future.” But I broadly agree with the other points. In a recent talk on astronomical waste stuff, I recommended thinking about AI in the category of “long-term technological/cultural path dependence/lock in,” rather than the GCR category (though that wasn’t the main point of the talk). Link here: http://www.gooddoneright.com/#!nick-beckstead/cxpp, see slide 13.
I think it’s an open question whether “even if you want to create lots of happy lives, most of the relevant ways to tackle that problem involve changing the direction in which the future goes rather than whether there is a future.” But I broadly agree with the other points. In a recent talk on astronomical waste stuff, I recommended thinking about AI in the category of “long-term technological/cultural path dependence/lock in,” rather than the GCR category (though that wasn’t the main point of the talk). Link here: http://www.gooddoneright.com/#!nick-beckstead/cxpp, see slide 13.