This gives the impression that longtermism is satisfied with prioritising one option in comparison to another, regardless of the context of other options which if considered would produce outcomes that are “near-best overall”. And as such it’s a somewhat strange claim that one of the best things you could do for the far future is in actuality “not so great”.
Longtermism should certainly prioritise the best persistent state possible. If we could lock-in a state of the world where there were the maximum number of beings with maximum wellbeing of course I would do that, but we probably can’t.
Ultimately the great value from a longtermist intervention does comes from comparing it to the state of the world that would have happened otherwise. If we can lock-in value 5 instead of locking in value 3, that is better than if we can lock-in value 9 instead of locking value 8.
At it’s heart, the “inability to predict” arguments really hold strongly onto the sense that the far future is likely to be radically different and therefore you are making a claim to having knowledge of what is ‘good’ in this radically different future.
I think we just have different intuitions here. The future will be different, but I think we can make reasonable guesses about what will be good. For example, I don’t have a problem with a claim that a future where people care about the wellbeing of sentient creatures is likely to be better than one where they don’t. If so, expanding our moral circle seems important in expectation. If you’re asking “why”—it’s because people who care about the wellbeing of sentient creatures are more likely to treat them well and therefore more likely to promote happiness over suffering. They are also therefore less likely to lock-in suffering. And fundamentally I think happiness is inherently good and suffering inherently bad and this is independent of what future people think. I don’t have a problem with reasoning like this, but if you do then I just think our intuitions diverge too much here.
Thus, while reducing risk associated with asteroid impacts has immediate positive effects, the net effect on the far future is more ambiguous.
Maybe fair, but if that’s the case I think we need to find those interventions that are not very ambiguous. Moral circle expansion seems one of those that is very hard to argue against. (I know I’m changing my interventions—it doesn’t mean I don’t think the previous ones I said are still good, I’m just trying to see how far your scepticism goes).
For a simple example, as soon as humans start living comfortably, in addition to but beyond Earth (for example on Mars), the existential risk from an asteroid impact declines dramatically, and further declines are made as we extend out further through the solar system and beyond. Yet the expected value is calculated on the time horizon whereby the value of this action, reducing risk from asteroid impact, will endure for the rest of time, when in reality, the value of this action, as originally calculated, will only endure for probably less than 50 years.
Considering this particular example—If we spread out to the stars then x-risk from asteroids drops considerably as no one asteroid can kill us all—that is true. But the value of the asteroid reduction intervention is borne from actually getting us to that point in the first place. If we hadn’t reduced risk from asteroids and had gone extinct then we’d have value 0 for the rest of time. If we can avert that and become existentially secure than we have non-zero value for the rest of the time. So yes, we would have indeed done an intervention that has impacts enduring for the rest time. X-risk reduction interventions are trying to get us to a point of existential security. If they do that, their work is done.
Longtermism should certainly prioritise the best persistent state possible. If we could lock-in a state of the world where there were the maximum number of beings with maximum wellbeing of course I would do that, but we probably can’t.
Ultimately the great value from a longtermist intervention does comes from comparing it to the state of the world that would have happened otherwise. If we can lock-in value 5 instead of locking in value 3, that is better than if we can lock-in value 9 instead of locking value 8.
I think we just have different intuitions here. The future will be different, but I think we can make reasonable guesses about what will be good. For example, I don’t have a problem with a claim that a future where people care about the wellbeing of sentient creatures is likely to be better than one where they don’t. If so, expanding our moral circle seems important in expectation. If you’re asking “why”—it’s because people who care about the wellbeing of sentient creatures are more likely to treat them well and therefore more likely to promote happiness over suffering. They are also therefore less likely to lock-in suffering. And fundamentally I think happiness is inherently good and suffering inherently bad and this is independent of what future people think. I don’t have a problem with reasoning like this, but if you do then I just think our intuitions diverge too much here.
Maybe fair, but if that’s the case I think we need to find those interventions that are not very ambiguous. Moral circle expansion seems one of those that is very hard to argue against. (I know I’m changing my interventions—it doesn’t mean I don’t think the previous ones I said are still good, I’m just trying to see how far your scepticism goes).
Considering this particular example—If we spread out to the stars then x-risk from asteroids drops considerably as no one asteroid can kill us all—that is true. But the value of the asteroid reduction intervention is borne from actually getting us to that point in the first place. If we hadn’t reduced risk from asteroids and had gone extinct then we’d have value 0 for the rest of time. If we can avert that and become existentially secure than we have non-zero value for the rest of the time. So yes, we would have indeed done an intervention that has impacts enduring for the rest time. X-risk reduction interventions are trying to get us to a point of existential security. If they do that, their work is done.