One larger point to make here is that there may be no one true morality, ie that moral realism is false, and insofar as such a thing is correct, then every morality becomes essentially ideological, and there’s no special claim for anyone, including EA to have any morality as truth. This would suggest very different actions from today.
This is also a reason to be wary of moral progress theories.
Also, this is why the future could be lovecraftian in it’s morality, assuming the AI Alignment project goes well, in both it’s positive and negative senses, since extremely high-end technology like genetic editing and digital people will warp our moral conceptions of personal identity, species, happiness and more.
Finally, I think that honesty as a morality should bend to the risks of information hazards, where it’s better off if society or individuals didn’t know something about it, where the misleading explanation is better than the truth, also known as strategic lies. AI safety is cursed here, but some other fields might have this problem.
Over the long-term for long-termism, extremes, not moderates win in the long-term.
PS: I actually think the politicization of the movement, alongside PR scandals, is plausibly a long-term threat to the movement.
One larger point to make here is that there may be no one true morality, ie that moral realism is false, and insofar as such a thing is correct, then every morality becomes essentially ideological, and there’s no special claim for anyone, including EA to have any morality as truth. This would suggest very different actions from today.
This is also a reason to be wary of moral progress theories.
Also, this is why the future could be lovecraftian in it’s morality, assuming the AI Alignment project goes well, in both it’s positive and negative senses, since extremely high-end technology like genetic editing and digital people will warp our moral conceptions of personal identity, species, happiness and more.
Finally, I think that honesty as a morality should bend to the risks of information hazards, where it’s better off if society or individuals didn’t know something about it, where the misleading explanation is better than the truth, also known as strategic lies. AI safety is cursed here, but some other fields might have this problem.
Over the long-term for long-termism, extremes, not moderates win in the long-term.
PS: I actually think the politicization of the movement, alongside PR scandals, is plausibly a long-term threat to the movement.