Yeah, there might be a correlation in practice, but I think intelligent agents could have basically any random values. There are no fundamentally incorrect values, just some values that we don’t like or that you’d say lack importance nuance. Even under moral realism, intelligent systems don’t necessarily have to care about the moral truth (even if they’re smart enough to figure out what the moral truth is). Cf. the orthogonality thesis.
Yeah, there might be a correlation in practice, but I think intelligent agents could have basically any random values. There are no fundamentally incorrect values, just some values that we don’t like or that you’d say lack importance nuance. Even under moral realism, intelligent systems don’t necessarily have to care about the moral truth (even if they’re smart enough to figure out what the moral truth is). Cf. the orthogonality thesis.