i agree it’s not gonna plot against us the moment it wakes up but it won’t be benevolent or have any reason to do so until someone programs or trains it on certain values that could be good or bad
an ASI aligned to maximize suffering is not gonna see the value in cooperation and won’t care about unless it matters to his goal
super intelligence on it’s own doesn’t give rise to cooperation or morality
why would an ASI even “want” anything?
i agree it’s not gonna plot against us the moment it wakes up but it won’t be benevolent or have any reason to do so until someone programs or trains it on certain values that could be good or bad
an ASI aligned to maximize suffering is not gonna see the value in cooperation and won’t care about unless it matters to his goal
super intelligence on it’s own doesn’t give rise to cooperation or morality
It’s all addressed in the essay. Have you read it?