I’m quite skeptical of the concept of an ASI that is interacting with us but not controlling us. If it can predict the impact of each of its actions, it basically chooses the future of our species. So either we become an ASI (cognitive enhancement, mind uploading,...) or we have an ASI that controls us, and then the goal is that it controls us benevolently. But putting that aside, my answer is yes, seems good by definition of ‘benevolently’.
In Superintelligence, Bostrom provided plausible scenarios showing how a superintelligent being could free itself from our control. People usually expect death as a result. To me it is more intuitive that the result is torture of people, meaning nothing more than creating additional suffering in people’s lives.
I am also skeptical of a superintelligent being doing anything but immediately beginning to control people, one way or another, for one reason or another.
I’m quite skeptical of the concept of an ASI that is interacting with us but not controlling us. If it can predict the impact of each of its actions, it basically chooses the future of our species. So either we become an ASI (cognitive enhancement, mind uploading,...) or we have an ASI that controls us, and then the goal is that it controls us benevolently. But putting that aside, my answer is yes, seems good by definition of ‘benevolently’.
In Superintelligence, Bostrom provided plausible scenarios showing how a superintelligent being could free itself from our control. People usually expect death as a result. To me it is more intuitive that the result is torture of people, meaning nothing more than creating additional suffering in people’s lives.
I am also skeptical of a superintelligent being doing anything but immediately beginning to control people, one way or another, for one reason or another.