Just because something is difficult, doesnât mean it isnât worth trying to do, or at least trying to learn more about so you have some sense of what to do. Calling something âunknowableââwhen the penalty for not knowing it âcivilization might end with unknown probabilityââis a claim that should be challenged vociferously, because if it turns out to be wrong in any aspect, thatâs very important for us to know.
I cannot imagine future humans being so stupid as to have AI connected to the internet and a robot army able to be hijacked by said AI at the same time.
Iâd recommend reading more about how people worried about AI conceive of the risk; Iâve heard zero people in all of EA say that this scenario is what worries them. There are many places you could start: Stuart Russellâs âHuman Compatibleâ is a good book, but thereâs also the free Wait But Why series on superintelligence (plus Luke Muehlhauserâs blog post correcting some errors in that series).
There are many good reasons to think that AI risk may be fairly low (this is an ongoing debate in EA), but before you say one side is wrong, you have to understand what they really believe.
Just because something is difficult, doesnât mean it isnât worth trying to do, or at least trying to learn more about so you have some sense of what to do. Calling something âunknowableââwhen the penalty for not knowing it âcivilization might end with unknown probabilityââis a claim that should be challenged vociferously, because if it turns out to be wrong in any aspect, thatâs very important for us to know.
Iâd recommend reading more about how people worried about AI conceive of the risk; Iâve heard zero people in all of EA say that this scenario is what worries them. There are many places you could start: Stuart Russellâs âHuman Compatibleâ is a good book, but thereâs also the free Wait But Why series on superintelligence (plus Luke Muehlhauserâs blog post correcting some errors in that series).
There are many good reasons to think that AI risk may be fairly low (this is an ongoing debate in EA), but before you say one side is wrong, you have to understand what they really believe.