Are you assuming the deployment of ASI will be analogous to an omnipotent civilisation with values completely disconnected from humans suddenly showing up on Earth?
Something like that, yeah.
However, that would be very much at odds with historical gradual technological development shaped by human values.
ASI would have a level of autonomy and goal-directedness that’s unlike any previous technology. The case for caring about AI risk doesn’t work if you take too much of an outside view, you have to reason about what properties ASI would have.
I see. I guess the probability over the next 10 years of something like what I described is lower than 0.001 %. I remain open tobetsagainst short AI timelines, or what they supposedly imply, up to 10 k$. Do you see any that we could make that is good for both of us considering we could invest our money, and that you could take loans?
Something like that, yeah.
ASI would have a level of autonomy and goal-directedness that’s unlike any previous technology. The case for caring about AI risk doesn’t work if you take too much of an outside view, you have to reason about what properties ASI would have.
I see. I guess the probability over the next 10 years of something like what I described is lower than 0.001 %. I remain open to bets against short AI timelines, or what they supposedly imply, up to 10 k$. Do you see any that we could make that is good for both of us considering we could invest our money, and that you could take loans?