My main source of skepticism is that I am not sure whether we’ll get to TAI this century. While there are currently some organizations dedicated to building AGI (OpenAI, DeepMind), it could be that comprehensive AI services obviate the economic incentive to develop AGI rather than a collection of narrow AIs (especially given that AGI poses known risks that narrow AIs don’t).
If I tell you a coin has 2 sides, and Alice tells you a die has 6, it feels like you have enough information to work out that getting tails is more likely than rolling a 1
Yes, that is an argument that directly compares probabilities. Fair coins and fair 6-sided dice are straightforward mathematical objects, whereas x-risk and expected value estimates for x-risk reduction depend on sketchy numerical assumptions.
My main source of skepticism is that I am not sure whether we’ll get to TAI this century. While there are currently some organizations dedicated to building AGI (OpenAI, DeepMind), it could be that comprehensive AI services obviate the economic incentive to develop AGI rather than a collection of narrow AIs (especially given that AGI poses known risks that narrow AIs don’t).
Yes, that is an argument that directly compares probabilities. Fair coins and fair 6-sided dice are straightforward mathematical objects, whereas x-risk and expected value estimates for x-risk reduction depend on sketchy numerical assumptions.
Sorry for my extremely delayed response, btw!