I don’t think world dystopia is entirely necessary, but a successful long stop for AI (the ~30+ years it’ll probably take) is probably going to require knocking over a couple of countries that refuse to play ball. It seems fairly hard to keep even small countries from setting up datacentres and chip factories except by threatening or using military force.
To be clear, I think that’s worth it. Heck, nuclear war would be worth it if necessary, although I’m not sure it will be—the PRC in particular I rate as >50% either a) agreeing to a stop, and/or b) getting destroyed in non-AI-related nuclear war in the next few years.
I don’t think world dystopia is entirely necessary, but a successful long stop for AI (the ~30+ years it’ll probably take) is probably going to require knocking over a couple of countries that refuse to play ball. It seems fairly hard to keep even small countries from setting up datacentres and chip factories except by threatening or using military force.
To be clear, I think that’s worth it. Heck, nuclear war would be worth it if necessary, although I’m not sure it will be—the PRC in particular I rate as >50% either a) agreeing to a stop, and/or b) getting destroyed in non-AI-related nuclear war in the next few years.