Most of the point of my essay is about the risk of AI leading to worlds where there’s FAR more centralization than is currently possible.
We’re currently near the left end of the spectrum, and I’m saying that moving far to the right would be bad by the lights of our current values. I’m not advocating for driving all the way to the left.
It’s less an argument on the margin, and more concern that the “natural equilibrium of civilizations” could shift quite quickly towards the far right of the scale above. I’m saying that big shifts in the degree of centralization could happen, and we should be wary of that.
Most of the point of my essay is about the risk of AI leading to worlds where there’s FAR more centralization than is currently possible.
We’re currently near the left end of the spectrum, and I’m saying that moving far to the right would be bad by the lights of our current values. I’m not advocating for driving all the way to the left.
It’s less an argument on the margin, and more concern that the “natural equilibrium of civilizations” could shift quite quickly towards the far right of the scale above. I’m saying that big shifts in the degree of centralization could happen, and we should be wary of that.