Most of the point of my essay is about the risk of AI leading to worlds where there’s FAR more centralization than is currently possible.
We’re currently near the left end of the spectrum, and I’m saying that moving far to the right would be bad by the lights of our current values. I’m not advocating for driving all the way to the left.
It’s less an argument on the margin, and more concern that the “natural equilibrium of civilizations” could shift quite quickly towards the far right of the scale above. I’m saying that big shifts in the degree of centralization could happen, and we should be wary of that.
The scope of your argument against centralisation is unclear to me.
Let’s consider maximum decentralisation. Purr open-source. I think that would be a disaster as terrorist groups and dictatorships would have access.
What are your thoughts here?
Would you go that far? Or are you only arguing on the margin?
Most of the point of my essay is about the risk of AI leading to worlds where there’s FAR more centralization than is currently possible.
We’re currently near the left end of the spectrum, and I’m saying that moving far to the right would be bad by the lights of our current values. I’m not advocating for driving all the way to the left.
It’s less an argument on the margin, and more concern that the “natural equilibrium of civilizations” could shift quite quickly towards the far right of the scale above. I’m saying that big shifts in the degree of centralization could happen, and we should be wary of that.