’Relatedly, laws around capital ownership. If almost all economic value is created by AI, then whoever owns the aligned AI (and hardware, data, etc) would have almost total economic power. Similarly, if all military power is held by AI, then whoever owns the AI would have almost total military power. In principle this could be a single company or a small group of people. We could try to work on legislation in advance to more widely share the increased power from aligned AI. ’
I’m a bit worried that even if on paper ownership of AI is somehow spread over a large proportion of the population, people who literally control the AI could just ignore this.
’Relatedly, laws around capital ownership. If almost all economic value is created by AI, then whoever owns the aligned AI (and hardware, data, etc) would have almost total economic power. Similarly, if all military power is held by AI, then whoever owns the AI would have almost total military power. In principle this could be a single company or a small group of people. We could try to work on legislation in advance to more widely share the increased power from aligned AI. ’
I’m a bit worried that even if on paper ownership of AI is somehow spread over a large proportion of the population, people who literally control the AI could just ignore this.