To be honest, I thought that the argument related to corporations was the weakest argument and that the post would be been strengthened by focusing on the other arguments.
It feels to me that there’s two very strong disanalogies: a) that the incentives of different employees are very often heavily at odds with each other and that this becomes more likely the more that a corporation scales and the more levels of hierarchy that it obtains b) that the corporation consists of humans who can prevent activities from veering too far into the objectionable in most cases.
I’ll also add an additional point: it’s very difficult for large corporations to engage in massive conspiracies without it eventually leaking. AI has no such problems co-ordinating with itself.
To be honest, I thought that the argument related to corporations was the weakest argument and that the post would be been strengthened by focusing on the other arguments.
It feels to me that there’s two very strong disanalogies: a) that the incentives of different employees are very often heavily at odds with each other and that this becomes more likely the more that a corporation scales and the more levels of hierarchy that it obtains b) that the corporation consists of humans who can prevent activities from veering too far into the objectionable in most cases.
I’ll also add an additional point: it’s very difficult for large corporations to engage in massive conspiracies without it eventually leaking. AI has no such problems co-ordinating with itself.