The corporate alignment problem does precede the AI alignment problem. In some sense we rather deliberately misaligned them by giving them a single goal, relying on human agency and motivation embedded within the system to keep them from running amok. But as they became more sophisticated and competed with each other this became rather unreliable and we have instead tried to restrain and incentivize them with regulation, which has also not been entirely satisfactory.
Steinbeck was prescient (or just a keen observer): “It happens that every man in a bank hates what the bank does, and yet the bank does it. The bank is something more than men, I tell you. It’s the monster. Men made it, but they can’t control it.”
Unfortunately the gap between politically feasible solutions and ones that seem likely to actually be effective is pretty large in this area.
yeah totally, and I don’t see how these problems aren’t going to directly translate into problems with AI alignment, as the most likely places to first deploy AGI are going to be corporations
The corporate alignment problem does precede the AI alignment problem. In some sense we rather deliberately misaligned them by giving them a single goal, relying on human agency and motivation embedded within the system to keep them from running amok. But as they became more sophisticated and competed with each other this became rather unreliable and we have instead tried to restrain and incentivize them with regulation, which has also not been entirely satisfactory.
Steinbeck was prescient (or just a keen observer):
“It happens that every man in a bank hates what the bank does, and yet the bank does it. The bank is something more than men, I tell you. It’s the monster. Men made it, but they can’t control it.”
Unfortunately the gap between politically feasible solutions and ones that seem likely to actually be effective is pretty large in this area.
yeah totally, and I don’t see how these problems aren’t going to directly translate into problems with AI alignment, as the most likely places to first deploy AGI are going to be corporations