I imagine that comprehensive AI services (CAIS) could face similar problems to intelligence agencies. Ideally, an intelligence agency would only hire those people who are maximally trusted, but then they could hire hardly anyone. Instead they split the information that any one person can see such that (1) that person can’t do much harm with the one piece of the full picture that they have and (2) if it leaks or the person exploits their knowledge in illegitimate ways, the higher-ups can trace the leak. Swap in particular capabilities for the particular information, and you have the situation that a network of specialized AI services faces.
Specialized services may be designed to recombine other services in ways that gives them, in aggregate, close to general abilities, or individual services may be undiscovered mesa-optimizers. Human overseers may then benefit from research that has transferred the experience of intelligence agencies to CAIS.
This may be part of a more general push to turn CAIS into a safer and more efficient alternative to AGI for the industry.
Safety of comprehensive AI services
Artificial Intelligence
I imagine that comprehensive AI services (CAIS) could face similar problems to intelligence agencies. Ideally, an intelligence agency would only hire those people who are maximally trusted, but then they could hire hardly anyone. Instead they split the information that any one person can see such that (1) that person can’t do much harm with the one piece of the full picture that they have and (2) if it leaks or the person exploits their knowledge in illegitimate ways, the higher-ups can trace the leak. Swap in particular capabilities for the particular information, and you have the situation that a network of specialized AI services faces.
Specialized services may be designed to recombine other services in ways that gives them, in aggregate, close to general abilities, or individual services may be undiscovered mesa-optimizers. Human overseers may then benefit from research that has transferred the experience of intelligence agencies to CAIS.
This may be part of a more general push to turn CAIS into a safer and more efficient alternative to AGI for the industry.