Executive summary: Advanced AI systems may enable the decomposition of agency into separable components, challenging assumptions about unitary AI agents and raising important questions about efficiency, safety, and societal impacts.
Key points:
Agency can be decomposed into goals, implementation capacity, situational awareness, and planning capacity.
Examples of decomposed agency already exist in human systems like management consulting and legal entities.
AI could enable fuller decomposition of agency, with systems providing specific components without being full agents.
Decomposed AI agency raises questions about efficiency, safety, and potential societal shifts in power dynamics.
More research is needed to map out the space of possibilities and prepare for scenarios with non-unitary AI systems.
Deliberate choices in system design could shape the future of AI agency, potentially avoiding certain risks.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, andcontact us if you have feedback.
Executive summary: Advanced AI systems may enable the decomposition of agency into separable components, challenging assumptions about unitary AI agents and raising important questions about efficiency, safety, and societal impacts.
Key points:
Agency can be decomposed into goals, implementation capacity, situational awareness, and planning capacity.
Examples of decomposed agency already exist in human systems like management consulting and legal entities.
AI could enable fuller decomposition of agency, with systems providing specific components without being full agents.
Decomposed AI agency raises questions about efficiency, safety, and potential societal shifts in power dynamics.
More research is needed to map out the space of possibilities and prepare for scenarios with non-unitary AI systems.
Deliberate choices in system design could shape the future of AI agency, potentially avoiding certain risks.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.