On the neglectedness of Cooperative AI, what do you think of the growing body of literature on multi-agent reinforcement learning? This paper notes that Google Scholar indexed nearly 10,000 papers on the topic in 2020 alone. Deepmind’s research agenda for cooperative AI has been widely cited, including by this review of the field that discusses four groups of recent research: analysis of emergent behaviors from existing RL algorithms in the multi-agent setting, learning to communicate, learning to cooperate, and agents modeling other agents.
Do you think this work productively contributes to x-risk motivated cooperative AI? What are the most helpful of these lines of research, and how could they better focus on x-risk safety?
On the neglectedness of Cooperative AI, what do you think of the growing body of literature on multi-agent reinforcement learning? This paper notes that Google Scholar indexed nearly 10,000 papers on the topic in 2020 alone. Deepmind’s research agenda for cooperative AI has been widely cited, including by this review of the field that discusses four groups of recent research: analysis of emergent behaviors from existing RL algorithms in the multi-agent setting, learning to communicate, learning to cooperate, and agents modeling other agents.
Do you think this work productively contributes to x-risk motivated cooperative AI? What are the most helpful of these lines of research, and how could they better focus on x-risk safety?