Is there an equivalent to ‘concrete problems in AI’ for strategic research? If I was a researcher interested in strategy I’d have three questions: ‘What even is AI strategy research?’, ‘What sort of skills are relevant?’, ‘What are some specific problems that I could work on?’ A ‘concrete problems’-like paper would help with all three.
This is a really good point, and I’m not sure that something exists which was written with that in mind. Daniel Dewey wrote something which was maybe a first step on a short form of this in 2015. A ‘concrete-problems’ in strategy might be a really useful output from SAIRC.
I feel like “Superintelligence” is the closest thing to this, which was largely on strategy rather than maths. While it didn’t end each chapter with explicit questions for further research, it’d be my first recommendation for a strategy researcher to read and gain a sense of what work could be done.
I’d also recommend Eliezer Yudkowsky’s paper on Intelligence Explosion Microeconomics, which is more niche but way less read.
Is there an equivalent to ‘concrete problems in AI’ for strategic research? If I was a researcher interested in strategy I’d have three questions: ‘What even is AI strategy research?’, ‘What sort of skills are relevant?’, ‘What are some specific problems that I could work on?’ A ‘concrete problems’-like paper would help with all three.
This is a really good point, and I’m not sure that something exists which was written with that in mind. Daniel Dewey wrote something which was maybe a first step on a short form of this in 2015. A ‘concrete-problems’ in strategy might be a really useful output from SAIRC.
http://globalprioritiesproject.org/2015/10/three-areas-of-research-on-the-superintelligence-control-problem/
I feel like “Superintelligence” is the closest thing to this, which was largely on strategy rather than maths. While it didn’t end each chapter with explicit questions for further research, it’d be my first recommendation for a strategy researcher to read and gain a sense of what work could be done.
I’d also recommend Eliezer Yudkowsky’s paper on Intelligence Explosion Microeconomics, which is more niche but way less read.
Luke Muehlhauser posted a list of strategic questions here: http://lukemuehlhauser.com/some-studies-which-could-improve-our-strategic-picture-of-superintelligence/ (originally posted in 2014).