Mo—you might be right about what MIRI thinks will be hard. I’m not sure; it often seems difficult to understand what they write about these issues, since it’s often very abstract and seems not very grounded in specific goals and values that AIs might need to implement. I do think the MIRI-type approach radically under-estimates the difficulty of your point number 2.
On the other hand, I’m not at all confident that point number 1 will be easy. My hunch is that both 1 and 2 will prove surprisingly hard. Which is a good reason to pause AI research until we make a lot more progress on both issues. (And if we don’t make dramatic progress on both issues, the ‘pause’ should remain in place as long as it takes. Which could be decades or centuries.)
Mo—you might be right about what MIRI thinks will be hard. I’m not sure; it often seems difficult to understand what they write about these issues, since it’s often very abstract and seems not very grounded in specific goals and values that AIs might need to implement. I do think the MIRI-type approach radically under-estimates the difficulty of your point number 2.
On the other hand, I’m not at all confident that point number 1 will be easy. My hunch is that both 1 and 2 will prove surprisingly hard. Which is a good reason to pause AI research until we make a lot more progress on both issues. (And if we don’t make dramatic progress on both issues, the ‘pause’ should remain in place as long as it takes. Which could be decades or centuries.)