I disagree re: motte and bailey; the above is not at all in conflict with the position of the book (which, to be clear, I endorse and agree with and is also my position).
re: “you can imagine,” I strongly encourage people to be careful about leaning too hard on their own ability to imagine things; it’s often fraught and a huge chunk of the work MIRI does is poking at those imaginings to see where they collapse.
I’ll note that core MIRI predictions about e.g. how machines will be misaligned at current levels of sophistication are being borne out—things we have been saying for years about e.g. emergent drives and deception and hacking and brittle proxies. I’m pretty sure that’s not “rooted in the actual nuts and bolts details” in the way you’re wanting, but it still feels … relevant.
I disagree re: motte and bailey; the above is not at all in conflict with the position of the book (which, to be clear, I endorse and agree with and is also my position).
re: “you can imagine,” I strongly encourage people to be careful about leaning too hard on their own ability to imagine things; it’s often fraught and a huge chunk of the work MIRI does is poking at those imaginings to see where they collapse.
I’ll note that core MIRI predictions about e.g. how machines will be misaligned at current levels of sophistication are being borne out—things we have been saying for years about e.g. emergent drives and deception and hacking and brittle proxies. I’m pretty sure that’s not “rooted in the actual nuts and bolts details” in the way you’re wanting, but it still feels … relevant.