So partially what I’m saying is that the definitions of ” AI alignment” and “AI safety” are confusing, and people are using them to refer to different things in a way that can mislead. For example, if you declare that your AI is “safe” while it’s killing people on the daily (because you were referring to extinction), people will rightly feel mislead and angry.
Similarly, for “misalignment”, an image generator giving you an image of a hand with the wrong number of fingers is misaligned in the sense than you care about the correct number of fingers and it doesn’t know this. But it doesn’t cause any real harm the way that a malfunction in a healthcare diagnoser would.
Your point about safety wanting to prevent as well as protect is a good one. I think “AI safety” should refer to both.
So partially what I’m saying is that the definitions of ” AI alignment” and “AI safety” are confusing, and people are using them to refer to different things in a way that can mislead. For example, if you declare that your AI is “safe” while it’s killing people on the daily (because you were referring to extinction), people will rightly feel mislead and angry.
Similarly, for “misalignment”, an image generator giving you an image of a hand with the wrong number of fingers is misaligned in the sense than you care about the correct number of fingers and it doesn’t know this. But it doesn’t cause any real harm the way that a malfunction in a healthcare diagnoser would.
Your point about safety wanting to prevent as well as protect is a good one. I think “AI safety” should refer to both.