How do you point its objective function at “itself”? How are you defining this so that it doesn’t include copies of itself, or other identical programs? Would it kill humans to prevent us from making another one of it later?
Are you sure it wouldn’t just destroy the world because that’s the most certain way to achieve its own erasure?
How do you point its objective function at “itself”? How are you defining this so that it doesn’t include copies of itself, or other identical programs? Would it kill humans to prevent us from making another one of it later?
Are you sure it wouldn’t just destroy the world because that’s the most certain way to achieve its own erasure?