I think that your list is really great! As a person who try to understand misaligned AI better, this is my arguments:
The difference between a human and an AGI might be greater than the difference between a human and a mushroom.
If the difference is that great, it will probably not make much difference between a cow and a human. The way humans treat other animals, the planet and each other makes it hard to see how we could possibly create AI alignment that is willing to save a creature like us.
If AGI has self-perservation, we are the only creatures that can threat their existence. Which means that they might want to make sure that we didn’t exist anymore just to be safe.
AGI is a thing that we know nothing about. If it cane a spaceship with aliens, we would probably use enormous resources to make sure it would not threat our planet. But now we are creating this alien creature ourselves and don’t do very much to make sure it isn’t a threat to our planet.
I think that your list is really great! As a person who try to understand misaligned AI better, this is my arguments:
The difference between a human and an AGI might be greater than the difference between a human and a mushroom.
If the difference is that great, it will probably not make much difference between a cow and a human. The way humans treat other animals, the planet and each other makes it hard to see how we could possibly create AI alignment that is willing to save a creature like us.
If AGI has self-perservation, we are the only creatures that can threat their existence. Which means that they might want to make sure that we didn’t exist anymore just to be safe.
AGI is a thing that we know nothing about. If it cane a spaceship with aliens, we would probably use enormous resources to make sure it would not threat our planet. But now we are creating this alien creature ourselves and don’t do very much to make sure it isn’t a threat to our planet.
I hope my list helps!