Agreed. It also doesnât seem to me that even a successful alignment of AGI to âhuman valuesââthe same values which gave us war, slavery, and even today still torture billions of sentient beings per year before killing themâis prima facie a good thing.
Does AI alignment imply that the AGI must care about blind spots in todayâs âhuman valuesâ, and seek to expand its circle to include moral patients who would otherwise have been ignored? Not necessarily.
Agreed. It also doesnât seem to me that even a successful alignment of AGI to âhuman valuesââthe same values which gave us war, slavery, and even today still torture billions of sentient beings per year before killing themâis prima facie a good thing.
Does AI alignment imply that the AGI must care about blind spots in todayâs âhuman valuesâ, and seek to expand its circle to include moral patients who would otherwise have been ignored? Not necessarily.