I hope you are right but you should be aware that the opposite may also be true. Depending on the weights we give AI in valuing human and non-human thriving, AI may discover new ways that would make humans happier at the expense of non-humans. There are people and organizations who would assign a moral weight of zero to the suffering of some of even all non-humans, and if those people win the argument then you might end up with an AI which is less to your taste than one that just emerges organically with basic guide rails.
For example, leaving aside second order effects on wider ecology, if you asked me how much intense suffering I would inflict on shrimp to save a human life, I would personally choose an almost unlimited amount.
I agree there is the opposite danger as well, and perhaps we have yet to known those dangers and new conflict of interests between humans and animals⦠I assume with ASI, the risk of possible future digital minds being in a conflict of interests with humans is bigger than for animals.
I hope you are right but you should be aware that the opposite may also be true. Depending on the weights we give AI in valuing human and non-human thriving, AI may discover new ways that would make humans happier at the expense of non-humans. There are people and organizations who would assign a moral weight of zero to the suffering of some of even all non-humans, and if those people win the argument then you might end up with an AI which is less to your taste than one that just emerges organically with basic guide rails.
For example, leaving aside second order effects on wider ecology, if you asked me how much intense suffering I would inflict on shrimp to save a human life, I would personally choose an almost unlimited amount.
I agree there is the opposite danger as well, and perhaps we have yet to known those dangers and new conflict of interests between humans and animalsβ¦
I assume with ASI, the risk of possible future digital minds being in a conflict of interests with humans is bigger than for animals.