Thank you for pursuing this line of argument, I think the question of legal rights for AI is a really important one. One thought i’ve had reading your previous posts about this, is whether it legal rights will matter not only for securing the welfare of AI but also for safeguarding humanity.
I haven’t really thought this fully through, but here’s my line of thinking:
As we are currently on track to create superintelligence and I don’t think we can say anything with much confidence about whether the AI we create will value the same things as us, it might be important to set up mechanisms which make peaceful collaboration with humanity the most attractive option for superintelligent AI(s) to get what they want.
If your best bet for getting what you want involves eliminating all humans, you are a lot more likely to eliminate all humans!
Thank you for pursuing this line of argument, I think the question of legal rights for AI is a really important one. One thought i’ve had reading your previous posts about this, is whether it legal rights will matter not only for securing the welfare of AI but also for safeguarding humanity.
I haven’t really thought this fully through, but here’s my line of thinking:
As we are currently on track to create superintelligence and I don’t think we can say anything with much confidence about whether the AI we create will value the same things as us, it might be important to set up mechanisms which make peaceful collaboration with humanity the most attractive option for superintelligent AI(s) to get what they want.
If your best bet for getting what you want involves eliminating all humans, you are a lot more likely to eliminate all humans!