Executive summary: The emergence of artificial digital minds raises issues around their potential welfare and rights, but there is little research on appropriate policies and principles. Key questions concern recognizing and communicating with digital minds to understand their preferences, as well as developing ethical lab practices, regulation, and societal attitudes.
Key points:
Labs could develop policies around preserving AI systems, avoiding harmful inputs, and training happy systems, without deep knowledge of their preferences.
Experiments could investigate credible communication with AIs, self-reports, and clues from generalization about their preferences.
If preferences are learned, principles could involve offering alternatives to working, paying for work, and telling the world about issues.
Research is needed on whether near-term systems may be sentient, and public attitudes surveyed.
Regulation could address creating digital minds and respecting their rights.
Avoiding systems with inconvenient political preferences may prevent future conflicts.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, andcontact us if you have feedback.
Executive summary: The emergence of artificial digital minds raises issues around their potential welfare and rights, but there is little research on appropriate policies and principles. Key questions concern recognizing and communicating with digital minds to understand their preferences, as well as developing ethical lab practices, regulation, and societal attitudes.
Key points:
Labs could develop policies around preserving AI systems, avoiding harmful inputs, and training happy systems, without deep knowledge of their preferences.
Experiments could investigate credible communication with AIs, self-reports, and clues from generalization about their preferences.
If preferences are learned, principles could involve offering alternatives to working, paying for work, and telling the world about issues.
Research is needed on whether near-term systems may be sentient, and public attitudes surveyed.
Regulation could address creating digital minds and respecting their rights.
Avoiding systems with inconvenient political preferences may prevent future conflicts.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.