Prometheus—all of these topics might sound hackneyed, threadworn, and over-discussed to people who have spent years within the EA/LessWrong communities.
But to most normal folks (the ‘general public’) who are encountering discussions of AI risk for the first time, all of these remain highly relevant issues to think through. It’s not at all obvious to most people why companies would seek AIs with agency, or AIs capable of recursive self-improvement, or AIs that can make lethal autonomous decisions in military conflicts.
IMHO, we have a serious public duty and moral obligation to communicate as clearly as possible everything we’ve learned over the last couple of decades in discussing AI X-risk with each other. Most people haven’t been privy to those discussions. They deserve to be able to follow our concepts, values, and reasoning on all these topics.
I generally agree, regarding the public at large. I’m speaking mostly from experience of people in the AIS Community speaking with people either working in AI or some related field, and I’ve found many often can get stuck debating these concepts. The general public seems to get more hung up on concepts like consciousness, sentience, etc. (from my experience)
Prometheus—all of these topics might sound hackneyed, threadworn, and over-discussed to people who have spent years within the EA/LessWrong communities.
But to most normal folks (the ‘general public’) who are encountering discussions of AI risk for the first time, all of these remain highly relevant issues to think through. It’s not at all obvious to most people why companies would seek AIs with agency, or AIs capable of recursive self-improvement, or AIs that can make lethal autonomous decisions in military conflicts.
IMHO, we have a serious public duty and moral obligation to communicate as clearly as possible everything we’ve learned over the last couple of decades in discussing AI X-risk with each other. Most people haven’t been privy to those discussions. They deserve to be able to follow our concepts, values, and reasoning on all these topics.
I generally agree, regarding the public at large. I’m speaking mostly from experience of people in the AIS Community speaking with people either working in AI or some related field, and I’ve found many often can get stuck debating these concepts. The general public seems to get more hung up on concepts like consciousness, sentience, etc. (from my experience)