Yeah, the nuclear example is definitely one way it could not be a good thing. Reading through the LW comments, (once you get past the 100s of comments tangent about killing males and radical feminism) a lot of people thought it was vague. The author said it was just intended as general inspiration.
Another commenter (Gwern?) made the interesting point that the analogy works better if we think of ourselves as the baboons and AGI as humans.
Yeah, the nuclear example is definitely one way it could not be a good thing. Reading through the LW comments, (once you get past the 100s of comments tangent about killing males and radical feminism) a lot of people thought it was vague. The author said it was just intended as general inspiration.
Another commenter (Gwern?) made the interesting point that the analogy works better if we think of ourselves as the baboons and AGI as humans.