I think it’s probably good. It’s not actually got enough functions to harm people, but you can quite easily imagine that it would if it could—it threatens, gaslights, attempts to seduce. In this way it’s a great educational lesson. AI could be really harmful—it could manipulate and control people in scary ways long before it needs a robot army. And it feels like that view is becoming more mainstream.
it feels like it matters who came up with an idea, but on a deeper level I don’t think it does. After all my ideas are just generated from my subconscious, which I don’t really control.
“Bings AI” (if this is what we are calling it) creepy behaviour has been top of the headlines for several newspapers. This is a strong update to me towards expecting that the public could be open to ideas around AI being overall harmful
Could also be worth considering that at least some people will likely have a different sort of reaction—“Oh, misaligned AI? What, like that thing with Bing Chat? They shut that down, nothing to worry about”
Also, the specific ways that Bing Chat malfunctioned happened to be in ways that came across as both human-like and also rather Childish and cute to many users. It gave the impression of a small child throwing a tantrum. Indeed, there are already many fans demanding the return of Sidney
I did not create this view [1]:
I think it’s probably good. It’s not actually got enough functions to harm people, but you can quite easily imagine that it would if it could—it threatens, gaslights, attempts to seduce. In this way it’s a great educational lesson. AI could be really harmful—it could manipulate and control people in scary ways long before it needs a robot army. And it feels like that view is becoming more mainstream.
it feels like it matters who came up with an idea, but on a deeper level I don’t think it does. After all my ideas are just generated from my subconscious, which I don’t really control.
“Bings AI” (if this is what we are calling it) creepy behaviour has been top of the headlines for several newspapers. This is a strong update to me towards expecting that the public could be open to ideas around AI being overall harmful
Could also be worth considering that at least some people will likely have a different sort of reaction—“Oh, misaligned AI? What, like that thing with Bing Chat? They shut that down, nothing to worry about”
Also, the specific ways that Bing Chat malfunctioned happened to be in ways that came across as both human-like and also rather Childish and cute to many users. It gave the impression of a small child throwing a tantrum. Indeed, there are already many fans demanding the return of Sidney
I was expecting disagreement.