I’m also worried about the related danger of AI persuasion technology being “democratically” deployed upon open societies (i.e., by anyone with an agenda, not necessarily just governments and big corporations), with the possible effect that in the words of Paul Christiano, “we’ll live to see a world where it’s considered dicey for your browser to uncritically display sentences written by an untrusted party.” This is arguably already true today for those especially vulnerable to conspiracy theories, but eventually will affect more and more people as the technology improves. How will we solve our collective problems when the safety of discussions are degraded to such an extent?
I’m also worried about the related danger of AI persuasion technology being “democratically” deployed upon open societies (i.e., by anyone with an agenda, not necessarily just governments and big corporations), with the possible effect that in the words of Paul Christiano, “we’ll live to see a world where it’s considered dicey for your browser to uncritically display sentences written by an untrusted party.” This is arguably already true today for those especially vulnerable to conspiracy theories, but eventually will affect more and more people as the technology improves. How will we solve our collective problems when the safety of discussions are degraded to such an extent?