Now, if you were using a superintelligence to target a UNIQUE 50-100 words tailored for each individual person, then IMO the sky’s the limit—a superintelligence could probably get crazy Snow-Crash-esque effects like getting people to commit suicide or to totally change their career / worldview / overall life trajectory.
It could probably pull this this off for a subsection of highly suggestible people, but I’m skeptical that even a superintelligence could convince most people to change deeply held values with a mere tweet thread.
Yes, there are a lot of potential word combinations out there, but the computer only has a finite amount of time to search through them, and is relying on an unavoidably imperfect model of the target person and the outer world (because of incomplete information and finite computing power).
I think it all comes down to how difficult the attempted persuasion is: I’m sure an AI could convince me to buy a 50$ product, but I don’t see any universe where it can convince me to commit an act of violence against a loved one.
It could probably pull this this off for a subsection of highly suggestible people, but I’m skeptical that even a superintelligence could convince most people to change deeply held values with a mere tweet thread.
Yes, there are a lot of potential word combinations out there, but the computer only has a finite amount of time to search through them, and is relying on an unavoidably imperfect model of the target person and the outer world (because of incomplete information and finite computing power).
I think it all comes down to how difficult the attempted persuasion is: I’m sure an AI could convince me to buy a 50$ product, but I don’t see any universe where it can convince me to commit an act of violence against a loved one.