Thanks for bringing this to light. I think awareness around deepfakes really does need to be considered more.
So maybe spamming content for significant figures doing whacky things is effective for updating people’s models for the probability of a deepfake.
I would be slightly concerned about spamming people with deepfakes. I don’t know if the average adult knows what a deepfake is. If spammed with deepfakes, people might think the world is even crazier than it actually is and I think that could get ugly. I think a more overtly educational or interactive exchange might have a better outcome.
I tend to mentally categorize deepfakes in a “discernment of truth” bucket alongside misinformation, disinformation. I think that bucket may already be impacting the average adult a fair amount. Social media bots have been fueling these for a while, and (personally, I feel that) there has been a fairly dramatic increase in quantity of scams, spam, phishing and clickbait augmented by ChatGPT and SEO changes. How do others think about this framing and what have others observed?
I agree that this issue is likely to get much worse if it’s not acted upon in a well coordinated, scaled and rapid manner.
Yeah discernment of truth makes sense to me—and fair, spam is probably not productive, but it got across my intention of ‘desensitizing’ people to this strategy of playing on our ‘discernment of truth’. I think Geoffrey’s comment on the next political cycle is really interesting for thinking about how that ‘spam’ may end up looking.
Several existing technologies can wreak havoc on epistemics / perception of the world and worsen polarization. Navigating truth vs. fiction will get more difficult. This will continue to be a problem for elections and may sow seeds for even bigger global problems.
Thanks for bringing this to light. I think awareness around deepfakes really does need to be considered more.
I would be slightly concerned about spamming people with deepfakes. I don’t know if the average adult knows what a deepfake is. If spammed with deepfakes, people might think the world is even crazier than it actually is and I think that could get ugly. I think a more overtly educational or interactive exchange might have a better outcome.
I tend to mentally categorize deepfakes in a “discernment of truth” bucket alongside misinformation, disinformation. I think that bucket may already be impacting the average adult a fair amount. Social media bots have been fueling these for a while, and (personally, I feel that) there has been a fairly dramatic increase in quantity of scams, spam, phishing and clickbait augmented by ChatGPT and SEO changes. How do others think about this framing and what have others observed?
I agree that this issue is likely to get much worse if it’s not acted upon in a well coordinated, scaled and rapid manner.
Yeah discernment of truth makes sense to me—and fair, spam is probably not productive, but it got across my intention of ‘desensitizing’ people to this strategy of playing on our ‘discernment of truth’. I think Geoffrey’s comment on the next political cycle is really interesting for thinking about how that ‘spam’ may end up looking.
I agree. This seems like an important problem.
Several existing technologies can wreak havoc on epistemics / perception of the world and worsen polarization. Navigating truth vs. fiction will get more difficult. This will continue to be a problem for elections and may sow seeds for even bigger global problems.
Anyone know what efforts exist to combat this?
Is this a subcategory of AI safety?
Yeah, I have no idea, unfortunately. And yes it seems quite attached to AI capabilities.