I’m not opposed to training AIs on human data, so long as those AIs don’t make non-consensual emulations of a particular person which are good enough that strategies optimized to manipulate the AI are also very effective against that person. In practice, I think the AI does have to be pretty deliberately set up to mirror a specific person for such approaches to be extremely effective.
I’d be in favor of a somewhat more limited version of the restriction OpenAI is apparently doing, where the thing that’s restricted is deliberately aiming to make really good emulations of a specific person[1]. E.g., “rewrite this stuff in X person’s style” is fine, but “gather a bunch of bio-metric and behavioral data on X, fit an AI to that data, then optimize visual stimuli to that AI so it likes Pepsi” isn’t.
Potentially with a further limitation that the restriction only applies to people who create the AI with the intent of manipulating the real version of the simulated person.
I’m not opposed to training AIs on human data, so long as those AIs don’t make non-consensual emulations of a particular person which are good enough that strategies optimized to manipulate the AI are also very effective against that person. In practice, I think the AI does have to be pretty deliberately set up to mirror a specific person for such approaches to be extremely effective.
I’d be in favor of a somewhat more limited version of the restriction OpenAI is apparently doing, where the thing that’s restricted is deliberately aiming to make really good emulations of a specific person[1]. E.g., “rewrite this stuff in X person’s style” is fine, but “gather a bunch of bio-metric and behavioral data on X, fit an AI to that data, then optimize visual stimuli to that AI so it likes Pepsi” isn’t.
Potentially with a further limitation that the restriction only applies to people who create the AI with the intent of manipulating the real version of the simulated person.