Executive summary: This personal reflection argues that many prominent Effective Altruists are abandoning EA principles as they rebrand themselves solely as “AI safety” workers, risking the loss of their original moral compass and the broader altruistic vision that initially motivated the movement.
Key points:
There’s a concerning trend of former EA organizations and individuals rebranding to focus exclusively on AI safety while distancing themselves from EA principles and community identity.
This shift risks making instrumental goals (building credibility and influence in AI) the enemy of terminal goals (doing the most good), following a pattern common in politics where compromises eventually hollow out original principles.
The move away from cause prioritization and explicit moral reflection threatens to disconnect AI safety work from the fundamental values that should guide it, potentially leading to work on less important AI issues.
Organizations like 80,000 Hours shifting focus exclusively to AI reflects a premature conclusion that cause prioritization is “done,” potentially closing off important moral reconsideration.
The author worries that by avoiding explicit connections to EA values, new recruits and organizations will lose sight of the ultimate aims (preventing existential risks) in favor of more mainstream but less important AI concerns.
Regular reflection on first principles and reconnection with other moral causes (like animal suffering and global health) serves as an important epistemic and moral check that AI safety work genuinely aims at the greatest good.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.
Executive summary: This personal reflection argues that many prominent Effective Altruists are abandoning EA principles as they rebrand themselves solely as “AI safety” workers, risking the loss of their original moral compass and the broader altruistic vision that initially motivated the movement.
Key points:
There’s a concerning trend of former EA organizations and individuals rebranding to focus exclusively on AI safety while distancing themselves from EA principles and community identity.
This shift risks making instrumental goals (building credibility and influence in AI) the enemy of terminal goals (doing the most good), following a pattern common in politics where compromises eventually hollow out original principles.
The move away from cause prioritization and explicit moral reflection threatens to disconnect AI safety work from the fundamental values that should guide it, potentially leading to work on less important AI issues.
Organizations like 80,000 Hours shifting focus exclusively to AI reflects a premature conclusion that cause prioritization is “done,” potentially closing off important moral reconsideration.
The author worries that by avoiding explicit connections to EA values, new recruits and organizations will lose sight of the ultimate aims (preventing existential risks) in favor of more mainstream but less important AI concerns.
Regular reflection on first principles and reconnection with other moral causes (like animal suffering and global health) serves as an important epistemic and moral check that AI safety work genuinely aims at the greatest good.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.