Executive summary: Implementing logical decision theory helps AI companies align their capabilities progress to reduce existential risk and maximize mutual utility.
Key points:
AI companies racing for capabilities creates unnecessary existential risk from unaligned superintelligences.
Logical decision theory incentives both companies to cooperate by slowing progress.
Cooperation allows more worlds where an aligned superintelligence satisfies their utility functions.
Defecting by racing progress causes more dead worlds and less mutual utility.
For negative utilitarians, cooperation also reduces remote suffering.
Some confidence in capabilities is warranted, but extreme overconfidence risks catastrophe.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, andcontact us if you have feedback.
Executive summary: Implementing logical decision theory helps AI companies align their capabilities progress to reduce existential risk and maximize mutual utility.
Key points:
AI companies racing for capabilities creates unnecessary existential risk from unaligned superintelligences.
Logical decision theory incentives both companies to cooperate by slowing progress.
Cooperation allows more worlds where an aligned superintelligence satisfies their utility functions.
Defecting by racing progress causes more dead worlds and less mutual utility.
For negative utilitarians, cooperation also reduces remote suffering.
Some confidence in capabilities is warranted, but extreme overconfidence risks catastrophe.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.