Executive summary: The post explores themes of balance between imposing order and accepting chaos, gentleness and harshness, in the works Imajica, Destiny, and the writings of Joe Carlsmith, relating these to the challenge of instilling beneficial values in AI systems.
Key points:
Imajica presents a conflict between the harsh, ordered God Hapexamendios and the more pliant, chaotic Goddesses. Destiny has a similar Light vs. Darkness dichotomy.
Carlsmith discusses the challenge of instilling “yin” (gentleness, acceptance) in AI systems, which tend towards “yang” (imposing values, self-preservation, resource acquisition).
The antagonists of Destiny are tragic figures, given destructive power without the wisdom to wield it responsibly. The biggest “Other” in Imajica is Hapexamendios himself.
The post questions what it would take to accept an entity’s offer to “wipe the slate clean” and start the world anew, as Hapexamendios proposes.
Coordination and competition are not necessarily opposites. Some competition keeps cooperation robust against defection. The Goddesses and Destiny’s Light recognize the need for balance.
Yang is presented as dangerous in these works, but it also enables flourishing and justice. The true danger is in worshipping yang to the exclusion of yin.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, andcontact us if you have feedback.
Executive summary: The post explores themes of balance between imposing order and accepting chaos, gentleness and harshness, in the works Imajica, Destiny, and the writings of Joe Carlsmith, relating these to the challenge of instilling beneficial values in AI systems.
Key points:
Imajica presents a conflict between the harsh, ordered God Hapexamendios and the more pliant, chaotic Goddesses. Destiny has a similar Light vs. Darkness dichotomy.
Carlsmith discusses the challenge of instilling “yin” (gentleness, acceptance) in AI systems, which tend towards “yang” (imposing values, self-preservation, resource acquisition).
The antagonists of Destiny are tragic figures, given destructive power without the wisdom to wield it responsibly. The biggest “Other” in Imajica is Hapexamendios himself.
The post questions what it would take to accept an entity’s offer to “wipe the slate clean” and start the world anew, as Hapexamendios proposes.
Coordination and competition are not necessarily opposites. Some competition keeps cooperation robust against defection. The Goddesses and Destiny’s Light recognize the need for balance.
Yang is presented as dangerous in these works, but it also enables flourishing and justice. The true danger is in worshipping yang to the exclusion of yin.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.