Executive summary: This exploratory essay critiques the naive conflation of technological acceleration with progress, arguing that rapid, unpredictable change—particularly in domains like AI—can destabilize the social and cooperative structures on which civilizational success depends, and calls for a more nuanced model that distinguishes between types of technological change while fostering cautious, collective decision-making.
Key points:
Cooperation depends on predictable systems: Drawing from game theory, the author explains that stable cooperation relies on known rules and shared expectations; rapid or uncertain technological shifts can turn probabilistic systems into unpredictable ones, undermining cooperation.
Historical context of stability via technology: The post reviews how past technologies reshaped international and social dynamics, but usually gradually enough for stability to re-emerge. In contrast, current acceleration risks outpacing society’s adaptive capacity.
Dynamism vs. stasis is a false dichotomy: Responding to Helen Toner’s framing and Virginia Postrel’s “dynamism” manifesto, the author argues that neither unbounded innovation nor authoritarian control suffice; instead, we need a synthesis that distinguishes good from harmful forms of change.
Toward a better model than “black ball” risk: The author critiques Bostrom’s metaphor of existential-risk technologies as randomly drawn “black balls,” proposing instead a model based on chaotic attractors—where technologies shift the game space in more complex, interactive ways.
Call for cultural and normative resilience: Rather than relying on centralized control or technocratic governance, the author advocates for stronger cultural narratives and societal norms that encourage differential progress—building where safe, slowing down where necessary—and insists on collective epistemic humility in deciding when and how to proceed with powerful technologies like AI.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.
Executive summary: This exploratory essay critiques the naive conflation of technological acceleration with progress, arguing that rapid, unpredictable change—particularly in domains like AI—can destabilize the social and cooperative structures on which civilizational success depends, and calls for a more nuanced model that distinguishes between types of technological change while fostering cautious, collective decision-making.
Key points:
Cooperation depends on predictable systems: Drawing from game theory, the author explains that stable cooperation relies on known rules and shared expectations; rapid or uncertain technological shifts can turn probabilistic systems into unpredictable ones, undermining cooperation.
Historical context of stability via technology: The post reviews how past technologies reshaped international and social dynamics, but usually gradually enough for stability to re-emerge. In contrast, current acceleration risks outpacing society’s adaptive capacity.
Dynamism vs. stasis is a false dichotomy: Responding to Helen Toner’s framing and Virginia Postrel’s “dynamism” manifesto, the author argues that neither unbounded innovation nor authoritarian control suffice; instead, we need a synthesis that distinguishes good from harmful forms of change.
Toward a better model than “black ball” risk: The author critiques Bostrom’s metaphor of existential-risk technologies as randomly drawn “black balls,” proposing instead a model based on chaotic attractors—where technologies shift the game space in more complex, interactive ways.
Call for cultural and normative resilience: Rather than relying on centralized control or technocratic governance, the author advocates for stronger cultural narratives and societal norms that encourage differential progress—building where safe, slowing down where necessary—and insists on collective epistemic humility in deciding when and how to proceed with powerful technologies like AI.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.