This post outlines the types of civilisational vulnerabilities described in Nick Bostromâs article The Vulnerable World Hypothesis (discussed in this TED talk). Any errors/âmisinterpretations are my own.
Definitions
Civilizational devastation: âdestructive event that is at least as bad as the death of 15 per cent of the world population or a reduction of global GDP by > 50 per cent per cent lasting for more than a decadeâ.
Semi-anarchic default condition:
Limited capacity for preventive policing: âStates do not have sufficiently reliable means of real-time surveillance and interception to make it virtually impossible for any individual or small group within their territory to carry out illegal actions â particularly actions that are very strongly disfavored by > 99 per cent of the populationâ.
Limited capacity for global governance: âThere is no reliable mechanism for solving global coordination problems and protecting global commons â particularly in high-stakes situations where vital national security interests are involvedâ.
Diverse motivations: âThere is a wide and recognizably human distribution of motives represented by a large population of actors (at both the individual and state level) â in particular, there are many actors motivated, to a substantial degree, by perceived self-interest (e.g. money, power, status, comfort and convenience) and there are some actors (âthe apocalyptic residualâ) who would act in ways that destroy civilization even at high cost to themselvesâ.
Type-1 vulnerability (âeasy nukesâ)
Definition: âThere is some technology which is so destructive and so easy to use that, given the semi-anarchic default condition, the actions of actors in the apocalyptic residual make civilizational devastation extremely likelyâ.
âSo destructive and [or] so easy to useâ because what matters is the âexpected harmâ, which is proportional to the likelihood of enabling a certain harm and to the severity of that harm. (And the total expected harm would be the sum of the expected harms of the various harmful technologies.)
Consequently, the lower is the feasibility of causing harm, the higher its severity has to be such that civilizational devastation is extremely likely. Some examples of âtype-1â vulnerabilities:
âVery easy nukesâ scenario (VEN), where the likelihood and severity are large.
âModerately easy bio-doomâ scenario (MEBD), where the likelihood is smaller than in the VEN, but the severity is larger.
âEasy nukesâ scenario, where the likelihood is between those of the VEN and the MEBD, but sufficiently high to result in a large expected harm.
Type-2a vulnerability (âsafe first strikeâ)
Definition: âThere is some level of technology at which powerful actors have the ability to produce civilization-devastating harms and, in the semi-anarchic default condition, face incentives to use that abilityâ.
âPowerful actorsâ could be, for instance, leaders of powerful countries (e.g. US and China) or influential companies (e.g. Google and Facebook).
Example of âincentives to use that abilityâ:
If both the US and Soviet Union had not been able to ensure second strike capability during the Cold War (a âhard nukesâ scenario), there would have been an incentive for a âsafe first strikeâ.
The âfirst strikerâ would alleviate the fear of becoming the victim of a first strike while surviving relatively unscathed (neglecting nuclear winter).
Type-2b vulnerability (âworse global warmingâ)
Definition: âThere is some level of technology at which, in the semi-anarchic default condition, a great many actors face incentives to take some slightly damaging action such that the combined effect of those actions is civilizational devastationâ.
As in the type-2a vulnerability, actors face incentives to porsue the course of action that leads to damage.
However, for the type-2b vulnerability, the incentices are faced by âa great many actorsâ (e.g. typical citizens of many countries).
The paper describes describes a âworse global warmingâ scenario as an example of type-2b vulnerability. For this scenario, we could imagine that:
The incentives to produce CO2e emissions are roughly as strong as in the âactual global warmingâ scenario, but the transient climate sensitivity (roughly speaking, the medium term temperature change per amount of CO2e emissions) is much higher.
The transient climate sensitivity is the same as in the âactual global warmingâ scenario, but the incentives to produce CO2e emissions are much stronger (much cheaper fossil fuels due to much greater availability).
Definition: âThere is some technology that carries a hidden risk such that the default outcome when it is discovered is inadvertent civilizational devastationâ.
âInadvertentâ refers to an adverse outcome which sprang from bad luck, not coordination failure.
The paper describes a âsurprising strangeletsâ scenario as an example of type-2b vulnerability:
âSome modern high-energy physics experiment turns out to initiate a self-catalyzing process in which ordinary matter gets converted into strange matter, with the result that our planet is destroyedâ.
Civilizational vulnerabilities
This post outlines the types of civilisational vulnerabilities described in Nick Bostromâs article The Vulnerable World Hypothesis (discussed in this TED talk). Any errors/âmisinterpretations are my own.
Definitions
Civilizational devastation: âdestructive event that is at least as bad as the death of 15 per cent of the world population or a reduction of global GDP by > 50 per cent per cent lasting for more than a decadeâ.
Semi-anarchic default condition:
Limited capacity for preventive policing: âStates do not have sufficiently reliable means of real-time surveillance and interception to make it virtually impossible for any individual or small group within their territory to carry out illegal actions â particularly actions that are very strongly disfavored by > 99 per cent of the populationâ.
Limited capacity for global governance: âThere is no reliable mechanism for solving global coordination problems and protecting global commons â particularly in high-stakes situations where vital national security interests are involvedâ.
Diverse motivations: âThere is a wide and recognizably human distribution of motives represented by a large population of actors (at both the individual and state level) â in particular, there are many actors motivated, to a substantial degree, by perceived self-interest (e.g. money, power, status, comfort and convenience) and there are some actors (âthe apocalyptic residualâ) who would act in ways that destroy civilization even at high cost to themselvesâ.
Type-1 vulnerability (âeasy nukesâ)
Definition: âThere is some technology which is so destructive and so easy to use that, given the semi-anarchic default condition, the actions of actors in the apocalyptic residual make civilizational devastation extremely likelyâ.
âSo destructive and [or] so easy to useâ because what matters is the âexpected harmâ, which is proportional to the likelihood of enabling a certain harm and to the severity of that harm. (And the total expected harm would be the sum of the expected harms of the various harmful technologies.)
Consequently, the lower is the feasibility of causing harm, the higher its severity has to be such that civilizational devastation is extremely likely. Some examples of âtype-1â vulnerabilities:
âVery easy nukesâ scenario (VEN), where the likelihood and severity are large.
âModerately easy bio-doomâ scenario (MEBD), where the likelihood is smaller than in the VEN, but the severity is larger.
âEasy nukesâ scenario, where the likelihood is between those of the VEN and the MEBD, but sufficiently high to result in a large expected harm.
Type-2a vulnerability (âsafe first strikeâ)
Definition: âThere is some level of technology at which powerful actors have the ability to produce civilization-devastating harms and, in the semi-anarchic default condition, face incentives to use that abilityâ.
âPowerful actorsâ could be, for instance, leaders of powerful countries (e.g. US and China) or influential companies (e.g. Google and Facebook).
Example of âincentives to use that abilityâ:
If both the US and Soviet Union had not been able to ensure second strike capability during the Cold War (a âhard nukesâ scenario), there would have been an incentive for a âsafe first strikeâ.
The âfirst strikerâ would alleviate the fear of becoming the victim of a first strike while surviving relatively unscathed (neglecting nuclear winter).
Type-2b vulnerability (âworse global warmingâ)
Definition: âThere is some level of technology at which, in the semi-anarchic default condition, a great many actors face incentives to take some slightly damaging action such that the combined effect of those actions is civilizational devastationâ.
As in the type-2a vulnerability, actors face incentives to porsue the course of action that leads to damage.
However, for the type-2b vulnerability, the incentices are faced by âa great many actorsâ (e.g. typical citizens of many countries).
The paper describes describes a âworse global warmingâ scenario as an example of type-2b vulnerability. For this scenario, we could imagine that:
The incentives to produce CO2e emissions are roughly as strong as in the âactual global warmingâ scenario, but the transient climate sensitivity (roughly speaking, the medium term temperature change per amount of CO2e emissions) is much higher.
The transient climate sensitivity is the same as in the âactual global warmingâ scenario, but the incentives to produce CO2e emissions are much stronger (much cheaper fossil fuels due to much greater availability).
Type-0 vulnerability (âsurprising strangeletsâ)
Definition: âThere is some technology that carries a hidden risk such that the default outcome when it is discovered is inadvertent civilizational devastationâ.
âInadvertentâ refers to an adverse outcome which sprang from bad luck, not coordination failure.
The paper describes a âsurprising strangeletsâ scenario as an example of type-2b vulnerability:
âSome modern high-energy physics experiment turns out to initiate a self-catalyzing process in which ordinary matter gets converted into strange matter, with the result that our planet is destroyedâ.