Archive About Log In Home All Wiki Shortform
Existential risk An existential risk is a risk that threatens the destruction of the long-term potential of life. An existential risk could threaten the extinction of humans (and other sentient beings), or it could threaten some other unrecoverable collapse or permanent failure to achieve a potential good state. Natural risks such as those posed by asteroids or supervolcanoes could be existential risks, as could anthropogenic (human-caused) risks like accidents from synthetic biology or unaligned artificial intelligence .
Estimating the probability of existential risk from different factors is difficult, but there are some estimates.
Some view reducing existential risks as a key moral priority, for a variety of reasons. Some people simply view the current estimates of existential risk as unacceptably high. Other authors argue that existential risks are especially important because the long-run future of humanity matters a great deal. Many believe that there is no intrinsic moral difference between the importance of a life today and one in a hundred years. However, there may be many more people in the future than there are now. Given these assumptions, existential risks threaten not only the beings alive right now, but also the enormous number of lives yet to be lived. One objection to this argument is that people have a special responsibility to other people currently alive that they do not have to people who have not yet been born. Another objection is that, although it would in principle be important to manage, the risks are currently so unlikely and poorly understood that existential risk reduction is less cost-effective than work on other promising areas.
In The Precipice: Existential Risk and the Future of Humanity , Toby Ord offers several policy and research recommendations for handling existential risks:
Explore options for new international institutions aimed at reducing existential risk, both incremental and revolutionary.
Investigate possibilities for making the deliberate or reckless imposition of human extinction risk an international crime.
Investigate possibilities for bringing the representation of future generations into national and international democratic institutions.
Each major world power should have an appointed senior government position responsible for registering and responding to existential risks that can be realistically foreseen in the next 20 years.
Find the major existential risk factors and security factors—both in terms of absolute size and in the cost-effectiveness of marginal changes.
Target efforts at reducing the likelihood of military conflicts between the US, Russia and China .
Improve horizon-scanning for unforeseen and emerging risks.
Investigate food substitutes in case of extreme and lasting reduction in the world’s ability to supply food.
Develop better theoretical and practical tools for assessing risks with extremely high stakes that are either unprecedented or thought to have extremely low probability.
Improve our understanding of the chance civilization will recover after a global collapse , what might prevent this, and how to improve the odds.
Develop our thinking about grand strategy for humanity.
Develop our understanding of the ethics of existential risk and valuing the longterm future .
Further reading Bostrom, Nick (2002) Existential risks: analyzing human extinction scenarios and related hazards , Journal of Evolution and Technology , vol. 9.A paper surveying a wide range of non-extinction existential risks.
Bostrom, Nick (2013) Existential risk prevention as global priority , Global Policy , vol. 4, pp. 15–31.
Matheny, Jason Gaverick (2007) Reducing the risk of human extinction , Risk Analysis , vol. 27, pp. 1335–1344.A paper exploring the cost-effectiveness of extinction risk reduction.
Ord, Toby (2020) The Precipice: Existential Risk and the Future of Humanity , London: Bloomsbury Publishing.
Ord, Toby (2020) Existential risks to humanity in Pedro Conceição (ed.) The 2020 Human Development Report: The Next Frontier: Human Development and the Anthropocene , New York: United Nations Development Programme, pp. 106–111.
Sánchez, Sebastián (2022) Timeline of existential risk , Timelines Wiki .
Related entries civilizational collapse | criticism of longtermism and existential risk studies | dystopia | estimation of existential risks | ethics of existential risk | existential catastrophe | existential risk factor | existential security | global catastrophic risk | hinge of history | longtermism | Toby Ord | rationality community | Russell–Einstein Manifesto | s-risk
Relevant New Old BrianK 11 Apr 2024 12:58 UTC 10 points
1 min read EA link (www.fastcompany.com)
FJehn 9 Apr 2024 8:05 UTC 23 points
10 min read EA link (existentialcrunch.substack.com)
FJehn 4 Mar 2024 7:57 UTC 31 points
7 min read EA link (existentialcrunch.substack.com)
EJT 28 Feb 2024 14:30 UTC 9 points
1 min read EA link (philpapers.org)
slg 26 Feb 2024 23:14 UTC 19 points
26 min read EA link (naobservatory.org)
tobyj 16 Feb 2024 15:04 UTC 152 points
9 min read EA link (seekingtobejolly.substack.com)
FJehn 8 Feb 2024 9:49 UTC 13 points
10 min read EA link (existentialcrunch.substack.com)
mic 2 Feb 2024 18:22 UTC 26 points
22 min read EA link (papers.ssrn.com)
M 31 Jan 2024 7:40 UTC 5 points
1 min read EA link eukaryote 7 Jan 2024 23:59 UTC 67 points
32 min read EA link (eukaryotewritesblog.com)
Buhl 18 Dec 2023 18:31 UTC 35 points
5 min read EA link (rethinkpriorities.org)
FJehn 15 Nov 2023 12:53 UTC 11 points
10 min read EA link (existentialcrunch.substack.com)
Jolyn Khoo 31 Oct 2023 5:46 UTC 14 points
2 min read EA link (www.campaignforaisafety.org)
EJT 16 Oct 2023 16:34 UTC 27 points
4 min read EA link (openairopensea.substack.com)
Calum 15 Oct 2023 14:18 UTC 36 points
1 min read EA link (www.politico.com)
FJehn 5 Oct 2023 6:19 UTC 14 points
6 min read EA link (existentialcrunch.substack.com)
Jolyn Khoo 27 Sep 2023 2:44 UTC 16 points
2 min read EA link (www.campaignforaisafety.org)
jackva 26 Sep 2023 19:16 UTC 32 points
1 min read EA link (www.prospectmagazine.co.uk)
jackva 26 Sep 2023 19:16 UTC 32 points
1 min read EA link (www.prospectmagazine.co.uk)
Nikola 17 Sep 2023 21:51 UTC 39 points
3 min read EA link (www.lesswrong.com)
alexherwix 14 Sep 2023 14:43 UTC −14 points
1 min read EA link (perspecteeva.substack.com)
Sam Bogerd 13 Sep 2023 13:27 UTC 25 points
3 min read EA link (state-of-the-union.ec.europa.eu)
brook 25 Aug 2023 13:42 UTC 16 points
5 min read EA link (www.lesswrong.com)
Oldphan 23 Aug 2023 22:23 UTC 10 points
1 min read EA link (www.cambridge.org)
FJehn 12 Aug 2023 8:57 UTC 34 points
4 min read EA link (existentialcrunch.substack.com)
FJehn 10 Aug 2023 9:54 UTC 4 points
7 min read EA link (existentialcrunch.substack.com)
Austin 4 Aug 2023 16:00 UTC 65 points
5 min read EA link (manifund.substack.com)
Austin 4 Aug 2023 16:00 UTC 65 points
5 min read EA link (manifund.substack.com)
Toby_Ord 18 Jul 2023 10:09 UTC 178 points
2 min read EA link (files.tobyord.com)
Toby_Ord 18 Jul 2023 10:09 UTC 178 points
2 min read EA link (files.tobyord.com)
JMonty 18 Jul 2023 1:47 UTC 19 points
1 min read EA link (www.nytimes.com)
JMonty 18 Jul 2023 1:47 UTC 19 points
1 min read EA link (www.nytimes.com)
Austin 15 Jul 2023 0:28 UTC 43 points
3 min read EA link (manifund.substack.com)
Austin 15 Jul 2023 0:28 UTC 43 points
3 min read EA link (manifund.substack.com)
Austin 5 Jul 2023 19:42 UTC 217 points
4 min read EA link (manifund.org)
Austin 5 Jul 2023 19:42 UTC 217 points
4 min read EA link (manifund.org)
Amber Dawn 30 Jun 2023 13:48 UTC 92 points
8 min read EA link (contemplatonist.substack.com)
Amber Dawn 30 Jun 2023 13:48 UTC 92 points
8 min read EA link (contemplatonist.substack.com)
Buhl 21 Jun 2023 15:54 UTC 132 points
20 min read EA link (rethinkpriorities.org)
FJehn 19 Jun 2023 8:57 UTC 24 points
8 min read EA link (existentialcrunch.substack.com)
Jolyn Khoo 16 Jun 2023 9:45 UTC 15 points
2 min read EA link (www.campaignforaisafety.org)
Guillem Bas 8 Jun 2023 22:09 UTC 36 points
6 min read EA link (riesgoscatastroficosglobales.com)
Aron 7 Jun 2023 19:05 UTC 26 points
6 min read EA link (coordinationishard.substack.com)
FJehn 7 Jun 2023 12:10 UTC 17 points
11 min read EA link (existentialcrunch.substack.com)
SWK 22 May 2023 11:01 UTC 37 points
1 min read EA link Lenny 19 May 2023 10:10 UTC 22 points
1 min read EA link (www.japantimes.co.jp)
jai 4 May 2023 16:19 UTC 31 points
1 min read EA link (laneless.substack.com)
JakubK 2 May 2023 22:50 UTC 15 points
1 min read EA link (nyupress.org)
DM 1 May 2023 19:54 UTC 43 points
3 min read EA link (www.nytimes.com)
Austin 30 Apr 2023 4:35 UTC 39 points
2 min read EA link (survivalandflourishing.fund)
Guillem Bas 27 Apr 2023 10:33 UTC 55 points
11 min read EA link (riesgoscatastroficosglobales.com)
rime 25 Apr 2023 19:39 UTC 29 points
2 min read EA link (www.lesswrong.com)
Oliver Z 25 Apr 2023 16:15 UTC 35 points
4 min read EA link (newsletter.safe.ai)
JMonty 22 Apr 2023 14:29 UTC 13 points
3 min read EA link (wwwnc.cdc.gov)
Oliver Z 18 Apr 2023 18:36 UTC 56 points
4 min read EA link (newsletter.safe.ai)
oeg 14 Apr 2023 17:41 UTC 104 points
22 min read EA link oeg 14 Apr 2023 17:40 UTC 53 points
9 min read EA link JonCefalu 8 Apr 2023 13:36 UTC −4 points
1 min read EA link (jesus-the-antichrist.com)
Austin 31 Mar 2023 15:32 UTC 32 points
2 min read EA link (manifund.org)
Austin 31 Mar 2023 15:32 UTC 32 points
2 min read EA link (manifund.org)
EJT 19 Mar 2023 16:50 UTC 258 points
35 min read EA link (philpapers.org)
Eli Rose 13 Mar 2023 2:26 UTC 51 points
1 min read EA link (geosci.uchicago.edu)
Eli Rose 13 Mar 2023 2:26 UTC 51 points
1 min read EA link (geosci.uchicago.edu)
Otto 8 Mar 2023 15:33 UTC 49 points
4 min read EA link (time.com)
finm 25 Feb 2023 22:22 UTC 67 points
24 min read EA link (finmoorhouse.com)
ELN 10 Feb 2023 10:48 UTC 22 points
4 min read EA link Yadav 9 Dec 2022 16:58 UTC 13 points
1 min read EA link (youtu.be)
Yadav 9 Dec 2022 16:58 UTC 13 points
1 min read EA link (youtu.be)
Jeremy 21 Nov 2022 17:47 UTC 15 points
1 min read EA link (scottaaronson.blog)
Jeremy 21 Nov 2022 17:47 UTC 15 points
1 min read EA link (scottaaronson.blog)
pseudonym 17 Nov 2022 21:04 UTC 33 points
4 min read EA link (www.businessinsider.com)
Jeremy 15 Nov 2022 16:23 UTC 177 points
1 min read EA link (dam.gcsp.ch)
sphor 7 Oct 2022 12:26 UTC 13 points
3 min read EA link (bostonreview.net)
sphor 7 Oct 2022 12:26 UTC 13 points
3 min read EA link (bostonreview.net)
Jeff A 30 Sep 2022 2:57 UTC 6 points
1 min read EA link (www.carnegiecouncil.org)
Lizka 25 Sep 2022 23:14 UTC 72 points
2 min read EA link (www.lesswrong.com)
Linch 15 Sep 2022 21:20 UTC 64 points
4 min read EA link (danluu.com)
BrianK 6 Sep 2022 22:38 UTC 47 points
1 min read EA link (www.forbes.com)
HTC 30 Aug 2022 4:27 UTC 30 points
17 min read EA link HTC 30 Aug 2022 4:27 UTC 30 points
17 min read EA link GideonF 20 Aug 2022 12:22 UTC 10 points
1 min read EA link (open.spotify.com)
GideonF 20 Aug 2022 12:22 UTC 10 points
1 min read EA link (open.spotify.com)
mikbp 16 Aug 2022 20:00 UTC 24 points
1 min read EA link (nonzero.substack.com)
Tyner 15 Aug 2022 20:55 UTC 15 points
1 min read EA link (www.nature.com)
elifland 14 Aug 2022 0:55 UTC 182 points
6 min read EA link (www.foxy-scout.com)
MMMaas 10 Aug 2022 11:00 UTC 90 points
9 min read EA link (verfassungsblog.de)
cwa 26 Jul 2022 15:15 UTC 144 points
11 min read EA link Linch 23 Jul 2022 21:38 UTC 69 points
12 min read EA link (biodefensecommission.org)
Jacy 30 Jun 2022 13:01 UTC 140 points
32 min read EA link (www.sentienceinstitute.org)
Lizka 28 Jun 2022 20:16 UTC 150 points
1 min read EA link (www.youtube.com)
Ty 5 May 2022 5:57 UTC 12 points
2 min read EA link Ty 5 May 2022 5:57 UTC 12 points
2 min read EA link skluug 8 Mar 2022 19:17 UTC 188 points
10 min read EA link (skluug.substack.com)
Fin 8 Mar 2022 17:04 UTC 103 points
11 min read EA link Fai 4 Mar 2022 19:59 UTC 125 points
16 min read EA link Gus Docker 22 Feb 2022 15:04 UTC 22 points
46 min read EA link (www.utilitarianpodcast.com)
finm 11 Feb 2022 21:01 UTC 44 points
5 min read EA link (www.finmoorhouse.com)
Chi 1 Feb 2022 22:24 UTC 62 points
10 min read EA link Chi 1 Feb 2022 22:24 UTC 62 points
10 min read EA link DM 30 Jan 2022 22:51 UTC 29 points
18 min read EA link ASB 16 Dec 2021 21:40 UTC 87 points
3 min read EA link ab 13 Dec 2021 13:36 UTC 249 points
28 min read EA link Ali 26 Nov 2021 14:40 UTC 66 points
6 min read EA link (www.sentienceinstitute.org)
Gus Docker 21 Nov 2021 15:29 UTC 26 points
1 min read EA link (www.utilitarianpodcast.com)
Linch 18 Nov 2021 21:40 UTC 63 points
1 min read EA link (www.youtube.com)
b_sen 30 Oct 2021 2:37 UTC 2 points
5 min read EA link (archiveofourown.org)
GAA 4 Oct 2021 18:21 UTC 32 points
24 min read EA link GAA 4 Oct 2021 18:21 UTC 32 points
24 min read EA link L Rudolf L 18 Aug 2021 22:15 UTC 21 points
16 min read EA link (strataoftheworld.blogspot.com)
L Rudolf L 18 Aug 2021 22:15 UTC 21 points
16 min read EA link (strataoftheworld.blogspot.com)
Pablo 2 Jul 2021 13:17 UTC 41 points
2 min read EA link (www.vox.com)
james 29 Jun 2021 9:59 UTC 91 points
5 min read EA link (docs.google.com)
james 10 Jun 2021 21:21 UTC 10 points
8 min read EA link (www.nickbostrom.com)
james 10 Jun 2021 21:21 UTC 10 points
8 min read EA link (www.nickbostrom.com)
MichaelA 4 Apr 2021 3:09 UTC 79 points
1 min read EA link (globalprioritiesinstitute.org)
eca 28 Mar 2021 19:56 UTC 113 points
11 min read EA link Gavin 23 Mar 2021 13:18 UTC 31 points
8 min read EA link (www.gleech.org)
finm 22 Mar 2021 11:07 UTC 26 points
1 min read EA link (hearthisidea.com)
finm 22 Mar 2021 11:07 UTC 26 points
1 min read EA link (hearthisidea.com)
jtm 5 Mar 2021 22:57 UTC 110 points
8 min read EA link jtm 5 Mar 2021 22:57 UTC 110 points
8 min read EA link finm 28 Jan 2021 19:47 UTC 11 points
1 min read EA link (hearthisidea.com)
finm 28 Jan 2021 19:47 UTC 11 points
1 min read EA link (hearthisidea.com)
DC 29 Nov 2020 0:26 UTC 22 points
2 min read EA link MichaelA 25 Aug 2020 9:53 UTC 29 points
2 min read EA link (www.openphilanthropy.org)
Ben 23 Jul 2020 19:02 UTC 10 points
3 min read EA link Ben 23 Jul 2020 19:02 UTC 10 points
3 min read EA link KR 22 Jul 2020 19:07 UTC 21 points
3 min read EA link evhub 1 Jul 2020 20:59 UTC 13 points
1 min read EA link (futureoflife.org)
Dale 23 Apr 2020 1:25 UTC 28 points
3 min read EA link (acoup.blog)
Ben 14 Jan 2020 22:13 UTC 40 points
14 min read EA link Ben 14 Jan 2020 22:13 UTC 40 points
14 min read EA link Pablo 5 Nov 2019 20:24 UTC 43 points
1 min read EA link (globalprioritiesinstitute.org)
Fin 17 Sep 2019 2:41 UTC 87 points
18 min read EA link Ben 17 Apr 2019 6:50 UTC 149 points
15 min read EA link ozymandias 14 Jan 2019 19:29 UTC 27 points
2 min read EA link (thingofthings.wordpress.com)
ozymandias 14 Jan 2019 19:29 UTC 27 points
2 min read EA link (thingofthings.wordpress.com)
Wei Dai 27 Dec 2018 9:27 UTC 25 points
1 min read EA link (www.lesswrong.com)
Wei Dai 27 Dec 2018 9:27 UTC 25 points
1 min read EA link (www.lesswrong.com)
Jacy 20 Feb 2018 18:29 UTC 106 points
36 min read EA link (www.sentienceinstitute.org)
Pablo 17 Mar 2017 6:48 UTC 30 points
24 min read EA link (www.stafforini.com)
Babel 8 Jul 2009 12:42 UTC 12 points
1 min read EA link (longtermrisk.org)
Babel 8 Jul 2009 12:42 UTC 12 points
1 min read EA link (longtermrisk.org)