RSS

Es­ti­ma­tion of ex­is­ten­tial risk

TagLast edit: 12 Jul 2022 19:28 UTC by Pablo

Estimation of existential risk is the set of methods for assessing the probability of human extinction and other existential catastrophes.

Further reading

Beard, Simon, Thomas Rowe & James Fox (2020) An analysis and evaluation of methods currently used to quantify the likelihood of existential hazards, Futures, vol. 115, pp. 1–14.

Besiroglu, Tamay (2019) Ragnarök Series — results so far, Metaculus, October 15.

Bostrom, Nick (2002) Existential risks: Analyzing human extinction scenarios and related hazards, Journal of evolution and technology, vol. 9.
The section “Assessing the Probability of Existential Risks” discusses methods of existential risk estimation.

Goth, Aidan, Stephen Clare & Christian Ruhl (2022) Professor Philip Tetlock’s research on improving judgments of existential risk, Founders Pledge, March 8.

Karger, Ezra, Pavel D. Atanasov & Philip Tetlock (2022) Improving judgments of existential risk: Better forecasts, questions, explanations, policies, SSRN Electronic Journal.

Muehlhauser, Luke (2019) How feasible is long-range forecasting?, Open Philanthropy, October 10.

Sandberg, A. & Bostrom, N. (2008) Global Catastrophic Risks Survey, Technical Report #2008-1, Future of Humanity Institute, University of Oxford.

Tonn, Bruce & Dorian Stiefel (2013) Evaluating methods for estimating existential risks, Risk Analysis, vol. 33, pp. 1772–1787.

Related entries

AI forecasting | anthropic shadow | existential risk | forecasting | long-range forecasting

Database of ex­is­ten­tial risk estimates

MichaelA15 Apr 2020 12:43 UTC
130 points
37 comments5 min readEA link

Ex­is­ten­tial Risk Model­ling with Con­tin­u­ous-Time Markov Chains

Radical Empath Ismam23 Jan 2023 20:32 UTC
87 points
9 comments12 min readEA link

Sur­vey on AI ex­is­ten­tial risk scenarios

Sam Clarke8 Jun 2021 17:12 UTC
154 points
11 comments6 min readEA link

A toy model for tech­nolog­i­cal ex­is­ten­tial risk

RobertHarling28 Nov 2020 11:55 UTC
10 points
2 comments4 min readEA link

My thoughts on nan­otech­nol­ogy strat­egy re­search as an EA cause area

Ben Snodin2 May 2022 9:41 UTC
136 points
17 comments33 min readEA link

Re­quest for pro­pos­als: Help Open Philan­thropy quan­tify biolog­i­cal risk

djbinder12 May 2022 21:28 UTC
137 points
10 comments6 min readEA link

Quan­tify­ing the prob­a­bil­ity of ex­is­ten­tial catas­tro­phe: A re­ply to Beard et al.

MichaelA10 Aug 2020 5:56 UTC
21 points
3 comments3 min readEA link
(gcrinstitute.org)

“Ex­is­ten­tial risk from AI” sur­vey results

RobBensinger1 Jun 2021 20:19 UTC
80 points
35 comments11 min readEA link

Can a war cause hu­man ex­tinc­tion? Once again, not on priors

Vasco Grilo25 Jan 2024 7:56 UTC
67 points
29 comments18 min readEA link

The Im­por­tance of Un­known Ex­is­ten­tial Risks

MichaelDickens23 Jul 2020 19:09 UTC
72 points
11 comments9 min readEA link

Fore­cast­ing Thread: Ex­is­ten­tial Risk

amandango22 Sep 2020 20:51 UTC
24 points
4 comments2 min readEA link
(www.lesswrong.com)

“Nu­clear risk re­search, fore­cast­ing, & im­pact” [pre­sen­ta­tion]

MichaelA21 Oct 2021 10:54 UTC
20 points
0 comments1 min readEA link
(www.youtube.com)

[Link] “How fea­si­ble is long-range fore­cast­ing?” (Open Phil)

Milan_Griffes11 Oct 2019 21:01 UTC
42 points
7 comments1 min readEA link

Ex­cerpts from “Do­ing EA Bet­ter” on x-risk methodology

BrownHairedEevee26 Jan 2023 1:04 UTC
21 points
5 comments6 min readEA link
(forum.effectivealtruism.org)

Sur­vey on in­ter­me­di­ate goals in AI governance

MichaelA17 Mar 2023 12:44 UTC
155 points
4 comments1 min readEA link

Mis­takes in the moral math­e­mat­ics of ex­is­ten­tial risk (Part 1: In­tro­duc­tion and cu­mu­la­tive risk) - Reflec­tive altruism

BrownHairedEevee3 Jul 2023 6:33 UTC
78 points
6 comments6 min readEA link
(ineffectivealtruismblog.com)

Mis­takes in the moral math­e­mat­ics of ex­is­ten­tial risk (Part 2: Ig­nor­ing back­ground risk) - Reflec­tive altruism

BrownHairedEevee3 Jul 2023 6:34 UTC
87 points
7 comments6 min readEA link
(ineffectivealtruismblog.com)

In­crease in fu­ture po­ten­tial due to miti­gat­ing food shocks caused by abrupt sun­light re­duc­tion scenarios

Vasco Grilo28 Mar 2023 7:43 UTC
12 points
2 comments8 min readEA link

More global warm­ing might be good to miti­gate the food shocks caused by abrupt sun­light re­duc­tion scenarios

Vasco Grilo29 Apr 2023 8:24 UTC
46 points
39 comments13 min readEA link

Fu­ture benefits of miti­gat­ing food shocks caused by abrupt sun­light re­duc­tion scenarios

Vasco Grilo4 Mar 2023 16:22 UTC
20 points
0 comments28 min readEA link

Can a ter­ror­ist at­tack cause hu­man ex­tinc­tion? Not on priors

Vasco Grilo2 Dec 2023 8:20 UTC
42 points
8 comments15 min readEA link

How likely is World War III?

Stephen Clare15 Feb 2022 15:09 UTC
116 points
22 comments16 min readEA link

Re­views of “Is power-seek­ing AI an ex­is­ten­tial risk?”

Joe_Carlsmith16 Dec 2021 20:50 UTC
71 points
4 comments1 min readEA link

[Question] Are there su­perfore­casts for ex­is­ten­tial risk?

Alex HT7 Jul 2020 7:39 UTC
24 points
13 comments1 min readEA link

Some global catas­trophic risk estimates

Tamay10 Feb 2021 19:32 UTC
106 points
15 comments1 min readEA link

Pre­dict re­sponses to the “ex­is­ten­tial risk from AI” survey

RobBensinger28 May 2021 1:38 UTC
36 points
8 comments2 min readEA link

Some thoughts on Toby Ord’s ex­is­ten­tial risk estimates

MichaelA7 Apr 2020 2:19 UTC
67 points
33 comments9 min readEA link

Draft re­port on ex­is­ten­tial risk from power-seek­ing AI

Joe_Carlsmith28 Apr 2021 21:41 UTC
87 points
34 comments1 min readEA link

EAGxVir­tual 2020 light­ning talks

EA Global25 Jan 2021 15:32 UTC
13 points
1 comment33 min readEA link
(www.youtube.com)

Prob­a­bil­ity of ex­tinc­tion for var­i­ous types of catastrophes

Vasco Grilo9 Oct 2022 15:30 UTC
16 points
0 comments10 min readEA link

Illu­sion of truth effect and Am­bi­guity effect: Bias in Eval­u­at­ing AGI X-Risks

Remmelt5 Jan 2023 4:05 UTC
1 point
1 comment1 min readEA link

An­chor­ing fo­cal­ism and the Iden­ti­fi­able vic­tim effect: Bias in Eval­u­at­ing AGI X-Risks

Remmelt7 Jan 2023 9:59 UTC
−2 points
1 comment1 min readEA link

How to re­con­sider a prediction

Noah Scales25 Oct 2022 21:28 UTC
2 points
2 comments4 min readEA link

Cur­rent Es­ti­mates for Like­li­hood of X-Risk?

rhys_lindmark6 Aug 2018 18:05 UTC
24 points
23 comments1 min readEA link

Band­wagon effect: Bias in Eval­u­at­ing AGI X-Risks

Remmelt28 Dec 2022 7:54 UTC
4 points
0 comments1 min readEA link

Nor­malcy bias and Base rate ne­glect: Bias in Eval­u­at­ing AGI X-Risks

Remmelt4 Jan 2023 3:16 UTC
5 points
0 comments1 min readEA link

Mere ex­po­sure effect: Bias in Eval­u­at­ing AGI X-Risks

Remmelt27 Dec 2022 14:05 UTC
4 points
1 comment1 min readEA link