RSS

De­ci­sion theory

TagLast edit: 27 Feb 2023 21:13 UTC by Sylvester Kollin

Decision theory is the study of rational decision-making under conditions of empirical uncertainty.

Decision theory is normative: it provides us with a means of assessing decisions, and guidance on how to make the best decisions. The goal is not necessarily to show how real-life agents actually make decisions, which is explored in behavioral economics and the psychology of decision making.

Suppose that a person has more than one action available to them, that they are uncertain about the state of the world, and that they know that different outcomes will result from their action depending on what the true state of the world is. Even once they have assigned values to each of these outcomes, they will need a function to process those value-assigned outcomes to the actions available to them: one that can rank the actions by how good they are. For example, if they think that they should maximize expected value, then the function will rank all of the actions available to them by the amount of value that each of them is expected to produce.

Further reading

Steele, Katie and H. Orri Stefánsson (2020), Decision Theory, The Stanford Encyclopedia of Philosophy.

Peterson, Martin (2017) An Introduction to Decision Theory, 2nd ed., Cambridge: Cambridge University Press.

Oesterheld, Caspar (2017) A comprehensive list of decision theories, The Universe from an Intentional Stance, June 22.

Related entries

alternatives to expected value theory | altruistic wager | credence | decision theoretic uncertainty | economics | game theory | risk aversion | sequence vs. cluster thinking

On ex­pected util­ity, part 1: Skyscrap­ers and madmen

Joe_Carlsmith16 Mar 2022 21:54 UTC
21 points
1 comment12 min readEA link

‘Con­se­quen­tial­ism’ is be­ing used to mean sev­eral differ­ent things

Theo Hawking11 Jun 2022 15:43 UTC
33 points
10 comments6 min readEA link

There are no co­her­ence theorems

EJT20 Feb 2023 21:52 UTC
104 points
49 comments19 min readEA link

[Question] What rea­son is there NOT to ac­cept Pas­cal’s Wager?

Transient Altruist4 Aug 2022 14:29 UTC
31 points
82 comments1 min readEA link

St. Peters­burg De­mon – a thought ex­per­i­ment that makes me doubt Longter­mism

wuschel23 May 2022 11:49 UTC
48 points
39 comments2 min readEA link

Am­bi­guity aver­sion and re­duc­tion of X-risks: A mod­el­ling situation

Benedikt Schmidt13 Sep 2021 7:16 UTC
29 points
6 comments6 min readEA link

How Re­think Pri­ori­ties is Ad­dress­ing Risk and Uncertainty

Marcus_A_Davis7 Nov 2023 13:42 UTC
89 points
10 comments7 min readEA link

Co­op­er­at­ing with aliens and AGIs: An ECL explainer

Chi24 Feb 2024 22:58 UTC
51 points
9 comments20 min readEA link

How Can Risk Aver­sion Affect Your Cause Pri­ori­ti­za­tion?

Laura Duffy20 Oct 2023 19:46 UTC
112 points
6 comments16 min readEA link
(docs.google.com)

Dis­cussing how to al­ign Trans­for­ma­tive AI if it’s de­vel­oped very soon

elifland28 Nov 2022 16:17 UTC
36 points
0 comments1 min readEA link

Per­son-af­fect­ing in­tu­itions can of­ten be money pumped

Rohin Shah7 Jul 2022 12:23 UTC
92 points
69 comments3 min readEA link

Chris­tian Tarsney on fu­ture bias and a pos­si­ble solu­tion to moral fanaticism

Pablo6 May 2021 10:39 UTC
26 points
6 comments1 min readEA link
(80000hours.org)

Ter­mi­nate de­liber­a­tion based on re­silience, not certainty

Gregory Lewis5 Jun 2022 20:08 UTC
142 points
15 comments10 min readEA link

Self-Similar­ity Experiment

Dawn Drescher5 Sep 2020 17:04 UTC
10 points
0 comments10 min readEA link
(impartial-priorities.org)

Thoughts on the Trans­par­ent New­comb’s Problem

Dawn Drescher15 Apr 2022 21:05 UTC
12 points
0 comments8 min readEA link
(impartial-priorities.org)

[Link] EAF Re­search agenda: “Co­op­er­a­tion, Con­flict, and Trans­for­ma­tive Ar­tifi­cial In­tel­li­gence”

stefan.torges17 Jan 2020 13:28 UTC
64 points
0 comments1 min readEA link

Rea­sons and Per­sons: Watch the­o­ries eat themselves

Aaron Gertler25 Dec 2021 3:53 UTC
63 points
7 comments15 min readEA link
(dynomight.net)

Puz­zles for Everyone

Richard Y Chappell10 Sep 2022 2:11 UTC
116 points
38 comments5 min readEA link
(rychappell.substack.com)

The Least Con­tro­ver­sial Ap­pli­ca­tion of Geo­met­ric Rationality

Scott Garrabrant25 Nov 2022 16:50 UTC
16 points
0 comments1 min readEA link

On ex­pected util­ity, part 3: VNM, sep­a­ra­bil­ity, and more

Joe_Carlsmith22 Mar 2022 3:05 UTC
8 points
0 comments27 min readEA link

Against the nor­ma­tive re­al­ist’s wager

Joe_Carlsmith13 Oct 2022 16:36 UTC
27 points
5 comments23 min readEA link

Can you con­trol the past?

Joe_Carlsmith27 Aug 2021 19:34 UTC
46 points
21 comments47 min readEA link

Chris­tian Tarsney on fu­ture bias and a pos­si­ble solu­tion to moral fanaticism

80000_Hours5 May 2021 19:38 UTC
7 points
0 comments114 min readEA link

The Harsanyi-Rawls de­bate: poli­ti­cal philos­o­phy as de­ci­sion the­ory un­der uncertainty

Ramiro1 Aug 2021 14:04 UTC
19 points
3 comments5 min readEA link

Lay­man’s Sum­mary of Re­solv­ing Pas­cal­lian De­ci­sion Prob­lems with Stochas­tic Dominance

Ben_West12 Mar 2021 3:51 UTC
44 points
11 comments5 min readEA link

2020 PhilPapers Sur­vey Results

RobBensinger2 Nov 2021 5:06 UTC
40 points
0 comments12 min readEA link

Slightly ad­vanced de­ci­sion the­ory 102: Four rea­sons not to be a (naive) util­ity maximizer

kirchner.jan23 Nov 2021 10:47 UTC
16 points
5 comments14 min readEA link
(universalprior.substack.com)

Sum­mary of Ev­i­dence, De­ci­sion, and Causality

Dawn Drescher5 Sep 2020 20:23 UTC
27 points
0 comments43 min readEA link
(impartial-priorities.org)

Ideal gov­er­nance (for com­pa­nies, coun­tries and more)

Holden Karnofsky7 Apr 2022 16:54 UTC
80 points
19 comments14 min readEA link

Geo­met­ric Ra­tion­al­ity is Not VNM Rational

Scott Garrabrant27 Nov 2022 19:36 UTC
44 points
0 comments1 min readEA link

Don’t Over-Op­ti­mize Things

Owen Cotton-Barratt16 Jun 2022 16:28 UTC
53 points
7 comments4 min readEA link

Philo­soph­i­cal con­sid­er­a­tions rele­vant to valu­ing con­tinued hu­man sur­vival: Con­cep­tual Anal­y­sis, Pop­u­la­tion Ax­iol­ogy, and De­ci­sion The­ory (An­dreas Mo­gensen)

Global Priorities Institute1 Nov 2023 12:10 UTC
40 points
0 comments3 min readEA link

Ar­gu­ments for util­i­tar­i­anism are im­pos­si­bil­ity ar­gu­ments un­der un­bounded prospects

MichaelStJules7 Oct 2023 21:09 UTC
39 points
48 comments1 min readEA link

How LDT helps re­duce the AI arms race

Tamsin Leake10 Dec 2023 16:21 UTC
8 points
1 comment1 min readEA link
(carado.moe)

Weight by Impact

vaniver21 May 2023 14:37 UTC
7 points
0 comments1 min readEA link

Everett branches, in­ter-light cone trade and other alien mat­ters: Ap­pendix to “An ECL ex­plainer”

Chi24 Feb 2024 23:09 UTC
25 points
1 comment11 min readEA link

Ev­i­den­tial Co­op­er­a­tion in Large Wor­lds: Po­ten­tial Ob­jec­tions & FAQ

Chi28 Feb 2024 18:58 UTC
33 points
5 comments19 min readEA link

Fair Col­lec­tive Effec­tive Altruism

Jobst Heitzig (vodle.it)28 Nov 2022 13:35 UTC
6 points
1 comment5 min readEA link
(www.lesswrong.com)

An­nounc­ing vo­dle, a web app for con­sen­sus-aiming col­lec­tive decisions

Jobst Heitzig (vodle.it)31 Oct 2022 0:37 UTC
24 points
8 comments1 min readEA link

The Benev­olent Ruler’s Hand­book (Part 1): The Policy Problem

FCCC12 Aug 2023 14:24 UTC
5 points
0 comments4 min readEA link

Utility Func­tions and Their Proxies

Max Reddel30 May 2023 6:03 UTC
7 points
0 comments11 min readEA link

Tyranny of the Epistemic Majority

Scott Garrabrant22 Nov 2022 17:19 UTC
46 points
2 comments1 min readEA link

Tough enough? Ro­bust satis­fic­ing as a de­ci­sion norm for long-term policy analysis

Global Priorities Institute31 Oct 2020 13:28 UTC
5 points
0 comments3 min readEA link
(globalprioritiesinstitute.org)

How to Avoid Cal­ifor­nia Re­call Disasters (SF Chron­i­cle Op-Ed)

Mahendra Prasad17 Sep 2021 5:01 UTC
3 points
0 comments2 min readEA link

Im­pli­ca­tions of ev­i­den­tial co­op­er­a­tion in large worlds

Lukas Finnveden23 Aug 2023 0:43 UTC
79 points
1 comment1 min readEA link
(lukasfinnveden.substack.com)

A bar­gain­ing-the­o­retic ap­proach to moral uncertainty

Global Priorities Institute8 Aug 2019 13:41 UTC
3 points
0 comments3 min readEA link
(globalprioritiesinstitute.org)

Avert­ing Catas­tro­phe: De­ci­sion The­ory for COVID-19, Cli­mate Change, and Po­ten­tial Disasters of All Kinds

JakubK2 May 2023 22:50 UTC
15 points
0 comments1 min readEA link
(nyupress.org)

Should AI fo­cus on prob­lem-solv­ing or strate­gic plan­ning? Why not both?

oliver_siegel1 Nov 2022 9:53 UTC
1 point
0 comments1 min readEA link

Mul­ti­verse-wide co­op­er­a­tion in a nutshell

Lukas_Gloor2 Nov 2017 10:17 UTC
83 points
10 comments16 min readEA link

Sum­mary: In Defence of Fa­nat­i­cism (Hay­den Wilk­in­son)

Nicholas Kruus15 Jan 2024 14:21 UTC
26 points
2 comments6 min readEA link

Should we Max­i­mize the Geo­met­ric Ex­pec­ta­tion?

A.H.19 Apr 2024 20:06 UTC
11 points
6 comments9 min readEA link

Craft­ing Our Mis­sion State­ment: Weighted Fac­tor Models, Shal­low Re­search, and Les­sons Learned for Clar­ity and Impact

Harry Luk13 Oct 2023 16:43 UTC
8 points
4 comments6 min readEA link

A New Bayesian De­ci­sion Theory

ParetoOptimal20 Sep 2023 9:38 UTC
0 points
2 comments1 min readEA link
(paretooptimal.substack.com)

The Benev­olent Ruler’s Hand­book (Part 2): Mo­ral­ity Rules

FCCC12 Aug 2023 14:25 UTC
3 points
0 comments4 min readEA link

Puz­zles for Some

Violet Hour3 Feb 2023 12:23 UTC
20 points
4 comments7 min readEA link

Th­e­sis Sum­mary and Open Ques­tions: Nor­ma­tive Uncer­tainty and In­for­ma­tion Value

rileyharris27 Apr 2022 8:46 UTC
31 points
0 comments3 min readEA link

Acausal normalcy

Andrew Critch3 Mar 2023 23:35 UTC
21 points
4 comments8 min readEA link

[Question] De­ci­sion mak­ing un­der model am­bi­guity, moral un­cer­tainty, and other agents with free will?

Jobst Heitzig (vodle.it)2 Nov 2022 12:52 UTC
16 points
1 comment8 min readEA link

[Question] What should my re­search lab fo­cus on in the first week of 2023?

Jobst Heitzig (vodle.it)4 Nov 2022 10:16 UTC
3 points
0 comments1 min readEA link

Fun­da­men­tals of Fatal Risks

Aino29 Jul 2023 7:12 UTC
1 point
0 comments4 min readEA link

De­ci­sion The­ory: A (Nor­ma­tive) Introduction

ParetoOptimal6 Sep 2023 11:46 UTC
0 points
3 comments3 min readEA link
(paretooptimal.substack.com)

Bayesian Mindset

Holden Karnofsky21 Dec 2021 19:54 UTC
73 points
19 comments25 min readEA link

LW4EA: Value of In­for­ma­tion: Four Examples

Jeremy14 Jun 2022 2:26 UTC
5 points
0 comments1 min readEA link
(www.lesswrong.com)

Ex­ceed­ing Ex­pec­ta­tions: Stochas­tic Dom­i­nance as a Gen­eral De­ci­sion Theory

Global Priorities Institute1 Aug 2020 13:34 UTC
3 points
0 comments5 min readEA link
(globalprioritiesinstitute.org)

OpenPrin­ci­ples Boot­camp, Reflect & Act on Your EA & Life Prin­ci­ples (Free)

Ti Guo16 Sep 2022 2:23 UTC
0 points
3 comments4 min readEA link

Is Our Uni­verse A New­comb’s Para­dox Si­mu­la­tion?

Jordan Arel15 May 2022 7:28 UTC
16 points
8 comments2 min readEA link

Courses and col­lab­o­ra­tive books on Effec­tive Altru­ism with So­cial-Psy­chol­ogy & Judg­ment and De­ci­sion-Mak­ing [Feed­back ap­pre­ci­ated]

Gilad Feldman11 Oct 2022 3:56 UTC
24 points
6 comments2 min readEA link

Punch­ing Utili­tar­i­ans in the Face

AppliedDivinityStudies13 Jul 2022 18:43 UTC
62 points
29 comments5 min readEA link

Re­spect­ing your Lo­cal Preferences

Scott Garrabrant26 Nov 2022 19:04 UTC
23 points
0 comments1 min readEA link

Solu­tions to prob­lems with Bayesianism

Bob Jacobs4 Nov 2023 12:15 UTC
27 points
2 comments21 min readEA link

Sum­mary: Against Anti-Fa­nat­i­cism (Chris­tian Tarsney)

Nicholas Kruus25 Jan 2024 15:04 UTC
25 points
1 comment3 min readEA link

Lo­cal Memes Against Geo­met­ric Rationality

Scott Garrabrant21 Dec 2022 3:53 UTC
18 points
0 comments1 min readEA link

My notes on: Se­quence think­ing vs. cluster thinking

Vasco Grilo25 May 2022 15:03 UTC
24 points
0 comments5 min readEA link

Gaia Net­work: An Illus­trated Primer

Roman Leventov26 Jan 2024 11:55 UTC
2 points
4 comments15 min readEA link

Storable Votes with a Pay as you win mechanism: a con­tri­bu­tion for in­sti­tu­tional design

Arturo Macias11 Mar 2024 15:52 UTC
6 points
3 comments2 min readEA link

New­comb’s Para­dox Explained

Alex Vellins31 Mar 2023 21:26 UTC
2 points
11 comments2 min readEA link

On ex­pected util­ity, part 4: Dutch books, Cox, and Com­plete Class

Joe_Carlsmith24 Mar 2022 7:49 UTC
7 points
0 comments19 min readEA link

Heuris­tics for clue­less agents: how to get away with ig­nor­ing what mat­ters most in or­di­nary de­ci­sion-making

Global Priorities Institute31 May 2020 13:35 UTC
4 points
0 comments3 min readEA link
(globalprioritiesinstitute.org)

Un­cor­re­lated Bets: an easy to un­der­stand and very im­por­tant de­ci­sion the­ory con­sid­er­a­tion, which helps tease out nonob­vi­ous but pro­duc­tive crit­i­cism of the EA movement

Uncorrelated Returns12 Aug 2022 9:04 UTC
22 points
8 comments3 min readEA link

Notes on “Can you con­trol the past”

So8res20 Oct 2022 3:41 UTC
15 points
0 comments1 min readEA link

Multi-Fac­tor De­ci­sion Mak­ing Math

Elliot Temple30 Oct 2022 16:46 UTC
1 point
13 comments37 min readEA link
(criticalfallibilism.com)

De­ci­sion the­ory does not im­ply that we get to have nice things

So8res18 Oct 2022 3:04 UTC
36 points
0 comments1 min readEA link

On ex­pected util­ity, part 2: Why it can be OK to pre­dictably lose

Joe_Carlsmith18 Mar 2022 8:28 UTC
7 points
2 comments16 min readEA link

LW4EA: Beyond Astro­nom­i­cal Waste

Jeremy10 May 2022 14:50 UTC
9 points
2 comments1 min readEA link
(www.lesswrong.com)

[Question] Should we pub­lish ar­gu­ments for the preser­va­tion of hu­man­ity?

Jeremy7 Apr 2023 13:51 UTC
8 points
4 comments1 min readEA link
No comments.