RSS

De­ci­sion theory

TagLast edit: Feb 27, 2023, 9:13 PM by Sylvester Kollin

Decision theory is the study of rational decision-making under conditions of empirical uncertainty.

Decision theory is normative: it provides us with a means of assessing decisions, and guidance on how to make the best decisions. The goal is not necessarily to show how real-life agents actually make decisions, which is explored in behavioral economics and the psychology of decision making.

Suppose that a person has more than one action available to them, that they are uncertain about the state of the world, and that they know that different outcomes will result from their action depending on what the true state of the world is. Even once they have assigned values to each of these outcomes, they will need a function to process those value-assigned outcomes to the actions available to them: one that can rank the actions by how good they are. For example, if they think that they should maximize expected value, then the function will rank all of the actions available to them by the amount of value that each of them is expected to produce.

Further reading

Steele, Katie and H. Orri Stefánsson (2020), Decision Theory, The Stanford Encyclopedia of Philosophy.

Peterson, Martin (2017) An Introduction to Decision Theory, 2nd ed., Cambridge: Cambridge University Press.

Oesterheld, Caspar (2017) A comprehensive list of decision theories, The Universe from an Intentional Stance, June 22.

Related entries

alternatives to expected value theory | altruistic wager | credence | decision theoretic uncertainty | economics | game theory | risk aversion | sequence vs. cluster thinking

Win­ning isn’t enough

Anthony DiGiovanniNov 5, 2024, 11:43 AM
31 points
3 comments1 min readEA link

On ex­pected util­ity, part 1: Skyscrap­ers and madmen

Joe_CarlsmithMar 16, 2022, 9:54 PM
22 points
1 comment12 min readEA link

There are no co­her­ence theorems

EJTFeb 20, 2023, 9:52 PM
107 points
49 comments19 min readEA link

Bet­ter differ­ence-mak­ing views

MichaelStJulesDec 21, 2024, 6:27 PM
31 points
0 comments14 min readEA link

‘Con­se­quen­tial­ism’ is be­ing used to mean sev­eral differ­ent things

Theo HawkingJun 11, 2022, 3:43 PM
33 points
10 comments6 min readEA link

Good Judg­ment with Numbers

Richard Y Chappell🔸Sep 23, 2024, 3:10 PM
62 points
12 comments6 min readEA link
(www.goodthoughts.blog)

[Question] What rea­son is there NOT to ac­cept Pas­cal’s Wager?

Transient AltruistAug 4, 2022, 2:29 PM
31 points
82 comments1 min readEA link

Re­fus­ing to Quan­tify is Re­fus­ing to Think (about trade-offs)

Richard Y Chappell🔸Nov 18, 2024, 6:03 PM
59 points
9 comments5 min readEA link
(www.goodthoughts.blog)

St. Peters­burg De­mon – a thought ex­per­i­ment that makes me doubt Longter­mism

wuschelMay 23, 2022, 11:49 AM
48 points
39 comments2 min readEA link

How Can Risk Aver­sion Affect Your Cause Pri­ori­ti­za­tion?

Laura DuffyOct 20, 2023, 7:46 PM
116 points
6 comments16 min readEA link
(docs.google.com)

How Re­think Pri­ori­ties is Ad­dress­ing Risk and Uncertainty

Marcus_A_DavisNov 7, 2023, 1:42 PM
89 points
10 comments7 min readEA link

Am­bi­guity aver­sion and re­duc­tion of X-risks: A mod­el­ling situation

Benedikt SchmidtSep 13, 2021, 7:16 AM
29 points
6 comments5 min readEA link

Co­op­er­at­ing with aliens and AGIs: An ECL explainer

ChiFeb 24, 2024, 10:58 PM
54 points
9 comments20 min readEA link

An In­tro­duc­tion to the CRAFT Sequence

Bob FischerJul 8, 2024, 10:27 AM
103 points
1 comment4 min readEA link

Aspira­tion-based, non-max­i­miz­ing AI agent designs

Bob JacobsMay 7, 2024, 4:13 PM
12 points
1 comment38 min readEA link

An Epistemic Defense of Round­ing Down

Hayley ClatterbuckJul 15, 2024, 2:51 PM
49 points
7 comments27 min readEA link

Differ­ence-Mak­ing Risk Aver­sion: An Exploration

Hayley ClatterbuckJul 12, 2024, 3:00 PM
22 points
7 comments17 min readEA link

Geo­met­ric Ra­tion­al­ity is Not VNM Rational

Scott GarrabrantNov 27, 2022, 7:36 PM
44 points
0 comments1 min readEA link

Don’t Over-Op­ti­mize Things

Owen Cotton-BarrattJun 16, 2022, 4:28 PM
55 points
7 comments4 min readEA link

Thoughts on the Trans­par­ent New­comb’s Problem

Dawn DrescherApr 15, 2022, 9:05 PM
12 points
0 comments8 min readEA link
(impartial-priorities.org)

Ter­mi­nate de­liber­a­tion based on re­silience, not certainty

Gregory Lewis🔸Jun 5, 2022, 8:08 PM
152 points
16 comments12 min readEA link

Max­imis­ing ex­pected util­ity fol­lows from self-ev­i­dent premises?

Vasco Grilo🔸Jan 19, 2025, 9:59 AM
17 points
25 comments1 min readEA link
(en.wikipedia.org)

Chris­tian Tarsney on fu­ture bias and a pos­si­ble solu­tion to moral fanaticism

PabloMay 6, 2021, 10:39 AM
26 points
6 comments1 min readEA link
(80000hours.org)

Think­ing About De­ci­sions as a Weighted Fac­tor Model

Joey🔸Oct 30, 2024, 3:29 PM
61 points
5 comments5 min readEA link

Self-Similar­ity Experiment

Dawn DrescherSep 5, 2020, 5:04 PM
10 points
0 comments10 min readEA link
(impartial-priorities.org)

Dis­cussing how to al­ign Trans­for­ma­tive AI if it’s de­vel­oped very soon

eliflandNov 28, 2022, 4:17 PM
36 points
0 comments1 min readEA link

A Stranger Pri­or­ity? Topics at the Outer Reaches of Effec­tive Altru­ism (my dis­ser­ta­tion)

Joe_CarlsmithFeb 21, 2023, 5:16 PM
64 points
0 comments1 min readEA link

On nav­i­gat­ing se­ri­ous philo­soph­i­cal con­fu­sion (Joe Car­l­smith on The 80,000 Hours Pod­cast)

80000_HoursMay 22, 2023, 12:53 PM
25 points
1 comment12 min readEA link

Rea­sons and Per­sons: Watch the­o­ries eat themselves

Aaron Gertler 🔸Dec 25, 2021, 3:53 AM
64 points
7 comments15 min readEA link
(dynomight.net)

Philo­soph­i­cal con­sid­er­a­tions rele­vant to valu­ing con­tinued hu­man sur­vival: Con­cep­tual Anal­y­sis, Pop­u­la­tion Ax­iol­ogy, and De­ci­sion The­ory (An­dreas Mo­gensen)

Global Priorities InstituteNov 1, 2023, 12:10 PM
45 points
0 comments3 min readEA link

Tak­ing Uncer­tainty Se­ri­ously (or, Why Tools Mat­ter)

Bob FischerJul 19, 2024, 10:30 AM
115 points
4 comments8 min readEA link

Per­son-af­fect­ing in­tu­itions can of­ten be money pumped

Rohin ShahJul 7, 2022, 12:23 PM
94 points
69 comments3 min readEA link

Ar­gu­ments for util­i­tar­i­anism are im­pos­si­bil­ity ar­gu­ments un­der un­bounded prospects

MichaelStJulesOct 7, 2023, 9:09 PM
39 points
48 comments1 min readEA link

2020 PhilPapers Sur­vey Results

RobBensingerNov 2, 2021, 5:06 AM
40 points
0 comments12 min readEA link

Chris­tian Tarsney on fu­ture bias and a pos­si­ble solu­tion to moral fanaticism

80000_HoursMay 5, 2021, 7:38 PM
7 points
0 comments113 min readEA link

The Harsanyi-Rawls de­bate: poli­ti­cal philos­o­phy as de­ci­sion the­ory un­der uncertainty

RamiroAug 1, 2021, 2:04 PM
19 points
3 comments4 min readEA link

Puz­zles for Everyone

Richard Y Chappell🔸Sep 10, 2022, 2:11 AM
116 points
38 comments5 min readEA link
(rychappell.substack.com)

The Least Con­tro­ver­sial Ap­pli­ca­tion of Geo­met­ric Rationality

Scott GarrabrantNov 25, 2022, 4:50 PM
18 points
0 comments1 min readEA link

Lay­man’s Sum­mary of Re­solv­ing Pas­cal­lian De­ci­sion Prob­lems with Stochas­tic Dominance

Ben_West🔸Mar 12, 2021, 3:51 AM
45 points
11 comments5 min readEA link

How LDT helps re­duce the AI arms race

Tamsin LeakeDec 10, 2023, 4:21 PM
8 points
1 comment1 min readEA link
(carado.moe)

[Link] EAF Re­search agenda: “Co­op­er­a­tion, Con­flict, and Trans­for­ma­tive Ar­tifi­cial In­tel­li­gence”

stefan.torgesJan 17, 2020, 1:28 PM
64 points
0 comments1 min readEA link

Weight by Impact

vaniverMay 21, 2023, 2:37 PM
7 points
0 comments1 min readEA link

On ex­pected util­ity, part 3: VNM, sep­a­ra­bil­ity, and more

Joe_CarlsmithMar 22, 2022, 3:05 AM
9 points
0 comments28 min readEA link

Slightly ad­vanced de­ci­sion the­ory 102: Four rea­sons not to be a (naive) util­ity maximizer

kirchner.janNov 23, 2021, 10:47 AM
16 points
5 comments14 min readEA link
(universalprior.substack.com)

Against the nor­ma­tive re­al­ist’s wager

Joe_CarlsmithOct 13, 2022, 4:36 PM
27 points
5 comments23 min readEA link

Everett branches, in­ter-light cone trade and other alien mat­ters: Ap­pendix to “An ECL ex­plainer”

ChiFeb 24, 2024, 11:09 PM
26 points
1 comment11 min readEA link

Ev­i­den­tial Co­op­er­a­tion in Large Wor­lds: Po­ten­tial Ob­jec­tions & FAQ

ChiFeb 28, 2024, 6:58 PM
40 points
5 comments18 min readEA link

Sum­mary of Ev­i­dence, De­ci­sion, and Causality

Dawn DrescherSep 5, 2020, 8:23 PM
27 points
0 comments43 min readEA link
(impartial-priorities.org)

Can you con­trol the past?

Joe_CarlsmithAug 27, 2021, 7:34 PM
46 points
21 comments47 min readEA link

Ideal gov­er­nance (for com­pa­nies, coun­tries and more)

Holden KarnofskyApr 7, 2022, 4:54 PM
80 points
19 comments14 min readEA link

Should we Max­i­mize the Geo­met­ric Ex­pec­ta­tion?

A.H.Apr 19, 2024, 8:06 PM
12 points
6 comments9 min readEA link

How to make hard choices, Ruth Chang

Ben YeohAug 2, 2024, 1:10 PM
22 points
0 comments1 min readEA link

Sum­mary: Against Anti-Fa­nat­i­cism (Chris­tian Tarsney)

Noah Varley🔸Jan 25, 2024, 3:04 PM
25 points
3 comments3 min readEA link

Gaia Net­work: An Illus­trated Primer

Roman LeventovJan 26, 2024, 11:55 AM
4 points
4 comments15 min readEA link

Weighted Fac­tor Models: Con­sider us­ing the ge­o­met­ric mean in­stead of the ar­ith­metic mean

Soemano ZeijlmansOct 21, 2024, 7:57 PM
59 points
13 comments10 min readEA link

Rea­sons-based choice and cluelessness

JesseCliftonFeb 7, 2025, 10:21 PM
42 points
1 comment1 min readEA link

How to Give in to Threats (with­out in­cen­tiviz­ing them)

MikhailSaminMar 24, 2025, 12:53 AM
9 points
0 comments1 min readEA link

In­tro­duc­tion to Ex­pected Value Fanaticism

Petra KosonenFeb 14, 2025, 12:05 AM
22 points
3 comments1 min readEA link
(utilitarianism.net)

Op­pres­sion and pro­duc­tion are com­pet­ing ex­pla­na­tions for wealth in­equal­ity.

BenquoJan 5, 2025, 2:36 PM
4 points
6 comments8 min readEA link
(benjaminrosshoffman.com)

The Dilemma’s Dilemma

Non-zero-sum JamesFeb 19, 2025, 11:56 PM
2 points
1 comment7 min readEA link
(nonzerosum.games)

Ground­ing metaethics, pop­u­la­tion ethics, an­i­mal ethics, etc.

N.W. RainsMar 27, 2025, 2:37 PM
1 point
0 comments2 min readEA link
(nwrains.net)

Fu­ture Bias – Does To­mor­row’s Pain Hurt More Than Yes­ter­day’s?

jachym_simkoJan 18, 2025, 1:12 PM
5 points
0 comments10 min readEA link

Mo­ral mountaineering

finmJan 18, 2025, 3:42 PM
20 points
5 comments6 min readEA link
(finmoorhouse.substack.com)

Ex­pected value of re­ject­ing a job offer when there are other on­go­ing applications

Vasco Grilo🔸Feb 23, 2025, 9:43 AM
13 points
7 comments7 min readEA link

The Stag Hunt—cul­ti­vat­ing co­op­er­a­tion to reap rewards

Non-zero-sum JamesFeb 25, 2025, 11:47 PM
13 points
4 comments4 min readEA link

Don’t treat prob­a­bil­ities less than 0.5 as if they’re 0

MichaelDickensFeb 26, 2025, 5:14 AM
36 points
3 comments1 min readEA link

EAs for­got what “marginal” means

Holly Elmore ⏸️ 🔸Feb 27, 2025, 12:49 AM
19 points
7 comments1 min readEA link

Should you go with your best guess?: Against pre­cise Bayesi­anism and re­lated views

Anthony DiGiovanniJan 27, 2025, 8:25 PM
73 points
1 comment22 min readEA link

Re­source Allo­ca­tion: A Re­search Agenda

arvommNov 14, 2024, 3:34 PM
44 points
7 comments33 min readEA link

The Mo­ral Illu­sion: What Hap­pens When We Real­ize Ethics Was Never Real?

Aaron ClarkeMar 1, 2025, 8:35 PM
2 points
5 comments24 min readEA link

De­ci­sion-Rele­vance of wor­lds and ADT im­ple­men­ta­tions

Maxime Riché 🔸Mar 6, 2025, 4:57 PM
9 points
1 comment15 min readEA link

Fun­da­men­tals of Fatal Risks

AinoJul 29, 2023, 7:12 AM
1 point
0 comments4 min readEA link

Punch­ing Utili­tar­i­ans in the Face

AppliedDivinityStudiesJul 13, 2022, 6:43 PM
62 points
29 comments5 min readEA link

[Question] What should my re­search lab fo­cus on in the first week of 2023?

Jobst Heitzig (vodle.it)Nov 4, 2022, 10:16 AM
3 points
0 comments1 min readEA link

[Question] De­ci­sion mak­ing un­der model am­bi­guity, moral un­cer­tainty, and other agents with free will?

Jobst Heitzig (vodle.it)Nov 2, 2022, 12:52 PM
16 points
1 comment8 min readEA link

Th­e­sis Sum­mary and Open Ques­tions: Nor­ma­tive Uncer­tainty and In­for­ma­tion Value

rileyharrisApr 27, 2022, 8:46 AM
32 points
0 comments3 min readEA link

Mul­ti­verse-wide co­op­er­a­tion in a nutshell

Lukas_GloorNov 2, 2017, 10:17 AM
84 points
10 comments16 min readEA link

My notes on: Se­quence think­ing vs. cluster thinking

Vasco Grilo🔸May 25, 2022, 3:03 PM
24 points
0 comments5 min readEA link

LW4EA: Value of In­for­ma­tion: Four Examples

JeremyJun 14, 2022, 2:26 AM
5 points
0 comments1 min readEA link
(www.lesswrong.com)

Bayesian Mindset

Holden KarnofskyDec 21, 2021, 7:54 PM
73 points
19 comments25 min readEA link

Ex­ceed­ing Ex­pec­ta­tions: Stochas­tic Dom­i­nance as a Gen­eral De­ci­sion Theory

Global Priorities InstituteAug 1, 2020, 1:34 PM
3 points
0 comments5 min readEA link
(globalprioritiesinstitute.org)

OpenPrin­ci­ples Boot­camp, Reflect & Act on Your EA & Life Prin­ci­ples (Free)

Ti GuoSep 16, 2022, 2:23 AM
0 points
3 comments4 min readEA link

Is Our Uni­verse A New­comb’s Para­dox Si­mu­la­tion?

Jordan ArelMay 15, 2022, 7:28 AM
16 points
8 comments2 min readEA link

Courses and col­lab­o­ra­tive books on Effec­tive Altru­ism with So­cial-Psy­chol­ogy & Judg­ment and De­ci­sion-Mak­ing [Feed­back ap­pre­ci­ated]

Gilad FeldmanOct 11, 2022, 3:56 AM
24 points
6 comments2 min readEA link

Re­spect­ing your Lo­cal Preferences

Scott GarrabrantNov 26, 2022, 7:04 PM
23 points
0 comments1 min readEA link

Lo­cal Memes Against Geo­met­ric Rationality

Scott GarrabrantDec 21, 2022, 3:53 AM
18 points
0 comments1 min readEA link

On ex­pected util­ity, part 4: Dutch books, Cox, and Com­plete Class

Joe_CarlsmithMar 24, 2022, 7:49 AM
7 points
0 comments22 min readEA link

Heuris­tics for clue­less agents: how to get away with ig­nor­ing what mat­ters most in or­di­nary de­ci­sion-making

Global Priorities InstituteMay 31, 2020, 1:35 PM
4 points
0 comments3 min readEA link
(globalprioritiesinstitute.org)

Un­cor­re­lated Bets: an easy to un­der­stand and very im­por­tant de­ci­sion the­ory con­sid­er­a­tion, which helps tease out nonob­vi­ous but pro­duc­tive crit­i­cism of the EA movement

Uncorrelated ReturnsAug 12, 2022, 9:04 AM
22 points
8 comments3 min readEA link

Notes on “Can you con­trol the past”

So8resOct 20, 2022, 3:41 AM
15 points
0 comments1 min readEA link

Multi-Fac­tor De­ci­sion Mak­ing Math

Elliot TempleOct 30, 2022, 4:46 PM
2 points
13 comments37 min readEA link
(criticalfallibilism.com)

De­ci­sion the­ory does not im­ply that we get to have nice things

So8resOct 18, 2022, 3:04 AM
36 points
0 comments1 min readEA link

On ex­pected util­ity, part 2: Why it can be OK to pre­dictably lose

Joe_CarlsmithMar 18, 2022, 8:28 AM
8 points
2 comments16 min readEA link

LW4EA: Beyond Astro­nom­i­cal Waste

JeremyMay 10, 2022, 2:50 PM
9 points
2 comments1 min readEA link
(www.lesswrong.com)

Fair Col­lec­tive Effec­tive Altruism

Jobst Heitzig (vodle.it)Nov 28, 2022, 1:35 PM
6 points
1 comment5 min readEA link
(www.lesswrong.com)

An­nounc­ing vo­dle, a web app for con­sen­sus-aiming col­lec­tive decisions

Jobst Heitzig (vodle.it)Oct 31, 2022, 12:37 AM
26 points
8 comments1 min readEA link

Tyranny of the Epistemic Majority

Scott GarrabrantNov 22, 2022, 5:19 PM
46 points
2 comments1 min readEA link

Tough enough? Ro­bust satis­fic­ing as a de­ci­sion norm for long-term policy analysis

Global Priorities InstituteOct 31, 2020, 1:28 PM
5 points
0 comments3 min readEA link
(globalprioritiesinstitute.org)

How to Avoid Cal­ifor­nia Re­call Disasters (SF Chron­i­cle Op-Ed)

Mahendra PrasadSep 17, 2021, 5:01 AM
3 points
0 comments2 min readEA link

A bar­gain­ing-the­o­retic ap­proach to moral uncertainty

Global Priorities InstituteAug 8, 2019, 1:41 PM
3 points
0 comments3 min readEA link
(globalprioritiesinstitute.org)

Should AI fo­cus on prob­lem-solv­ing or strate­gic plan­ning? Why not both?

oliver_siegelNov 1, 2022, 9:53 AM
1 point
0 comments1 min readEA link

Puz­zles for Some

Violet HourFeb 3, 2023, 12:23 PM
20 points
4 comments7 min readEA link

Acausal normalcy

Andrew CritchMar 3, 2023, 11:35 PM
21 points
4 comments8 min readEA link

Pineap­ples on Mars, why you should stop look­ing at orgs for cause prio, and how we com­pare: an INT dis­sec­tion for be­gin­ners

SofiiaFMar 14, 2025, 8:56 AM
−1 points
1 comment7 min readEA link

Other Civ­i­liza­tions Would Re­cover 84+% of Our Cos­mic Re­sources—A Challenge to Ex­tinc­tion Risk Prioritization

Maxime Riché 🔸Mar 17, 2025, 1:11 PM
19 points
0 comments12 min readEA link

Ar­ti­cle on Value Plu­ral­ism, Mak­ing Trade Offs and Policymaking

Danny WardleMar 17, 2025, 1:26 PM
1 point
0 comments1 min readEA link
(sagacitymagazine.com.au)

Prob­a­bil­ities might be off by one per­centage point

SjlverDec 12, 2024, 10:42 AM
24 points
18 comments2 min readEA link

De­ci­sion The­ory: A (Nor­ma­tive) Introduction

ParetoOptimalSep 6, 2023, 11:46 AM
0 points
3 comments3 min readEA link
(paretooptimal.substack.com)

Solu­tions to prob­lems with Bayesianism

Bob JacobsNov 4, 2023, 12:15 PM
27 points
2 comments21 min readEA link

New­comb’s Para­dox Explained

Alex VellinsMar 31, 2023, 9:26 PM
2 points
11 comments2 min readEA link

[Question] Should we pub­lish ar­gu­ments for the preser­va­tion of hu­man­ity?

JeremyApr 7, 2023, 1:51 PM
8 points
4 comments1 min readEA link

Devel­op­ing a Calcu­la­ble Con­science for AI: Equa­tion for Rights Violations

Sean SweeneyDec 12, 2024, 5:50 PM
4 points
1 comment15 min readEA link

The Benev­olent Ruler’s Hand­book (Part 1): The Policy Problem

FCCCAug 12, 2023, 2:24 PM
5 points
0 comments4 min readEA link

Im­pli­ca­tions of ev­i­den­tial co­op­er­a­tion in large worlds

Lukas FinnvedenAug 23, 2023, 12:43 AM
79 points
1 comment1 min readEA link
(lukasfinnveden.substack.com)

Avert­ing Catas­tro­phe: De­ci­sion The­ory for COVID-19, Cli­mate Change, and Po­ten­tial Disasters of All Kinds

JakubKMay 2, 2023, 10:50 PM
15 points
0 comments1 min readEA link
(nyupress.org)

Craft­ing Our Mis­sion State­ment: Weighted Fac­tor Models, Shal­low Re­search, and Les­sons Learned for Clar­ity and Impact

Harry LukOct 13, 2023, 4:43 PM
9 points
4 comments6 min readEA link

A New Bayesian De­ci­sion Theory

ParetoOptimalSep 20, 2023, 9:38 AM
0 points
2 comments1 min readEA link
(paretooptimal.substack.com)

The Benev­olent Ruler’s Hand­book (Part 2): Mo­ral­ity Rules

FCCCAug 12, 2023, 2:25 PM
3 points
0 comments4 min readEA link

Democ­racy be­yond majoritarianism

Arturo MaciasSep 3, 2024, 3:06 PM
7 points
3 comments4 min readEA link

Storable Votes with a Pay as you win mechanism: a con­tri­bu­tion for in­sti­tu­tional design

Arturo MaciasMar 11, 2024, 3:52 PM
6 points
3 comments2 min readEA link

Sum­mary: In Defence of Fa­nat­i­cism (Hay­den Wilk­in­son)

Noah Varley🔸Jan 15, 2024, 2:21 PM
30 points
3 comments6 min readEA link

Re­think Pri­ori­ties’ Port­fo­lio Builder Tool

arvommJul 10, 2024, 12:06 PM
102 points
1 comment11 min readEA link
No comments.