Mo­ral uncertainty

TagLast edit: 14 Jan 2022 15:23 UTC by Pablo

Moral uncertainty is uncertainty about how to act given lack of certainty in any one moral theory, as well as the study of how we ought to act given this uncertainty.

We are sometimes uncertain about empirical facts, such as whether it will rain tomorrow. But we can also be uncertain about moral facts, such as whether it’s wrong to steal, or how we should value the well-being of animals. Uncertainty about whether it’s wrong to steal is uncertainty about moral or normative facts, while uncertainty about how we should value the well-being of animals is uncertainty about axiological or value facts.

Can moral uncertainty be rational, and what should we do in response to it? We might think that it can never be rational to be uncertain about normative or axiological facts, because such facts are, like mathematical facts, knowable a priori. Nevertheless it seems that agents like ourselves are uncertain about non-trivial mathematical facts, and that we are also uncertain about normative and axiological facts. Given this, it seems necessary to develop some account of how we ought to act under moral uncertainty.

Several such accounts have been formulated in recent years:

Two important problems facing the view that moral uncertainty can affect how we ought to act are the regress problem—the problem that we will be uncertain not only about typical moral questions, but also about which approach to moral uncertainty is correct, and so on ad infinitum[5] - and the problem of intertheoretic comparisons—the problem that there seems to be no principled ways to make comparisons between different moral theories.[6]

Further reading

MacAskill, William, Krister Bykvist, & Toby Ord (2020) Moral Uncertainty, Oxford: Oxford University Press.

Related entries

altruistic wager | decision-theoretic uncertainty | ethics of existential risk | expected value | fanaticism | moral trade | normative uncertainty

  1. ^

    Weatherson, Brian (2014) Running risks morally, Philosophical Studies, 167: 141–63.

  2. ^

    Gustafsson, Johan E. & Olle Torpman (2014) In defence of my favourite theory, Pacific Philosophical Quarterly, 95(2): 159-174.

  3. ^

    MacAskill, William (2014) Normative uncertainty, Doctoral dissertation, University of Oxford.

  4. ^

    Bostrom, Nick (2009) Moral uncertainty—towards a solution?, Overcoming Bias, January 1.

  5. ^

  6. ^

    Nissan-Rozen, Ittay (2015) Against moral hedging, Economics and Philosophy, 31(3): 349-369.

New book: Mo­ral Uncer­tainty by MacAskill, Ord & Bykvist

frankieaw10 Sep 2020 16:22 UTC
85 points
2 comments1 min readEA link

Mak­ing de­ci­sions un­der moral uncertainty

MichaelA1 Jan 2020 13:02 UTC
42 points
8 comments17 min readEA link

A longter­mist cri­tique of “The ex­pected value of ex­tinc­tion risk re­duc­tion is pos­i­tive”

antimonyanthony1 Jul 2021 21:01 UTC
80 points
8 comments46 min readEA link

Stan­ley the Uncer­tain [Creative Writ­ing Con­test]

Akash28 Oct 2021 20:12 UTC
33 points
1 comment3 min readEA link

Wor­ld­view uncertainty

Ronja_Lutz16 May 2018 14:02 UTC
15 points
7 commentsEA link

Cause pri­ori­ti­za­tion for down­side-fo­cused value systems

Lukas_Gloor31 Jan 2018 14:47 UTC
70 points
10 comments48 min readEA link

Sor­ti­tion Model of Mo­ral Uncertainty

Bob Jacobs4 Oct 2020 20:58 UTC
24 points
5 comments2 min readEA link

EA read­ing list: moral un­cer­tainty, moral co­op­er­a­tion, and val­ues spreading

richard_ngo3 Aug 2020 9:21 UTC
14 points
0 comments1 min readEA link

Nor­ma­tive Uncer­tainty and the Depen­dence Problem

G Gordon Worley III23 Mar 2020 17:29 UTC
15 points
4 comments2 min readEA link

Prac­ti­cal ethics given moral uncertainty

William_MacAskill31 Jan 2012 5:00 UTC
15 points
4 commentsEA link

Why the Irre­ducible Nor­ma­tivity Wager (Mostly) Fails

Lukas_Gloor14 Jun 2020 13:33 UTC
22 points
13 comments10 min readEA link

Me­taeth­i­cal Fa­nat­i­cism (Dialogue)

Lukas_Gloor17 Jun 2020 12:33 UTC
24 points
10 comments15 min readEA link

Why I Don’t Ac­count for Mo­ral Uncertainty

[deleted]11 Jan 2015 3:52 UTC
20 points
16 comments2 min readEA link

Mo­ral­ity vs re­lated concepts

MichaelA10 Feb 2020 8:02 UTC
18 points
2 comments8 min readEA link

Mak­ing de­ci­sions when both morally and em­piri­cally uncertain

MichaelA2 Jan 2020 7:08 UTC
17 points
4 comments20 min readEA link

Quotes about the long reflection

MichaelA5 Mar 2020 7:48 UTC
53 points
13 comments13 min readEA link

Vive la Différence? Struc­tural Diver­sity as a Challenge for Me­tanor­ma­tive Theories

G Gordon Worley III26 May 2020 0:45 UTC
17 points
0 comments1 min readEA link

Up­date on the Global Pri­ori­ties In­sti­tute’s (GPI) activities

Global Priorities Institute24 Dec 2019 13:51 UTC
23 points
0 comments7 min readEA link

The ex­pected value of ex­tinc­tion risk re­duc­tion is positive

JanBrauner9 Dec 2018 8:00 UTC
43 points
23 comments61 min readEA link

Will MacAskill on nor­ma­tive uncertainty

lukeprog9 Apr 2014 15:27 UTC
2 points
0 commentsEA link

Nor­ma­tive Uncer­tainty and Prob­a­bil­is­tic Mo­ral Knowledge

G Gordon Worley III11 Nov 2019 20:26 UTC
13 points
0 comments1 min readEA link

Ex­pected value un­der nor­ma­tive uncertainty

G Gordon Worley III8 Jun 2020 15:45 UTC
14 points
1 comment1 min readEA link

EA read­ing list: clue­less­ness and epistemic modesty

richard_ngo3 Aug 2020 9:23 UTC
23 points
3 comments1 min readEA link

Hedg­ing against deep and moral uncertainty

MichaelStJules12 Sep 2020 23:44 UTC
45 points
11 comments9 min readEA link

Even Allo­ca­tion Strat­egy un­der High Model Ambiguity

MichaelStJules31 Dec 2020 9:10 UTC
14 points
3 comments2 min readEA link

Shar­ing the World with Digi­tal Minds

Aaron Gertler1 Dec 2020 8:00 UTC
12 points
0 comments1 min readEA link

[Pod­cast] Ajeya Co­tra on wor­ld­view di­ver­sifi­ca­tion and how big the fu­ture could be

evelynciara22 Jan 2021 23:57 UTC
56 points
20 comments1 min readEA link

Wrong by Induction

Ales_Flidr6 Sep 2018 22:00 UTC
20 points
2 commentsEA link

The Pos­si­bil­ity of an On­go­ing Mo­ral Catas­tro­phe (Sum­mary)

Linch2 Aug 2019 21:55 UTC
59 points
11 comments5 min readEA link

Amanda Askell: The moral value of information

EA Global2 Jun 2017 8:48 UTC
6 points
0 comments13 min readEA link

How might we be wildly wrong?

William_MacAskill4 Sep 2013 19:19 UTC
3 points
0 commentsEA link

Peter Singer on the 80K podcast

Jon_Behar18 Dec 2019 17:17 UTC
31 points
0 comments1 min readEA link

SoGive’s moral weights—please take part!

Sanjay5 Apr 2021 22:47 UTC
26 points
2 comments3 min readEA link

New re­search on moral weights

GiveWell4 Dec 2019 11:57 UTC
41 points
4 comments2 min readEA link

Mo­ral plu­ral­ism and longter­mism | Sunyshore

evelynciara17 Apr 2021 0:14 UTC
26 points
0 comments5 min readEA link

Light­ning talks from EA Global: San Fran­cisco (2018)

EA Global8 Jun 2018 20:51 UTC
6 points
0 comments11 min readEA link

Chris­tian Tarsney on fu­ture bias and a pos­si­ble solu­tion to moral fanaticism

Pablo6 May 2021 10:39 UTC
26 points
6 comments1 min readEA link

Chris­tian Tarsney on fu­ture bias and a pos­si­ble solu­tion to moral fanaticism

80000_Hours5 May 2021 19:38 UTC
7 points
0 comments113 min readEA link

Seek­ing feed­back on new EA-al­igned eco­nomics paper

jh21 Oct 2021 21:19 UTC
34 points
13 comments1 min readEA link

Brian To­masik – Rea­sons to Be Nice to Other Value Systems

tessa17 Jan 2014 0:28 UTC
18 points
0 comments1 min readEA link

Might stop­ping mis­car­riages be a very im­por­tant cause area?

SaraAzubuike5 Dec 2021 17:18 UTC
9 points
13 comments2 min readEA link

Democratis­ing Risk—or how EA deals with critics

CarlaZoeC28 Dec 2021 15:05 UTC
188 points
292 comments4 min readEA link

Non-Con­se­quen­tial­ist Con­sid­er­a­tions For Cause-Pri­oritza­tion Part 1

Parker_Whitfill28 Nov 2018 22:22 UTC
14 points
2 commentsEA link

Stu­art Rus­sell Hu­man Com­pat­i­ble AI Roundtable with Allan Dafoe, Rob Re­ich, & Ma­ri­etje Schaake

Mahendra Prasad11 Feb 2021 7:43 UTC
16 points
0 comments1 min readEA link

Re­view and Sum­mary of ‘Mo­ral Uncer­tainty’

finm2 Oct 2020 15:41 UTC
36 points
3 comments1 min readEA link

Ar­gu­ments for moral indefinability

richard_ngo8 Feb 2019 11:09 UTC
33 points
8 commentsEA link

[Question] Does any thor­ough dis­cus­sion of moral par­li­a­ments ex­ist?

richard_ngo6 Sep 2019 15:33 UTC
36 points
10 comments1 min readEA link

Uncer­tainty and Wild An­i­mal Welfare

abrahamrowe19 Jul 2019 13:33 UTC
24 points
0 comments8 min readEA link

Ajeya Co­tra: Im­ple­ment­ing cause pri­ori­ti­sa­tion at Open Philanthropy

EA Global3 Nov 2017 7:43 UTC
13 points
0 comments1 min readEA link

Con­struc­tive Crit­i­cism of Mo­ral Uncer­tainty (book)

mariushobbhahn4 Jun 2021 6:04 UTC
28 points
3 comments5 min readEA link

A bar­gain­ing-the­o­retic ap­proach to moral uncertainty

Global Priorities Institute8 Aug 2019 13:41 UTC
3 points
0 comments4 min readEA link

Pod­cast: Krister Bykvist on moral un­cer­tainty, ra­tio­nal­ity, metaethics, AI and fu­ture pop­u­la­tions

Gus Docker21 Oct 2021 15:17 UTC
8 points
0 comments1 min readEA link

Mo­ral un­cer­tainty and pub­lic jus­tifi­ca­tion (Bar­ret and Sch­midt, 2021)

Global Priorities Institute22 Oct 2021 9:57 UTC
4 points
3 comments3 min readEA link

Mo­ral Uncer­tainty and Mo­ral Real­ism Are in Tension

Lukas_Gloor25 Jan 2022 11:07 UTC
15 points
1 comment12 min readEA link
No comments.