RSS

Mo­ral uncertainty

TagLast edit: 13 May 2021 14:49 UTC by EA Wiki assistant

Moral uncertainty is uncertainty about how to act given lack of certainty in any one moral theory, as well as the study of how we ought to act given this uncertainty.

We are sometimes uncertain about empirical facts, such as whether it will rain tomorrow. But we can also be uncertain about moral facts, such as whether it’s wrong to steal, or how we should value the well-being of animals. Uncertainty about whether it’s wrong to steal is uncertainty about moral or normative facts, while uncertainty about how we should value the well-being of animals is uncertainty about axiological or value facts.

Can moral uncertainty be rational, and what should we do in response to it? We might think that it can never be rational to be uncertain about normative or axiological facts, because such facts are, like mathematical facts, knowable a priori. Nevertheless it seems that agents like ourselves are uncertain about non-trivial mathematical facts, and that we are also uncertain about normative and axiological facts. Given this, it seems necessary to develop some account of how we ought to act under moral uncertainty.

Several such accounts have been formulated in recent years:

Two important problems facing the view that moral uncertainty can affect how we ought to act are the regress problem—the problem that we will be uncertain not only about typical moral questions, but also about which approach to moral uncertainty is correct, and so on ad infinitum (Sepielli 2013) - and the problem of intertheoretic comparisons—the problem that there seems to be no principled ways to make comparisons between different moral theories (Nissan-Rozen 2015).

Bibliography

Bostrom, Nick (2009) Moral uncertainty—towards a solution?, Overcoming Bias, January 1.

Gustafsson, Johan E. & Olle Torpman (2014) In defence of my favourite theory, Pacific Philosophical Quarterly, 95(2): 159-174.

MacAskill, William (2014) Normative uncertainty, Doctoral dissertation, University of Oxford.

MacAskill, William, Krister Bykvist, & Toby Ord (2020) Moral Uncertainty, Oxford: Oxford University Press.

Nissan-Rozen, Ittay (2015) Against moral hedging, Economics and Philosophy, 31(3): 349-369.

Sepielli, Andrew (2013) What to do when you don’t know what to do when you don’t know what to do…, Nous, 47(1) :521-544.

Weatherson, Brian (2014) Running risks morally, Philosophical Studies, 167: 141–63.

Related entries

altruistic wager | decision-theoretic uncertainty | expected value | fanaticism | moral perspectives on existential risk reduction | moral trade | normative uncertainty

New book: Mo­ral Uncer­tainty by MacAskill, Ord & Bykvist

frankieaw10 Sep 2020 16:22 UTC
85 points
2 comments1 min readEA link

Mak­ing de­ci­sions un­der moral uncertainty

MichaelA1 Jan 2020 13:02 UTC
41 points
8 comments17 min readEA link

Wor­ld­view uncertainty

Ronja_Lutz16 May 2018 14:02 UTC
15 points
7 commentsEA link

Sor­ti­tion Model of Mo­ral Uncertainty

Bob Jacobs4 Oct 2020 20:58 UTC
24 points
5 comments2 min readEA link

EA read­ing list: moral un­cer­tainty, moral co­op­er­a­tion, and val­ues spreading

richard_ngo3 Aug 2020 9:21 UTC
13 points
0 comments1 min readEA link

Nor­ma­tive Uncer­tainty and the Depen­dence Problem

G Gordon Worley III23 Mar 2020 17:29 UTC
15 points
4 comments2 min readEA link
(philpapers.org)

Prac­ti­cal ethics given moral uncertainty

William_MacAskill31 Jan 2012 5:00 UTC
13 points
4 commentsEA link

Mo­ral Anti-Real­ism Se­quence #4: Why the Mo­ral Real­ism Wager Fails

Lukas_Gloor14 Jun 2020 13:33 UTC
22 points
13 comments11 min readEA link

Mo­ral Anti-Real­ism Se­quence #5: Me­taeth­i­cal Fa­nat­i­cism (Dialogue)

Lukas_Gloor17 Jun 2020 12:33 UTC
22 points
10 comments15 min readEA link

Why I Don’t Ac­count for Mo­ral Uncertainty

[deleted]11 Jan 2015 3:52 UTC
20 points
16 comments2 min readEA link

Cause pri­ori­ti­za­tion for down­side-fo­cused value systems

Lukas_Gloor31 Jan 2018 14:47 UTC
61 points
9 comments47 min readEA link

Mo­ral­ity vs re­lated concepts

MichaelA10 Feb 2020 8:02 UTC
18 points
2 comments8 min readEA link

Mak­ing de­ci­sions when both morally and em­piri­cally uncertain

MichaelA2 Jan 2020 7:08 UTC
17 points
4 comments20 min readEA link

Quotes about the long reflection

MichaelA5 Mar 2020 7:48 UTC
52 points
12 comments13 min readEA link

Vive la Différence? Struc­tural Diver­sity as a Challenge for Me­tanor­ma­tive Theories

G Gordon Worley III26 May 2020 0:45 UTC
17 points
0 comments1 min readEA link
(philpapers.org)

Up­date on the Global Pri­ori­ties In­sti­tute’s (GPI) activities

Global Priorities Institute24 Dec 2019 13:51 UTC
23 points
0 comments7 min readEA link

The ex­pected value of ex­tinc­tion risk re­duc­tion is positive

JanBrauner9 Dec 2018 8:00 UTC
40 points
21 comments61 min readEA link

Will MacAskill on nor­ma­tive uncertainty

Luke_Muehlhauser9 Apr 2014 15:27 UTC
2 points
0 commentsEA link

Nor­ma­tive Uncer­tainty and Prob­a­bil­is­tic Mo­ral Knowledge

G Gordon Worley III11 Nov 2019 20:26 UTC
13 points
0 comments1 min readEA link
(philpapers.org)

Ex­pected value un­der nor­ma­tive uncertainty

G Gordon Worley III8 Jun 2020 15:45 UTC
14 points
1 comment1 min readEA link
(philpapers.org)

EA read­ing list: clue­less­ness and epistemic modesty

richard_ngo3 Aug 2020 9:23 UTC
23 points
3 comments1 min readEA link

Hedg­ing against deep and moral uncertainty

MichaelStJules12 Sep 2020 23:44 UTC
42 points
10 comments9 min readEA link

Even Allo­ca­tion Strat­egy un­der High Model Ambiguity

MichaelStJules31 Dec 2020 9:10 UTC
14 points
2 comments2 min readEA link

Shar­ing the World with Digi­tal Minds

Aaron Gertler1 Dec 2020 8:00 UTC
12 points
0 comments1 min readEA link
(www.nickbostrom.com)

[Pod­cast] Ajeya Co­tra on wor­ld­view di­ver­sifi­ca­tion and how big the fu­ture could be

evelynciara22 Jan 2021 23:57 UTC
56 points
17 comments1 min readEA link
(80000hours.org)

Wrong by Induction

Ales_Flidr6 Sep 2018 22:00 UTC
20 points
2 commentsEA link

The Pos­si­bil­ity of an On­go­ing Mo­ral Catas­tro­phe (Sum­mary)

Linch2 Aug 2019 21:55 UTC
44 points
10 comments1 min readEA link
(docs.google.com)

Amanda Askell: The moral value of information

EA Global2 Jun 2017 8:48 UTC
6 points
0 comments13 min readEA link
(www.youtube.com)

How might we be wildly wrong?

William_MacAskill4 Sep 2013 19:19 UTC
3 points
0 commentsEA link

Peter Singer on the 80K podcast

Jon_Behar18 Dec 2019 17:17 UTC
31 points
0 comments1 min readEA link
(80000hours.org)

SoGive’s moral weights—please take part!

Sanjay5 Apr 2021 22:47 UTC
26 points
2 comments3 min readEA link

New re­search on moral weights

GiveWell4 Dec 2019 11:57 UTC
41 points
4 comments2 min readEA link
(blog.givewell.org)

Mo­ral plu­ral­ism and longter­mism | Sunyshore

evelynciara17 Apr 2021 0:14 UTC
26 points
0 comments5 min readEA link
(sunyshore.substack.com)

Light­ning talks from EA Global: San Fran­cisco (2018)

EA Global8 Jun 2018 20:51 UTC
6 points
0 comments11 min readEA link
(www.youtube.com)

Chris­tian Tarsney on fu­ture bias and a pos­si­ble solu­tion to moral fanaticism

Pablo6 May 2021 10:39 UTC
26 points
3 comments1 min readEA link
(80000hours.org)

Non-Con­se­quen­tial­ist Con­sid­er­a­tions For Cause-Pri­oritza­tion Part 1

Parker_Whitfill28 Nov 2018 22:22 UTC
14 points
2 commentsEA link

Stu­art Rus­sell Hu­man Com­pat­i­ble AI Roundtable with Allan Dafoe, Rob Re­ich, & Ma­ri­etje Schaake

Mahendra Prasad11 Feb 2021 7:43 UTC
16 points
0 comments1 min readEA link

Re­view and Sum­mary of ‘Mo­ral Uncer­tainty’

finm2 Oct 2020 15:41 UTC
31 points
2 comments1 min readEA link
(www.finmoorhouse.com)

Ar­gu­ments for moral indefinability

richard_ngo8 Feb 2019 11:09 UTC
33 points
8 commentsEA link
(thinkingcomplete.blogspot.com)

[Question] Does any thor­ough dis­cus­sion of moral par­li­a­ments ex­ist?

richard_ngo6 Sep 2019 15:33 UTC
36 points
10 comments1 min readEA link

Uncer­tainty and Wild An­i­mal Welfare

abrahamrowe19 Jul 2019 13:33 UTC
24 points
0 comments8 min readEA link

Ajeya Co­tra: Im­ple­ment­ing cause pri­ori­ti­sa­tion at Open Philanthropy

EA Global3 Nov 2017 7:43 UTC
6 points
0 comments1 min readEA link
(www.youtube.com)

Con­struc­tive Crit­i­cism of Mo­ral Uncer­tainty (book)

mariushobbhahn4 Jun 2021 6:04 UTC
28 points
3 comments5 min readEA link
No comments.