RSS

Epistemology

TagLast edit: Jun 2, 2022, 7:35 PM by Leo

Epistemology is the study of how people should form credences about the nature of the world.

Beliefs and credences are purely evaluative attitudes: they are simply about the way that we think the world is. A person might believe that it will rain, for example, even though they hope that it will not.

Beliefs are all-or-nothing attitudes: we either believe that it will rain or we don’t believe that it will rain. Credences, on the other hand, reflect how likely we think it is that something is true, expressed as a real number between 0 and 1. For example, we might think that there is a 80% chance that it will rain, and therefore have a credence of 0.8 that it will rain.

It is widely held that beliefs are rational if they are supported by our evidence. And credences are rational if they follow the probability axioms (e.g. a credence should never be greater than 1 in any event) and are revised in accordance with Bayes’ rule.

Improving the accuracy of beliefs

One way to improve a person’s capacity to do good is to increase the accuracy of their beliefs. Since people’s actions are determined by their desires and their beliefs, a person aiming to do good will generally do more good the more accurate their beliefs are.

Examples of belief-improving work include reading books, crafting arguments in moral philosophy, writing articles about important problems, and making scientific discoveries.

Two distinctions are relevant in this context. First, a person can build capacity by improving either their factual or their normative beliefs. Second, a person can build capacity by improving either particular beliefs or general processes of belief-formation.

Further reading

Steup, Matthias & Ram Neta (2005) Epistemology, The Stanford Encyclopedia of Philosophy, December 14 (updated 11 April 2020).

Related entries

Bayesian epistemology | decision theory | epistemic deference | rationality

Epistemic Hell

rogersbacon1Jan 27, 2024, 5:17 PM
10 points
1 comment14 min readEA link
(www.secretorum.life)

So­cial Science in its episte­molog­i­cal context

Arturo MaciasDec 5, 2024, 4:10 PM
2 points
0 comments1 min readEA link
(www.theseedsofscience.pub)

Longter­mism and Com­pu­ta­tional Complexity

David KinneyAug 31, 2022, 9:51 PM
41 points
46 comments25 min readEA link

Prob­a­bil­ities, Pri­ori­ti­za­tion, and ‘Bayesian Mind­set’

Violet HourApr 4, 2023, 10:16 AM
70 points
6 comments24 min readEA link

[Link] The Op­ti­mizer’s Curse & Wrong-Way Reductions

Chris SmithApr 4, 2019, 1:28 PM
94 points
61 comments1 min readEA link

Disagree­ables and Asses­sors: Two In­tel­lec­tual Archetypes

Ozzie GooenNov 5, 2021, 9:01 AM
91 points
20 comments3 min readEA link

[Question] What con­crete ques­tion would you like to see de­bated? I might or­ganise some de­bates.

Nathan YoungApr 18, 2023, 4:13 PM
35 points
50 comments1 min readEA link

In fa­vor of steelmanning

JP Addison🔸May 1, 2023, 3:33 PM
27 points
3 comments3 min readEA link

In favour of ex­plor­ing nag­ging doubts about x-risk

Owen Cotton-BarrattJun 25, 2024, 11:52 PM
89 points
15 comments2 min readEA link

Flimsy Pet The­o­ries, Enor­mous Initiatives

Ozzie GooenDec 9, 2021, 3:10 PM
212 points
57 comments4 min readEA link

Dis­tanc­ing EA from ra­tio­nal­ity is foolish

Jan_KulveitJun 25, 2024, 9:02 PM
137 points
32 comments2 min readEA link

Think­ing of Con­ve­nience as an Eco­nomic Term

Ozzie GooenMay 5, 2023, 7:09 PM
28 points
5 comments12 min readEA link

On miss­ing moods and tradeoffs

LizkaMay 9, 2023, 10:06 AM
50 points
3 comments2 min readEA link

Pro­ject ideas: Epistemics

Lukas FinnvedenJan 4, 2024, 7:26 AM
43 points
1 comment17 min readEA link
(lukasfinnveden.substack.com)

How much do you be­lieve your re­sults?

Eric NeymanMay 5, 2023, 7:51 PM
211 points
14 comments1 min readEA link

De­sen­si­tiz­ing Deepfakes

PhibMar 29, 2023, 1:20 AM
22 points
10 comments1 min readEA link

Defer­ence for Bayesians

John G. HalsteadFeb 13, 2021, 12:33 PM
101 points
30 comments7 min readEA link

The mo­ti­vated rea­son­ing cri­tique of effec­tive altruism

LinchSep 14, 2021, 8:43 PM
286 points
59 comments23 min readEA link

The most im­por­tant les­son I learned af­ter ten years in EA

Kat WoodsAug 3, 2022, 12:28 PM
193 points
8 comments6 min readEA link

[Question] Where can I find good crit­i­cisms of EA made by non-EAs?

oh54321Jun 2, 2022, 12:03 AM
26 points
5 comments1 min readEA link

Why is it so hard to know if you’re helping?

Vasco Grilo🔸Oct 16, 2024, 4:08 PM
59 points
6 comments12 min readEA link
(www.theintrinsicperspective.com)

Truth­seek­ing is the ground in which other prin­ci­ples grow

ElizabethMay 27, 2024, 1:11 AM
106 points
17 comments1 min readEA link

[Question] Mat­sés—Are lan­guages pro­vid­ing epistemic cer­tainty of state­ments not of the in­ter­est of the EA com­mu­nity?

Miquel Banchs-Piqué (prev. mikbp)Jun 8, 2021, 7:25 PM
15 points
12 comments1 min readEA link

Pre­dictable up­dat­ing about AI risk

Joe_CarlsmithMay 8, 2023, 10:05 PM
134 points
12 comments36 min readEA link

Limits to Legibility

Jan_KulveitJun 29, 2022, 5:45 PM
104 points
3 comments5 min readEA link
(www.lesswrong.com)

[Link] EAF Re­search agenda: “Co­op­er­a­tion, Con­flict, and Trans­for­ma­tive Ar­tifi­cial In­tel­li­gence”

stefan.torgesJan 17, 2020, 1:28 PM
64 points
0 comments1 min readEA link

[Question] What im­prove­ments should be made to im­prove EA dis­cus­sion on heated top­ics?

Ozzie GooenJan 16, 2023, 8:11 PM
54 points
35 comments1 min readEA link

6 (Po­ten­tial) Mis­con­cep­tions about AI Intellectuals

Ozzie GooenFeb 14, 2025, 11:51 PM
30 points
2 comments12 min readEA link

Street Outreach

BarracudaJun 6, 2022, 1:40 PM
4 points
2 comments2 min readEA link

How to be a good ag­nos­tic (and some good rea­sons to be dog­matic)

peterhartreeFeb 4, 2023, 11:08 AM
11 points
1 comment3 min readEA link

Global health is im­por­tant for the epistemic foun­da­tions of EA, even for longtermists

Owen Cotton-BarrattJun 2, 2022, 1:57 PM
163 points
15 comments2 min readEA link

How mod­est should you be?

John G. HalsteadDec 28, 2020, 5:47 PM
26 points
10 comments7 min readEA link

Im­pact is very complicated

JustisMay 22, 2022, 4:24 AM
98 points
12 comments7 min readEA link

Should you go with your best guess?: Against pre­cise Bayesi­anism and re­lated views

Anthony DiGiovanniJan 27, 2025, 8:25 PM
73 points
1 comment22 min readEA link

[Question] “Epistemic maps” for AI De­bates? (or for other is­sues)

Marcel DAug 30, 2021, 4:59 AM
14 points
9 comments5 min readEA link

Con­trol­ling for a thinker’s big idea

Vasco Grilo🔸Oct 21, 2023, 7:56 AM
60 points
11 comments8 min readEA link
(magnusvinding.com)

A Sketch of AI-Driven Epistemic Lock-In

Ozzie GooenMar 5, 2025, 10:40 PM
13 points
1 comment3 min readEA link

Truth­ful AI

Owen Cotton-BarrattOct 20, 2021, 3:11 PM
55 points
14 comments10 min readEA link

Dis­courseDrome on Tradeoffs

JP Addison🔸Feb 18, 2023, 8:50 PM
12 points
0 comments1 min readEA link
(www.tumblr.com)

Se­quence think­ing vs. cluster thinking

GiveWellJul 25, 2016, 10:43 AM
17 points
0 comments28 min readEA link
(blog.givewell.org)

The Parable of the Boy Who Cried 5% Chance of Wolf

Kat WoodsAug 15, 2022, 2:22 PM
80 points
8 comments2 min readEA link

[Question] Is the cur­rent defi­ni­tion of EA not rep­re­sen­ta­tive of hits-based giv­ing?

VenkateshApr 26, 2021, 4:37 AM
44 points
14 comments1 min readEA link

On Epistemics and Communities

JP Addison🔸Dec 16, 2022, 7:11 PM
36 points
0 comments3 min readEA link

[Question] What im­por­tant truth do very few peo­ple agree with you on?

Tomer_GoloboyJun 1, 2022, 5:18 PM
3 points
3 comments1 min readEA link

Uncer­tainty over time and Bayesian updating

David BernardOct 25, 2023, 3:51 PM
63 points
2 comments28 min readEA link

Epistemics (Part 2: Ex­am­ples) | Reflec­tive Altruism

Eevee🔹May 19, 2023, 9:28 PM
34 points
0 comments2 min readEA link
(ineffectivealtruismblog.com)

Us­ing Points to Rate Differ­ent Kinds of Evidence

Ozzie GooenAug 25, 2023, 7:26 PM
33 points
6 comments6 min readEA link

Dispel­ling the An­thropic Shadow (Teruji Thomas)

Global Priorities InstituteOct 16, 2024, 1:25 PM
11 points
1 comment3 min readEA link
(globalprioritiesinstitute.org)

Epistemic tres­pass­ing, or epistemic squat­ting? | Noahpinion

Eevee🔹Aug 25, 2021, 1:50 AM
11 points
1 comment1 min readEA link
(noahpinion.substack.com)

The most ba­sic ra­tio­nal­ity tech­niques are of­ten neglected

Vasco Grilo🔸Aug 26, 2024, 3:45 PM
50 points
4 comments2 min readEA link
(stefanschubert.substack.com)

Nav­i­gat­ing the episte­molo­gies of effec­tive altruism

Ozzie_GooenSep 23, 2013, 7:50 PM
0 points
1 comment5 min readEA link

Solu­tions to prob­lems with Bayesianism

Bob JacobsNov 4, 2023, 12:15 PM
27 points
2 comments21 min readEA link

My Cur­rent Claims and Cruxes on LLM Fore­cast­ing & Epistemics

Ozzie GooenJun 26, 2024, 12:40 AM
46 points
7 comments24 min readEA link

Say how much, not more or less ver­sus some­one else

Gregory Lewis🔸Dec 28, 2023, 10:24 PM
100 points
10 comments5 min readEA link

Epistemic Trade: A quick proof sketch with one example

LinchMay 11, 2021, 9:05 AM
19 points
3 comments8 min readEA link

Ten Com­mand­ments for Aspiring Superforecasters

Vasco Grilo🔸Feb 20, 2024, 1:01 PM
13 points
2 comments1 min readEA link
(goodjudgment.com)

A tril­ogy on anti-philan­thropic misdirection

Richard Y Chappell🔸Apr 5, 2024, 4:39 PM
103 points
12 comments1 min readEA link
(rychappell.substack.com)

Deep athe­ism and AI risk

Joe_CarlsmithJan 4, 2024, 6:58 PM
65 points
4 comments1 min readEA link

An Evolu­tion­ary Ar­gu­ment un­der­min­ing Longter­mist think­ing?

Jim BuhlerMar 3, 2025, 2:47 PM
22 points
10 comments8 min readEA link

Disagree Smarter, a schema:

kungfuhobbitMar 6, 2025, 1:53 AM
20 points
0 comments1 min readEA link

AI Safety is Drop­ping the Ball on Clown Attacks

trevor1Oct 21, 2023, 11:15 PM
−17 points
0 comments1 min readEA link

The Wages of North-At­lantic Bias

Sach WryAug 19, 2022, 12:34 PM
8 points
2 comments17 min readEA link

Cap­i­tal­ism, power and episte­mol­ogy: a cri­tique of EA

Matthew_DoranAug 22, 2022, 2:20 PM
14 points
19 comments23 min readEA link

Paper sum­mary: The Epistemic Challenge to Longter­mism (Chris­tian Tarsney)

Global Priorities InstituteOct 11, 2022, 11:29 AM
39 points
5 comments4 min readEA link
(globalprioritiesinstitute.org)

An episte­mol­ogy for effec­tive al­tru­ism?

Benjamin_ToddSep 21, 2014, 9:46 PM
22 points
19 comments3 min readEA link

Be less trust­ing of in­tu­itive ar­gu­ments about so­cial phe­nom­ena

Nathan_BarnardDec 18, 2022, 1:11 AM
43 points
20 comments4 min readEA link

When should you trust your in­tu­ition/​gut check/​hunch over ex­plicit rea­son­ing?

SharmakeSep 5, 2022, 10:18 PM
9 points
0 comments1 min readEA link
(80000hours.org)

Red team­ing a model for es­ti­mat­ing the value of longter­mist in­ter­ven­tions—A cri­tique of Tarsney’s “The Epistemic Challenge to Longter­mism”

Anjay FJul 16, 2022, 7:05 PM
21 points
0 comments30 min readEA link

The Role of “Economism” in the Belief-For­ma­tion Sys­tems of Effec­tive Altruism

Thomas AitkenSep 1, 2022, 7:33 AM
28 points
3 comments10 min readEA link
(drive.google.com)

Multi-Fac­tor De­ci­sion Mak­ing Math

Elliot TempleOct 30, 2022, 4:46 PM
2 points
13 comments37 min readEA link
(criticalfallibilism.com)

Against Modest Epistemology

EliezerYudkowskyNov 14, 2017, 9:26 PM
18 points
11 comments15 min readEA link

[Question] I’m col­lect­ing con­tent that show­cases epistemic virtues, any sug­ges­tions?

Alejandro AcelasJul 31, 2022, 12:15 PM
10 points
2 comments1 min readEA link

Effec­tive Altru­ism’s Im­plicit Epistemology

Violet HourOct 18, 2022, 1:38 PM
129 points
12 comments28 min readEA link

An Episte­molog­i­cal Ac­count of In­tu­itions in Science

Eleni_ASep 3, 2022, 11:21 PM
5 points
0 comments17 min readEA link

Pre­fer be­liefs to cre­dence probabilities

Noah ScalesSep 1, 2022, 2:04 AM
3 points
1 comment4 min readEA link

LW4EA: Epistemic Legibility

JeremyAug 16, 2022, 3:55 PM
5 points
2 comments3 min readEA link
(www.lesswrong.com)

Up­date your be­liefs with a “Yes/​No de­bate”

jorgesNov 3, 2022, 12:05 AM
18 points
4 comments4 min readEA link

We in­ter­viewed 15 China-fo­cused re­searchers on how to do good research

gabriel_wagnerDec 19, 2022, 7:08 PM
49 points
4 comments23 min readEA link

On Solv­ing Prob­lems Be­fore They Ap­pear: The Weird Episte­molo­gies of Alignment

adamShimiOct 11, 2021, 8:21 AM
28 points
0 comments15 min readEA link

My notes on: Se­quence think­ing vs. cluster thinking

Vasco Grilo🔸May 25, 2022, 3:03 PM
24 points
0 comments5 min readEA link

There is no royal road to al­ign­ment

Eleni_ASep 17, 2022, 1:24 PM
18 points
2 comments3 min readEA link

Who or­dered al­ign­ment’s ap­ple?

Eleni_AAug 28, 2022, 2:24 PM
5 points
0 comments3 min readEA link

A new Heuris­tic to Up­date on the Cre­dences of Others

aaron_maiJan 16, 2023, 11:35 AM
22 points
4 comments20 min readEA link

Epistemic health is a com­mu­nity issue

ConcernedEAsFeb 2, 2023, 3:59 PM
12 points
11 comments9 min readEA link

[Linkpost] Michael Hue­mer on the case for Bayesian statistics

John G. HalsteadFeb 7, 2023, 5:52 PM
20 points
2 comments1 min readEA link

Let’s make the truth eas­ier to find

DPiepgrassMar 20, 2023, 4:28 AM
36 points
8 comments24 min readEA link

Sen­tien­tism: Im­prov­ing the hu­man episte­mol­ogy and ethics baseline

JamieWoodhouseMar 27, 2019, 3:34 PM
8 points
6 comments1 min readEA link

Es­ti­ma­tion for san­ity checks

NunoSempereMar 21, 2023, 12:13 AM
64 points
7 comments4 min readEA link
(nunosempere.com)

AI Risk and Sur­vivor­ship Bias—How An­dreessen and LeCun got it wrong

stepanlosJul 14, 2023, 5:10 PM
5 points
1 comment6 min readEA link

Ex­pert trap: Ways out (Part 3 of 3) – how hind­sight, hi­er­ar­chy, and con­fir­ma­tion bi­ases break con­duc­tivity and ac­cu­racy of knowledge

Pawel SysiakJul 22, 2023, 1:05 PM
2 points
0 comments9 min readEA link

The space of sys­tems and the space of maps

Jan_KulveitMar 22, 2023, 4:05 PM
12 points
0 comments5 min readEA link
(www.lesswrong.com)

New­comb’s Para­dox Explained

Alex VellinsMar 31, 2023, 9:26 PM
2 points
11 comments2 min readEA link

EA is un­der­es­ti­mat­ing in­tel­li­gence agen­cies and this is dangerous

trevor1Aug 26, 2023, 4:52 PM
28 points
4 comments10 min readEA link

Ex­pert trap: What is it? (Part 1 of 3) – how hind­sight, hi­er­ar­chy, and con­fir­ma­tion bi­ases break con­duc­tivity and ac­cu­racy of knowledge

Pawel SysiakJun 6, 2023, 3:05 PM
3 points
0 comments8 min readEA link

Ex­pert trap (Part 2 of 3) – how hind­sight, hi­er­ar­chy, and con­fir­ma­tion bi­ases break con­duc­tivity and ac­cu­racy of knowledge

Pawel SysiakJun 9, 2023, 10:53 PM
3 points
0 comments7 min readEA link

You are not too “ir­ra­tional” to know your prefer­ences.

Daystar EldNov 26, 2024, 3:01 PM
73 points
1 comment1 min readEA link

An­nounc­ing the First Work­shop on the Eco­nomics of Pan­demic Preparedness

matteoApr 3, 2024, 11:18 AM
3 points
0 comments1 min readEA link

How Do We Know What We Know: The Tri­par­tite The­ory of Knowl­edge

Siya SawhneyJul 6, 2024, 10:18 AM
2 points
1 comment3 min readEA link

Con­ta­gious Beliefs—Si­mu­lat­ing Poli­ti­cal Alignment

Non-zero-sum JamesOct 13, 2024, 1:38 AM
4 points
3 comments2 min readEA link
(nonzerosum.games)

How did you up­date on AI Safety in 2023?

Chris LeongJan 23, 2024, 2:21 AM
30 points
5 comments1 min readEA link

Differ­en­tial knowl­edge interconnection

Roman LeventovOct 12, 2024, 12:52 PM
3 points
1 comment1 min readEA link

An am­bi­tious pro­ject of re­defin­ing what sci­ence is based on pro­cess philosophy

Michał TerpiłowskiOct 18, 2024, 5:14 AM
0 points
0 comments1 min readEA link
(youtu.be)

Value capture

Erich_Grunewald 🔸Oct 26, 2024, 10:46 PM
37 points
0 comments2 min readEA link
(jesp.org)

what to know about words 30ish points on words that i think are some­what non-triv­ial?

danilooooFeb 7, 2025, 2:39 PM
−7 points
0 comments11 min readEA link

Towards the Oper­a­tional­iza­tion of Philos­o­phy & Wisdom

Thane RuthenisOct 28, 2024, 7:45 PM
1 point
1 comment1 min readEA link
(aiimpacts.org)

AI & wis­dom 1: wis­dom, amor­tised op­ti­mi­sa­tion, and AI

L Rudolf LOct 29, 2024, 1:37 PM
14 points
0 comments1 min readEA link
(rudolf.website)

The Quest for a Stone-Free World: Chanca Pie­dra (Phyl­lan­thus niruri) as an Acute and Pro­phy­lac­tic Treat­ment for Kid­ney Stones and Their As­so­ci­ated Ex­treme Nega­tive Valence

algekalipsoFeb 18, 2025, 12:08 AM
70 points
10 comments32 min readEA link

Inescapably Value-Laden Ex­pe­rience—Can We Make Mo­ral­ity Ra­tion­al­is­able?

Non-zero-sum JamesJan 15, 2025, 12:13 AM
2 points
7 comments2 min readEA link
(nonzerosum.games)

[Question] Look­ing for Quick, Col­lab­o­ra­tive Sys­tems for Truth-Seek­ing in Group Disagreements

EffectiveAdvocate🔸Jan 21, 2025, 6:32 AM
10 points
1 comment1 min readEA link

Win­ning isn’t enough

Anthony DiGiovanniNov 5, 2024, 11:43 AM
31 points
3 comments1 min readEA link

The Mo­ral Illu­sion: What Hap­pens When We Real­ize Ethics Was Never Real?

Aaron ClarkeMar 1, 2025, 8:35 PM
2 points
5 comments24 min readEA link
No comments.