RSS

Differ­en­tial progress

TagLast edit: Jan 18, 2022, 5:38 PM by Leo

Differential progress is the hastening of risk-reducing progress and the delaying of risk-increasing progress.

Differential progress can be regarded as a generalization of the proposal, first made by Nick Bostrom, to accelerate risk-reducing technological progress and retard risk-increasing technological progress.[1] This proposal, which Bostrom calls differential technological development, was originally offered as an alternative to the view that technological progress as a whole should be slowed down in response to concerns about existential risk. As Bostrom argued, since technology has the potential to both increase and decrease risk, the appropriate response is to handle technologies with different effects on risk differently, rather than having a general policy of technological retardation. In more recent publications, Bostrom understands “technology” in a very broad sense, to include “not only gadgets but also methods, techniques and institution design principles”[2] and “scientific ideas, institutional designs, organizational techniques, ideologies, concepts, and memes”.[3] When the notion of differential technological development is combined with this expansive understanding of technology, it becomes roughly equivalent to differential progress, rather than a special case of it.

The term “differential intellectual progress” is sometimes used as a synonym for “differential progress”, though it may also be used more restrictively to exclude non-intellectual forms of progress.[4][5]

Further reading

Aird, Michael (2020) Collection of all prior work I found that explicitly uses the terms differential progress /​ intellectual progress /​ technological development, Effective Altruism Forum, February 24.
Many additional resources on this topic.

Beckstead, Nick (2015) Differential technological development: some early thinking, The GiveWell Blog, September 30 (updated 26 July 2016).
An application of the concept of differential progress to artificial intelligence research.

Christiano, Paul (2014) On progress and prosperity, Effective Altruism Forum, October 15.
Argues that differential progress is extremely important from an altruistic perspective.

Related entries

accidental harm | anthropogenic existential risk | cultural lag | economic growth | scientific progress | speeding up development | vulnerable world hypothesis

  1. ^

    Bostrom, Nick (2002) Existential risks: Analyzing human extinction scenarios and related hazards, Journal of evolution and technology, vol. 9., section 9.4.

  2. ^

    Bostrom, Nick (2009) The future of humanity, in Jan Kyrre Berg Olsen, Stig Andur Pedersen & Vincent F. Hendricks (eds.) A Companion to the Philosophy of Technology, Oxford: Wiley-Blackwell, pp. 551–557, p. 551.

  3. ^

    Bostrom, Nick (2019) The vulnerable world hypothesis, Global Policy, vol. 10, pp. 455–476, p. 458.

  4. ^

    Muehlhauser, Luke & Anna Salamon (2012) Intelligence explosion: evidence and import, in Amnon Eden et al. (eds.) Singularity Hypotheses: A Scientific and Philosophical Assessment, Berlin: Springer, pp. 15–40.

  5. ^

    Tomasik, Brian (2015) Differential intellectual progress as a positive-sum project, Center on Long-Term Risk, December 21.

Differ­en­tial progress /​ in­tel­lec­tual progress /​ tech­nolog­i­cal development

MichaelA🔸Apr 24, 2020, 2:08 PM
47 points
16 comments7 min readEA link

Differ­en­tial tech­nol­ogy de­vel­op­ment: preprint on the concept

Hamish_HobbsSep 12, 2022, 1:52 PM
65 points
0 comments2 min readEA link

A Sim­ple Model of AGI De­ploy­ment Risk

djbinderJul 9, 2021, 9:44 AM
30 points
0 comments5 min readEA link

“Slower tech de­vel­op­ment” can be about or­der­ing, grad­u­al­ness, or dis­tance from now

MichaelA🔸Nov 14, 2021, 8:58 PM
47 points
3 comments4 min readEA link

Differ­en­tial tech­nolog­i­cal de­vel­op­ment

jamesJun 25, 2020, 10:54 AM
37 points
7 comments5 min readEA link

On Progress and Prosperity

Paul_ChristianoOct 15, 2014, 7:03 AM
69 points
32 comments9 min readEA link

In­tro­duc­ing the AI Ob­jec­tives In­sti­tute’s Re­search: Differ­en­tial Paths to­ward Safe and Benefi­cial AI

cmckMay 5, 2023, 8:26 PM
43 points
1 comment8 min readEA link

[Video] How hav­ing Fast Fourier Trans­forms sooner could have helped with Nu­clear Disar­ma­ment—Veritasium

mako yassNov 3, 2022, 8:52 PM
12 points
1 comment1 min readEA link
(www.youtube.com)

Differ­en­tial knowl­edge interconnection

Roman LeventovOct 12, 2024, 12:52 PM
3 points
1 comment1 min readEA link

Slow­ing down AI progress is an un­der­ex­plored al­ign­ment strategy

Michael HuangJul 13, 2022, 3:22 AM
92 points
11 comments3 min readEA link
(www.lesswrong.com)

Effects of anti-ag­ing re­search on the long-term future

Matthew_BarnettFeb 27, 2020, 10:42 PM
61 points
33 comments4 min readEA link

A Frame­work for Tech­ni­cal Progress on Biosecurity

kyle_fishNov 3, 2021, 10:57 AM
85 points
1 comment9 min readEA link

Im­prov­ing the fu­ture by in­fluenc­ing ac­tors’ benev­olence, in­tel­li­gence, and power

MichaelA🔸Jul 20, 2020, 10:00 AM
76 points
15 comments17 min readEA link

Brian To­masik – Differ­en­tial In­tel­lec­tual Progress as a Pos­i­tive-Sum Project

Tessa A 🔸Oct 23, 2013, 11:31 PM
28 points
0 comments1 min readEA link
(longtermrisk.org)

Su­per-ex­po­nen­tial growth im­plies that ac­cel­er­at­ing growth is unim­por­tant in the long run

kbogAug 11, 2020, 7:20 AM
36 points
9 comments4 min readEA link

Risks from Atom­i­cally Pre­cise Manufacturing

MichaelA🔸Aug 25, 2020, 9:53 AM
29 points
4 comments2 min readEA link
(www.openphilanthropy.org)

Progress stud­ies vs. longter­mist EA: some differences

Max_DanielMay 31, 2021, 9:35 PM
84 points
27 comments3 min readEA link

Differ­en­tial Tech­nolog­i­cal Devel­op­ment: Some Early Thinking

Nick_BecksteadSep 29, 2015, 10:23 AM
4 points
0 comments9 min readEA link
(blog.givewell.org)

Robert Wiblin: Mak­ing sense of long-term in­di­rect effects

EA GlobalAug 6, 2016, 12:40 AM
14 points
0 comments17 min readEA link
(www.youtube.com)

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #1 - Sum­mary of the Paper

Alex HTJun 21, 2020, 9:22 AM
64 points
7 comments9 min readEA link

Safety reg­u­la­tors: A tool for miti­gat­ing tech­nolog­i­cal risk

JustinShovelainJan 21, 2020, 1:09 PM
10 points
0 comments4 min readEA link

The His­tory, Episte­mol­ogy and Strat­egy of Tech­nolog­i­cal Res­traint, and les­sons for AI (short es­say)

MMMaasAug 10, 2022, 11:00 AM
90 points
6 comments9 min readEA link
(verfassungsblog.de)

Towards a longter­mist frame­work for eval­u­at­ing democ­racy-re­lated interventions

Tom Barnes🔸Jul 28, 2021, 1:23 PM
96 points
5 comments30 min readEA link

Ex­is­ten­tial Risk and Eco­nomic Growth

leopoldSep 3, 2019, 1:23 PM
112 points
31 comments1 min readEA link

Ad­dress­ing Global Poverty as a Strat­egy to Im­prove the Long-Term Future

bshumwayAug 7, 2020, 6:27 AM
40 points
18 comments16 min readEA link

Im­prov­ing sci­ence: In­fluenc­ing the di­rec­tion of re­search and the choice of re­search questions

C TilliDec 20, 2021, 10:20 AM
65 points
13 comments15 min readEA link

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #3 - Ex­ten­sions and Variations

Alex HTDec 20, 2020, 12:39 PM
5 points
0 comments12 min readEA link

Help me find the crux be­tween EA/​XR and Progress Studies

jasoncrawfordJun 2, 2021, 6:47 PM
119 points
37 comments3 min readEA link

Restrict­ing brain organoid re­search to slow down AGI

freedomandutilityNov 9, 2022, 1:01 PM
8 points
2 comments1 min readEA link

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #2 - A Crit­i­cal Look at Model Conclusions

Ben SnodinAug 18, 2020, 10:25 AM
58 points
11 comments17 min readEA link

What would bet­ter sci­ence look like?

C TilliAug 30, 2021, 8:57 AM
24 points
3 comments5 min readEA link

Katja Grace: Let’s think about slow­ing down AI

peterhartreeDec 23, 2022, 12:57 AM
84 points
6 comments2 min readEA link
(worldspiritsockpuppet.substack.com)

Let’s think about slow­ing down AI

Katja_GraceDec 23, 2022, 7:56 PM
334 points
9 comments1 min readEA link

AI Tools for Ex­is­ten­tial Security

LizkaMar 14, 2025, 6:37 PM
43 points
2 comments11 min readEA link
(www.forethought.org)

En­light­en­ment Values in a Vuln­er­a­ble World

Maxwell TabarrokJul 18, 2022, 11:54 AM
66 points
18 comments31 min readEA link

Pro­ject ideas: Epistemics

Lukas FinnvedenJan 4, 2024, 7:26 AM
43 points
1 comment17 min readEA link
(lukasfinnveden.substack.com)

Cog­ni­tive as­sets and defen­sive acceleration

JulianHazellApr 3, 2024, 2:55 PM
13 points
3 comments4 min readEA link
(muddyclothes.substack.com)

Re­port on the De­sir­a­bil­ity of Science Given New Biotech Risks

Matt ClancyJan 17, 2024, 7:42 PM
78 points
23 comments4 min readEA link

On the Value of Ad­vanc­ing Progress

Toby_OrdJul 11, 2024, 11:20 AM
119 points
39 comments9 min readEA link

What’s im­por­tant in “AI for epistemics”?

Lukas FinnvedenAug 24, 2024, 1:27 AM
66 points
1 comment1 min readEA link
(lukasfinnveden.substack.com)

My Cur­rent Claims and Cruxes on LLM Fore­cast­ing & Epistemics

Ozzie GooenJun 26, 2024, 12:40 AM
46 points
7 comments24 min readEA link

AI safety tax dynamics

Owen Cotton-BarrattOct 23, 2024, 12:21 PM
21 points
9 comments6 min readEA link
(strangecities.substack.com)

Win­ners of the Es­say com­pe­ti­tion on the Au­toma­tion of Wis­dom and Philosophy

Owen Cotton-BarrattOct 29, 2024, 12:02 AM
37 points
2 comments30 min readEA link
(blog.aiimpacts.org)

Pri­ori­ti­za­tion Re­search for Ad­vanc­ing Wis­dom and Intelligence

Ozzie GooenOct 18, 2021, 10:22 PM
88 points
34 comments5 min readEA link

Which AI Safety Org to Join?

Yonatan CaleOct 11, 2022, 7:42 PM
17 points
21 comments1 min readEA link

De­lay, De­tect, Defend: Prepar­ing for a Fu­ture in which Thou­sands Can Re­lease New Pan­demics by Kevin Esvelt

JeremyNov 15, 2022, 4:23 PM
177 points
7 comments1 min readEA link
(dam.gcsp.ch)

If tech progress might be bad, what should we tell peo­ple about it?

Robert_WiblinFeb 16, 2016, 10:26 AM
21 points
18 comments2 min readEA link

Does Mo­ral Philos­o­phy Drive Mo­ral Progress?

AppliedDivinityStudiesJul 2, 2021, 9:22 PM
38 points
4 comments4 min readEA link

[Question] Slow­ing down AI progress?

Eleni_AJul 26, 2022, 8:46 AM
16 points
9 comments1 min readEA link

Katja Grace on Slow­ing Down AI, AI Ex­pert Sur­veys And Es­ti­mat­ing AI Risk

Michaël TrazziSep 16, 2022, 6:00 PM
48 points
6 comments3 min readEA link
(theinsideview.ai)

Le­gal As­sis­tance for Vic­tims of AI

bobMar 17, 2023, 11:42 AM
52 points
19 comments1 min readEA link

A note about differ­en­tial tech­nolog­i­cal development

So8resJul 24, 2022, 11:41 PM
58 points
8 comments6 min readEA link

The ap­pli­ca­bil­ity of transsen­tien­tist crit­i­cal path analysis

Peter SøllingAug 11, 2020, 11:26 AM
0 points
2 comments32 min readEA link
(www.optimalaltruism.com)

Self-Sus­tain­ing Fields Liter­a­ture Re­view: Tech­nol­ogy Fore­cast­ing, How Aca­demic Fields Emerge, and the Science of Science

Megan KinnimentSep 6, 2021, 3:04 PM
27 points
0 comments6 min readEA link

De­sign­ing Ar­tifi­cial Wis­dom: De­ci­sion Fore­cast­ing AI & Futarchy

Jordan ArelJul 14, 2024, 5:10 AM
5 points
1 comment6 min readEA link

Cause Area: Differ­en­tial Neu­rotech­nol­ogy Development

mwcvitkovicAug 10, 2022, 2:39 AM
95 points
7 comments36 min readEA link

In­stead of tech­ni­cal re­search, more peo­ple should fo­cus on buy­ing time

AkashNov 5, 2022, 8:43 PM
107 points
31 comments1 min readEA link

Against Mak­ing Up Our Con­scious Minds

SilicaFeb 10, 2024, 7:12 AM
13 points
0 comments5 min readEA link

We Prob­a­bly Shouldn’t Solve Consciousness

SilicaFeb 10, 2024, 7:12 AM
33 points
5 comments16 min readEA link

Balanc­ing safety and waste

Daniel_FriedrichMar 17, 2024, 10:57 AM
6 points
0 comments7 min readEA link

Pa­trick Col­li­son on Effec­tive Altruism

SamuelKnocheJun 23, 2020, 9:04 AM
98 points
4 comments3 min readEA link

2019 AI Align­ment Liter­a­ture Re­view and Char­ity Comparison

LarksDec 19, 2019, 2:58 AM
147 points
28 comments62 min readEA link

In­ves­ti­gat­ing how tech­nol­ogy-fo­cused aca­demic fields be­come self-sustaining

Ben SnodinSep 6, 2021, 3:04 PM
43 points
4 comments42 min readEA link

[Question] What pre­vi­ous work has been done on fac­tors that af­fect the pace of tech­nolog­i­cal de­vel­op­ment?

Megan KinnimentApr 27, 2021, 6:43 PM
21 points
6 comments1 min readEA link
No comments.