RSS

Differ­en­tial progress

TagLast edit: 18 Jan 2022 17:38 UTC by Leo

Differential progress is the hastening of risk-reducing progress and the delaying of risk-increasing progress.

Differential progress can be regarded as a generalization of the proposal, first made by Nick Bostrom, to accelerate risk-reducing technological progress and retard risk-increasing technological progress.[1] This proposal, which Bostrom calls differential technological development, was originally offered as an alternative to the view that technological progress as a whole should be slowed down in response to concerns about existential risk. As Bostrom argued, since technology has the potential to both increase and decrease risk, the appropriate response is to handle technologies with different effects on risk differently, rather than having a general policy of technological retardation. In more recent publications, Bostrom understands “technology” in a very broad sense, to include “not only gadgets but also methods, techniques and institution design principles”[2] and “scientific ideas, institutional designs, organizational techniques, ideologies, concepts, and memes”.[3] When the notion of differential technological development is combined with this expansive understanding of technology, it becomes roughly equivalent to differential progress, rather than a special case of it.

The term “differential intellectual progress” is sometimes used as a synonym for “differential progress”, though it may also be used more restrictively to exclude non-intellectual forms of progress.[4][5]

Further reading

Aird, Michael (2020) Collection of all prior work I found that explicitly uses the terms differential progress /​ intellectual progress /​ technological development, Effective Altruism Forum, February 24.
Many additional resources on this topic.

Beckstead, Nick (2015) Differential technological development: some early thinking, The GiveWell Blog, September 30 (updated 26 July 2016).
An application of the concept of differential progress to artificial intelligence research.

Christiano, Paul (2014) On progress and prosperity, Effective Altruism Forum, October 15.
Argues that differential progress is extremely important from an altruistic perspective.

Related entries

accidental harm | anthropogenic existential risk | cultural lag | economic growth | scientific progress | speeding up development | vulnerable world hypothesis

  1. ^

    Bostrom, Nick (2002) Existential risks: Analyzing human extinction scenarios and related hazards, Journal of evolution and technology, vol. 9., section 9.4.

  2. ^

    Bostrom, Nick (2009) The future of humanity, in Jan Kyrre Berg Olsen, Stig Andur Pedersen & Vincent F. Hendricks (eds.) A Companion to the Philosophy of Technology, Oxford: Wiley-Blackwell, pp. 551–557, p. 551.

  3. ^

    Bostrom, Nick (2019) The vulnerable world hypothesis, Global Policy, vol. 10, pp. 455–476, p. 458.

  4. ^

    Muehlhauser, Luke & Anna Salamon (2012) Intelligence explosion: evidence and import, in Amnon Eden et al. (eds.) Singularity Hypotheses: A Scientific and Philosophical Assessment, Berlin: Springer, pp. 15–40.

  5. ^

    Tomasik, Brian (2015) Differential intellectual progress as a positive-sum project, Center on Long-Term Risk, December 21.

Differ­en­tial progress /​ in­tel­lec­tual progress /​ tech­nolog­i­cal development

MichaelA🔸24 Apr 2020 14:08 UTC
47 points
16 comments7 min readEA link

Differ­en­tial tech­nol­ogy de­vel­op­ment: preprint on the concept

Hamish_Hobbs12 Sep 2022 13:52 UTC
65 points
0 comments2 min readEA link

A Sim­ple Model of AGI De­ploy­ment Risk

djbinder9 Jul 2021 9:44 UTC
30 points
0 comments5 min readEA link

“Slower tech de­vel­op­ment” can be about or­der­ing, grad­u­al­ness, or dis­tance from now

MichaelA🔸14 Nov 2021 20:58 UTC
47 points
3 comments4 min readEA link

Differ­en­tial tech­nolog­i­cal de­vel­op­ment

james25 Jun 2020 10:54 UTC
37 points
7 comments5 min readEA link

On Progress and Prosperity

Paul_Christiano15 Oct 2014 7:03 UTC
68 points
32 comments9 min readEA link

In­tro­duc­ing the AI Ob­jec­tives In­sti­tute’s Re­search: Differ­en­tial Paths to­ward Safe and Benefi­cial AI

cmck5 May 2023 20:26 UTC
43 points
1 comment8 min readEA link

[Video] How hav­ing Fast Fourier Trans­forms sooner could have helped with Nu­clear Disar­ma­ment—Veritasium

mako yass3 Nov 2022 20:52 UTC
12 points
1 comment1 min readEA link
(www.youtube.com)

Differ­en­tial knowl­edge interconnection

Roman Leventov12 Oct 2024 12:52 UTC
3 points
1 comment1 min readEA link

Slow­ing down AI progress is an un­der­ex­plored al­ign­ment strategy

Michael Huang13 Jul 2022 3:22 UTC
92 points
11 comments3 min readEA link
(www.lesswrong.com)

Effects of anti-ag­ing re­search on the long-term future

Matthew_Barnett27 Feb 2020 22:42 UTC
61 points
33 comments4 min readEA link

A Frame­work for Tech­ni­cal Progress on Biosecurity

kyle_fish3 Nov 2021 10:57 UTC
84 points
1 comment9 min readEA link

Im­prov­ing the fu­ture by in­fluenc­ing ac­tors’ benev­olence, in­tel­li­gence, and power

MichaelA🔸20 Jul 2020 10:00 UTC
76 points
15 comments17 min readEA link

Brian To­masik – Differ­en­tial In­tel­lec­tual Progress as a Pos­i­tive-Sum Project

Tessa A 🔸23 Oct 2013 23:31 UTC
28 points
0 comments1 min readEA link
(longtermrisk.org)

Su­per-ex­po­nen­tial growth im­plies that ac­cel­er­at­ing growth is unim­por­tant in the long run

kbog11 Aug 2020 7:20 UTC
36 points
9 comments4 min readEA link

Risks from Atom­i­cally Pre­cise Manufacturing

MichaelA🔸25 Aug 2020 9:53 UTC
29 points
4 comments2 min readEA link
(www.openphilanthropy.org)

Progress stud­ies vs. longter­mist EA: some differences

Max_Daniel31 May 2021 21:35 UTC
84 points
27 comments3 min readEA link

Differ­en­tial Tech­nolog­i­cal Devel­op­ment: Some Early Thinking

Nick_Beckstead29 Sep 2015 10:23 UTC
4 points
0 comments9 min readEA link
(blog.givewell.org)

Robert Wiblin: Mak­ing sense of long-term in­di­rect effects

EA Global6 Aug 2016 0:40 UTC
14 points
0 comments17 min readEA link
(www.youtube.com)

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #1 - Sum­mary of the Paper

Alex HT21 Jun 2020 9:22 UTC
64 points
7 comments9 min readEA link

Safety reg­u­la­tors: A tool for miti­gat­ing tech­nolog­i­cal risk

JustinShovelain21 Jan 2020 13:09 UTC
10 points
0 comments4 min readEA link

The His­tory, Episte­mol­ogy and Strat­egy of Tech­nolog­i­cal Res­traint, and les­sons for AI (short es­say)

MMMaas10 Aug 2022 11:00 UTC
90 points
6 comments9 min readEA link
(verfassungsblog.de)

Towards a longter­mist frame­work for eval­u­at­ing democ­racy-re­lated interventions

Tom Barnes28 Jul 2021 13:23 UTC
96 points
5 comments30 min readEA link

Ex­is­ten­tial Risk and Eco­nomic Growth

leopold3 Sep 2019 13:23 UTC
112 points
31 comments1 min readEA link

Ad­dress­ing Global Poverty as a Strat­egy to Im­prove the Long-Term Future

bshumway7 Aug 2020 6:27 UTC
40 points
18 comments16 min readEA link

Im­prov­ing sci­ence: In­fluenc­ing the di­rec­tion of re­search and the choice of re­search questions

C Tilli20 Dec 2021 10:20 UTC
65 points
13 comments15 min readEA link

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #3 - Ex­ten­sions and Variations

Alex HT20 Dec 2020 12:39 UTC
5 points
0 comments12 min readEA link

Help me find the crux be­tween EA/​XR and Progress Studies

jasoncrawford2 Jun 2021 18:47 UTC
119 points
37 comments3 min readEA link

Restrict­ing brain organoid re­search to slow down AGI

freedomandutility9 Nov 2022 13:01 UTC
8 points
2 comments1 min readEA link

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #2 - A Crit­i­cal Look at Model Conclusions

Ben Snodin18 Aug 2020 10:25 UTC
58 points
11 comments17 min readEA link

What would bet­ter sci­ence look like?

C Tilli30 Aug 2021 8:57 UTC
24 points
3 comments5 min readEA link

Katja Grace: Let’s think about slow­ing down AI

peterhartree23 Dec 2022 0:57 UTC
84 points
6 comments2 min readEA link
(worldspiritsockpuppet.substack.com)

Let’s think about slow­ing down AI

Katja_Grace23 Dec 2022 19:56 UTC
334 points
9 comments1 min readEA link

En­light­en­ment Values in a Vuln­er­a­ble World

Maxwell Tabarrok18 Jul 2022 11:54 UTC
66 points
18 comments31 min readEA link

Pro­ject ideas: Epistemics

Lukas Finnveden4 Jan 2024 7:26 UTC
43 points
1 comment17 min readEA link
(lukasfinnveden.substack.com)

Pri­ori­ti­za­tion Re­search for Ad­vanc­ing Wis­dom and Intelligence

Ozzie Gooen18 Oct 2021 22:22 UTC
88 points
34 comments5 min readEA link

Cog­ni­tive as­sets and defen­sive acceleration

JulianHazell3 Apr 2024 14:55 UTC
13 points
3 comments4 min readEA link
(muddyclothes.substack.com)

Re­port on the De­sir­a­bil­ity of Science Given New Biotech Risks

Matt Clancy17 Jan 2024 19:42 UTC
78 points
23 comments4 min readEA link

On the Value of Ad­vanc­ing Progress

Toby_Ord11 Jul 2024 11:20 UTC
119 points
39 comments9 min readEA link

What’s im­por­tant in “AI for epistemics”?

Lukas Finnveden24 Aug 2024 1:27 UTC
66 points
1 comment1 min readEA link
(lukasfinnveden.substack.com)

My Cur­rent Claims and Cruxes on LLM Fore­cast­ing & Epistemics

Ozzie Gooen26 Jun 2024 0:40 UTC
44 points
7 comments24 min readEA link

AI safety tax dynamics

Owen Cotton-Barratt23 Oct 2024 12:21 UTC
21 points
9 comments6 min readEA link
(strangecities.substack.com)

Win­ners of the Es­say com­pe­ti­tion on the Au­toma­tion of Wis­dom and Philosophy

Owen Cotton-Barratt29 Oct 2024 0:02 UTC
36 points
2 comments30 min readEA link
(blog.aiimpacts.org)

[Question] What pre­vi­ous work has been done on fac­tors that af­fect the pace of tech­nolog­i­cal de­vel­op­ment?

Megan Kinniment27 Apr 2021 18:43 UTC
21 points
6 comments1 min readEA link

Which AI Safety Org to Join?

Yonatan Cale11 Oct 2022 19:42 UTC
17 points
21 comments1 min readEA link

De­lay, De­tect, Defend: Prepar­ing for a Fu­ture in which Thou­sands Can Re­lease New Pan­demics by Kevin Esvelt

Jeremy15 Nov 2022 16:23 UTC
177 points
7 comments1 min readEA link
(dam.gcsp.ch)

If tech progress might be bad, what should we tell peo­ple about it?

Robert_Wiblin16 Feb 2016 10:26 UTC
21 points
18 comments2 min readEA link

Le­gal As­sis­tance for Vic­tims of AI

bob17 Mar 2023 11:42 UTC
52 points
19 comments1 min readEA link

[Question] Slow­ing down AI progress?

Eleni_A26 Jul 2022 8:46 UTC
16 points
9 comments1 min readEA link

Katja Grace on Slow­ing Down AI, AI Ex­pert Sur­veys And Es­ti­mat­ing AI Risk

Michaël Trazzi16 Sep 2022 18:00 UTC
48 points
6 comments3 min readEA link
(theinsideview.ai)

The ap­pli­ca­bil­ity of transsen­tien­tist crit­i­cal path analysis

Peter Sølling11 Aug 2020 11:26 UTC
0 points
2 comments32 min readEA link
(www.optimalaltruism.com)

A note about differ­en­tial tech­nolog­i­cal development

So8res24 Jul 2022 23:41 UTC
58 points
8 comments6 min readEA link

Self-Sus­tain­ing Fields Liter­a­ture Re­view: Tech­nol­ogy Fore­cast­ing, How Aca­demic Fields Emerge, and the Science of Science

Megan Kinniment6 Sep 2021 15:04 UTC
27 points
0 comments6 min readEA link

Does Mo­ral Philos­o­phy Drive Mo­ral Progress?

AppliedDivinityStudies2 Jul 2021 21:22 UTC
38 points
4 comments4 min readEA link

Against Mak­ing Up Our Con­scious Minds

Silica10 Feb 2024 7:12 UTC
13 points
0 comments5 min readEA link

Cause Area: Differ­en­tial Neu­rotech­nol­ogy Development

mwcvitkovic10 Aug 2022 2:39 UTC
95 points
7 comments36 min readEA link

In­stead of tech­ni­cal re­search, more peo­ple should fo­cus on buy­ing time

Akash5 Nov 2022 20:43 UTC
107 points
31 comments1 min readEA link

We Prob­a­bly Shouldn’t Solve Consciousness

Silica10 Feb 2024 7:12 UTC
33 points
5 comments16 min readEA link

Balanc­ing safety and waste

Daniel_Friedrich17 Mar 2024 10:57 UTC
6 points
0 comments7 min readEA link

De­sign­ing Ar­tifi­cial Wis­dom: De­ci­sion Fore­cast­ing AI & Futarchy

Jordan Arel14 Jul 2024 5:10 UTC
5 points
1 comment6 min readEA link

Pa­trick Col­li­son on Effec­tive Altruism

SamuelKnoche23 Jun 2020 9:04 UTC
98 points
4 comments3 min readEA link

2019 AI Align­ment Liter­a­ture Re­view and Char­ity Comparison

Larks19 Dec 2019 2:58 UTC
147 points
28 comments62 min readEA link

In­ves­ti­gat­ing how tech­nol­ogy-fo­cused aca­demic fields be­come self-sustaining

Ben Snodin6 Sep 2021 15:04 UTC
43 points
4 comments42 min readEA link
No comments.