Differ­en­tial progress

TagLast edit: 1 Aug 2021 10:10 UTC by EA Wiki assistant

Differential progress is the hastening of risk-reducing progress and the delaying of risk-increasing progress.

Differential progress can be regarded as a generalization of the proposal, first made by Nick Bostrom, to accelerate risk-reducing technological progress and retard risk-increasing technological progress (Bostrom 2002: sect. 9.4). This proposal, which Bostrom calls differential technological development, was originally offered as an alternative to the view that technological progress as a whole should be slowed down in response to concerns about existential risk. As Bostrom argued, since technology has the potential to both increase and decrease risk, the appropriate response is to handle technologies with different effects on risk differently, rather than having a general policy of technological retardation. In more recent publications, Bostrom understands “technology” in a very broad sense, to include “not only gadgets but also methods, techniques and institution design principles” (Bostrom 2009: 551) and “scientific ideas, institutional designs, organizational techniques, ideologies, concepts, and memes” (Bostrom 2019: 458). When the notion of differential technological development is combined with this expansive understanding of technology, it becomes roughly equivalent to differential progress, rather than a special case of it.

The term “differential intellectual progress” is sometimes used as a synonym for “differential progress”, though it may also be used more restrictively to exclude non-intellectual forms of progress (cf. Muehlhauser & Salamon 2012; Tomasik 2015).


Aird, Michael (2020) Collection of all prior work I found that explicitly uses the terms differential progress /​ intellectual progress /​ technological development, Effective Altruism Forum, February 24.
Many additional resources on this topic.

Beckstead, Nick (2015a) Differential technological development: some early thinking, The GiveWell Blog, September 30 (updated 26 July 2016).
An application of the concept of differential progress to artificial intelligence research.

Beckstead, Nick (2015b) Simple DTD model, GiveWell.
The model described in 2015a.

Bostrom, Nick (2002) Existential risks: Analyzing human extinction scenarios and related hazards, Journal of evolution and technology, vol. 9.
Section 9.4 includes a discussion of differential technological development.

Bostrom, Nick (2009) The future of humanity, in Jan Kyrre Berg Olsen, Stig Andur Pedersen & Vincent F. Hendricks (eds.) A Companion to the Philosophy of Technology, Oxford: Wiley-Blackwell, pp. 551–557.

Bostrom, Nick (2019) The vulnerable world hypothesis, Global Policy, vol. 10, pp. 455–476.

Christiano, Paul (2014) On progress and prosperity, Effective Altruism Forum, October 15.
Argument that differential progress is extremely important from an altruistic perspective.

Muehlhauser, Luke & Anna Salamon (2012) Intelligence explosion: evidence and import, in Amnon Eden et al. (eds.) Singularity Hypotheses: A Scientific and Philosophical Assessment, Berlin: Springer, pp. 15–40.

Tomasik, Brian (2015) Differential intellectual progress as a positive-sum project, Center on Long-Term Risk, December 21.
A report on its implications.

Wikipedia (2006) Differential technological development, Wikipedia, (updated 1 April 2021).
A summary of its progress.

Related entries

accidental harm | anthropogenic existential risk | cultural lag | economic growth | scientific progress | speeding up development | vulnerable world hypothesis

Differ­en­tial progress /​ in­tel­lec­tual progress /​ tech­nolog­i­cal development

MichaelA24 Apr 2020 14:08 UTC
32 points
14 comments7 min readEA link

Effects of anti-ag­ing re­search on the long-term future

Matthew_Barnett27 Feb 2020 22:42 UTC
54 points
33 comments4 min readEA link

Im­prov­ing the fu­ture by in­fluenc­ing ac­tors’ benev­olence, in­tel­li­gence, and power

MichaelA20 Jul 2020 10:00 UTC
62 points
15 comments17 min readEA link

Differ­en­tial tech­nolog­i­cal de­vel­op­ment

velutvulpes25 Jun 2020 10:54 UTC
29 points
7 comments5 min readEA link

Ex­is­ten­tial Risk and Eco­nomic Growth

leopold3 Sep 2019 13:23 UTC
121 points
30 comments1 min readEA link

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #1 - Sum­mary of the Paper

Alex HT21 Jun 2020 9:22 UTC
56 points
7 comments9 min readEA link

On Progress and Prosperity

Paul_Christiano15 Oct 2014 7:03 UTC
37 points
33 commentsEA link

Ad­dress­ing Global Poverty as a Strat­egy to Im­prove the Long-Term Future

bshumway7 Aug 2020 6:27 UTC
38 points
18 comments16 min readEA link

Su­per-ex­po­nen­tial growth im­plies that ac­cel­er­at­ing growth is unim­por­tant in the long run

kbog11 Aug 2020 7:20 UTC
36 points
9 comments4 min readEA link

Risks from Atom­i­cally Pre­cise Manufacturing

MichaelA25 Aug 2020 9:53 UTC
26 points
2 comments2 min readEA link

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #2 - A Crit­i­cal Look at Model Conclusions

Ben_Snodin18 Aug 2020 10:25 UTC
57 points
8 comments17 min readEA link

‘Ex­is­ten­tial Risk and Growth’ Deep Dive #3 - Ex­ten­sions and Variations

Alex HT20 Dec 2020 12:39 UTC
5 points
0 comments12 min readEA link

Robert Wiblin: Mak­ing sense of long-term in­di­rect effects

EA Global6 Aug 2016 0:40 UTC
8 points
0 comments16 min readEA link

Progress stud­ies vs. longter­mist EA: some differences

Max_Daniel31 May 2021 21:35 UTC
75 points
26 comments3 min readEA link

Help me find the crux be­tween EA/​XR and Progress Studies

jasoncrawford2 Jun 2021 18:47 UTC
102 points
35 comments3 min readEA link

A Sim­ple Model of AGI De­ploy­ment Risk

djbinder9 Jul 2021 9:44 UTC
15 points
0 comments4 min readEA link

Safety reg­u­la­tors: A tool for miti­gat­ing tech­nolog­i­cal risk

JustinShovelain21 Jan 2020 13:09 UTC
10 points
0 comments4 min readEA link

Towards a longter­mist frame­work for eval­u­at­ing democ­racy-re­lated interventions

22tom28 Jul 2021 13:23 UTC
81 points
3 comments36 min readEA link

What would bet­ter sci­ence look like?

C Tilli30 Aug 2021 8:57 UTC
20 points
3 comments5 min readEA link

Pa­trick Col­li­son on Effec­tive Altruism

SamuelKnoche23 Jun 2020 9:04 UTC
74 points
4 comments3 min readEA link

The ap­pli­ca­bil­ity of transsen­tien­tist crit­i­cal path analysis

Peter Sølling11 Aug 2020 11:26 UTC
0 points
2 comments32 min readEA link

If tech progress might be bad, what should we tell peo­ple about it?

Robert_Wiblin16 Feb 2016 10:26 UTC
21 points
18 commentsEA link

[Question] What pre­vi­ous work has been done on fac­tors that af­fect the pace of tech­nolog­i­cal de­vel­op­ment?

Megan Kinniment27 Apr 2021 18:43 UTC
21 points
6 comments1 min readEA link

2019 AI Align­ment Liter­a­ture Re­view and Char­ity Comparison

Larks19 Dec 2019 2:58 UTC
146 points
28 comments62 min readEA link

Does Mo­ral Philos­o­phy Drive Mo­ral Progress?

AppliedDivinityStudies2 Jul 2021 21:22 UTC
37 points
4 comments4 min readEA link

Self-Sus­tain­ing Fields Liter­a­ture Re­view: Tech­nol­ogy Fore­cast­ing, How Aca­demic Fields Emerge, and the Science of Science

Megan Kinniment6 Sep 2021 15:04 UTC
25 points
0 comments8 min readEA link

In­ves­ti­gat­ing how tech­nol­ogy-fo­cused aca­demic fields be­come self-sustaining

Ben_Snodin6 Sep 2021 15:04 UTC
41 points
4 comments44 min readEA link
No comments.