RSS

AI governance

TagLast edit: 10 May 2021 12:46 UTC by Pablo

AI governance is the study of norms, policies, and institutions that can help humanity navigate the transition to a world with advanced artificial intelligence. This includes a broad range of subjects, from global coordination around regulating AI development to providing incentives for corporations to be more cautious in their AI research.

Bibliography

Flynn, Carrick (2018) AI governance landscape, Effective Altruism, September 25.
Talk on examples of AI governance work.

Related entries

AI alignment | AI forecasting | global governance

AI Gover­nance: Op­por­tu­nity and The­ory of Impact

Allan Dafoe17 Sep 2020 6:30 UTC
163 points
14 comments13 min readEA link

Sin­ga­pore AI Policy Ca­reer Guide

yiyang21 Jan 2021 3:05 UTC
27 points
0 comments5 min readEA link

Per­sonal thoughts on ca­reers in AI policy and strategy

carrickflynn27 Sep 2017 16:52 UTC
56 points
29 commentsEA link

AI Gover­nance Ca­reer Paths for Europeans

careersthrowaway16 May 2020 6:40 UTC
66 points
1 comment12 min readEA link

CSER Ad­vice to EU High-Level Ex­pert Group on AI

HaydnBelfield8 Mar 2019 20:42 UTC
13 points
0 comments5 min readEA link
(www.cser.ac.uk)

Markus An­der­ljung and Ben Garfinkel: Fireside chat on AI governance

EA Global24 Jul 2020 14:56 UTC
24 points
0 comments16 min readEA link
(www.youtube.com)

[Question] Ex­am­ples of self-gov­er­nance to re­duce tech­nol­ogy risk?

Jia25 Sep 2020 13:26 UTC
32 points
1 comment1 min readEA link

Longter­mist rea­sons to work for in­no­va­tive governments

Alexis Carlier13 Oct 2020 16:32 UTC
74 points
8 comments1 min readEA link

Open Philan­thropy’s AI gov­er­nance grant­mak­ing (so far)

Aaron Gertler17 Dec 2020 12:00 UTC
63 points
0 comments6 min readEA link
(www.openphilanthropy.org)

Jade Le­ung: Who do we want to con­trol hu­man-level AI?

EA Global8 Jun 2018 7:15 UTC
8 points
0 comments22 min readEA link
(www.youtube.com)

Car­rick Flynn: AI gov­er­nance landscape

EA Global8 Jun 2018 7:15 UTC
8 points
0 comments11 min readEA link
(www.youtube.com)

[Link post] Co­or­di­na­tion challenges for pre­vent­ing AI conflict

stefan.torges9 Mar 2021 9:39 UTC
48 points
0 comments1 min readEA link
(longtermrisk.org)

Case stud­ies of self-gov­er­nance to re­duce tech­nol­ogy risk

Jia6 Apr 2021 8:49 UTC
46 points
6 comments7 min readEA link

Jade Le­ung: Why com­pa­nies should be lead­ing on AI governance

EA Global15 May 2019 23:37 UTC
28 points
7 comments18 min readEA link
(www.youtube.com)

A new pro­posal for reg­u­lat­ing AI in the EU

EdoArad26 Apr 2021 17:25 UTC
37 points
3 comments1 min readEA link
(www.bbc.com)

Some AI Gover­nance Re­search Ideas

MarkusAnderljung3 Jun 2021 10:51 UTC
86 points
5 comments2 min readEA link

A Viral Li­cense for AI Safety

IvanVendrov5 Jun 2021 2:00 UTC
24 points
6 comments5 min readEA link

A per­sonal take on longter­mist AI governance

lukeprog16 Jul 2021 22:08 UTC
126 points
3 comments12 min readEA link

The Gover­nance Prob­lem and the “Pretty Good” X-Risk

Zach Stein-Perlman28 Aug 2021 20:00 UTC
21 points
4 comments12 min readEA link

FHI Re­port: Stable Agree­ments in Tur­bu­lent Times

Cullen_OKeefe21 Feb 2019 17:12 UTC
25 points
2 comments4 min readEA link
(www.fhi.ox.ac.uk)

FHI Re­port: The Wind­fall Clause: Distribut­ing the Benefits of AI for the Com­mon Good

Cullen_OKeefe5 Feb 2020 23:49 UTC
51 points
19 comments2 min readEA link

An­titrust-Com­pli­ant AI In­dus­try Self-Regulation

Cullen_OKeefe7 Jul 2020 20:52 UTC
26 points
1 comment1 min readEA link
(cullenokeefe.com)

AI Benefits Post 4: Out­stand­ing Ques­tions on Select­ing Benefits

Cullen_OKeefe14 Jul 2020 17:24 UTC
6 points
0 comments5 min readEA link

Le­gal Pri­ori­ties Re­search: A Re­search Agenda

jonasschuett6 Jan 2021 21:47 UTC
58 points
4 comments1 min readEA link

[link] Cen­tre for the Gover­nance of AI 2020 An­nual Report

MarkusAnderljung14 Jan 2021 10:23 UTC
11 points
5 comments1 min readEA link

Is Democ­racy a Fad?

Ben Garfinkel13 Mar 2021 12:40 UTC
133 points
36 comments18 min readEA link

The Cen­tre for the Gover­nance of AI is be­com­ing a nonprofit

MarkusAnderljung9 Jul 2021 10:05 UTC
77 points
4 comments1 min readEA link

[Question] What are the challenges and prob­lems with pro­gram­ming law-break­ing con­straints into AGI?

MichaelStJules2 Feb 2020 20:53 UTC
7 points
34 comments1 min readEA link

AI policy ca­reers in the EU

Lauro Langosco11 Nov 2019 10:43 UTC
55 points
7 comments11 min readEA link

UK policy and poli­tics careers

weeatquince28 Sep 2019 16:18 UTC
28 points
10 comments7 min readEA link

AI & Policy 1/​3: On know­ing the effect of to­day’s poli­cies on Trans­for­ma­tive AI risks, and the case for in­sti­tu­tional im­prove­ments.

weeatquince27 Aug 2019 11:04 UTC
23 points
3 comments10 min readEA link

Good policy ideas that won’t hap­pen (yet)

Niel_Bowerman11 Sep 2014 12:29 UTC
21 points
8 commentsEA link

CSER and FHI ad­vice to UN High-level Panel on Digi­tal Co­op­er­a­tion

HaydnBelfield8 Mar 2019 20:39 UTC
22 points
7 comments6 min readEA link
(www.cser.ac.uk)

An in­ter­ven­tion to shape policy di­alogue, com­mu­ni­ca­tion, and AI re­search norms for AI safety

Lee_Sharkey1 Oct 2017 18:29 UTC
9 points
33 commentsEA link

[Question] Do­ing Global Pri­ori­ties or AI Policy re­search from re­mote lo­ca­tion?

With Love from Israel29 Oct 2019 9:34 UTC
30 points
4 comments1 min readEA link

[Link] Cen­ter for the Gover­nance of AI (GovAI) An­nual Re­port 2018

MarkusAnderljung21 Dec 2018 16:17 UTC
24 points
0 commentsEA link

Some cruxes on im­pact­ful al­ter­na­tives to AI policy work

richard_ngo22 Nov 2018 13:43 UTC
26 points
2 commentsEA link

[Question] What type of Master’s is best for AI policy work?

Milan_Griffes22 Feb 2019 20:04 UTC
13 points
7 comments1 min readEA link

The case for build­ing ex­per­tise to work on US AI policy, and how to do it

80000_Hours31 Jan 2019 22:44 UTC
37 points
2 commentsEA link

[Question] Will AGI cause mass tech­nolog­i­cal un­em­ploy­ment?

evelynciara22 Jun 2020 20:55 UTC
3 points
2 comments2 min readEA link

FHI Re­port: How Will Na­tional Se­cu­rity Con­sid­er­a­tions Affect An­titrust De­ci­sions in AI? An Ex­am­i­na­tion of His­tor­i­cal Precedents

Cullen_OKeefe28 Jul 2020 18:33 UTC
13 points
0 comments1 min readEA link
(www.fhi.ox.ac.uk)

Brian Tse: Sino-Western co­op­er­a­tion in AI safety

EA Global30 Jan 2020 22:02 UTC
8 points
0 comments15 min readEA link
(www.youtube.com)

I’m Cul­len O’Keefe, a Policy Re­searcher at OpenAI, AMA

Cullen_OKeefe11 Jan 2020 4:13 UTC
45 points
68 comments1 min readEA link

AMA: Markus An­der­ljung (PM at GovAI, FHI)

MarkusAnderljung21 Sep 2020 11:23 UTC
49 points
24 comments2 min readEA link

Assess­ing the state of AI R&D in the US, China, and Europe – Part 1: Out­put indicators

stefan.torges1 Nov 2019 14:41 UTC
19 points
1 comment14 min readEA link

Some AI re­search ar­eas and their rele­vance to ex­is­ten­tial safety

critch15 Dec 2020 12:15 UTC
11 points
0 comments56 min readEA link
(alignmentforum.org)

TAI Safety Biblio­graphic Database

Jess_Riedel22 Dec 2020 16:03 UTC
61 points
9 comments17 min readEA link

Baobao Zhang: How so­cial sci­ence re­search can in­form AI governance

EA Global22 Jan 2021 15:10 UTC
9 points
0 comments16 min readEA link
(www.youtube.com)

Po­ten­tial Risks from Ad­vanced AI

EA Global13 Aug 2017 7:00 UTC
8 points
0 comments17 min readEA link

What does (and doesn’t) AI mean for effec­tive al­tru­ism?

EA Global12 Aug 2017 7:00 UTC
8 points
0 comments12 min readEA link

Three Im­pacts of Ma­chine Intelligence

Paul_Christiano23 Aug 2013 10:10 UTC
33 points
4 comments8 min readEA link
(rationalaltruist.com)

Jade Le­ung and Seth Baum: The role of ex­ist­ing in­sti­tu­tions in AI strategy

EA Global8 Jun 2018 7:15 UTC
8 points
0 comments28 min readEA link
(www.youtube.com)

Ross Gruet­zemacher: Defin­ing and un­pack­ing trans­for­ma­tive AI

EA Global18 Oct 2019 8:22 UTC
8 points
0 comments1 min readEA link
(www.youtube.com)

Jeffrey Ding: Re-de­ci­pher­ing China’s AI dream

EA Global18 Oct 2019 18:05 UTC
8 points
0 comments1 min readEA link
(www.youtube.com)

The Im­por­tance of Ar­tifi­cial Sentience

Jamie_Harris3 Mar 2021 17:17 UTC
53 points
10 comments11 min readEA link
(www.sentienceinstitute.org)

Jaan Tal­linn: Fireside chat (2020)

EA Global21 Nov 2020 8:12 UTC
6 points
0 comments1 min readEA link
(www.youtube.com)

Jeffrey Ding: Bring­ing techno-global­ism back: a ro­man­ti­cally re­al­ist re­fram­ing of the US-China tech relationship

EA Global21 Nov 2020 8:12 UTC
6 points
0 comments1 min readEA link
(www.youtube.com)

Allan Dafoe: Prepar­ing for AI — risks and opportunities

EA Global3 Nov 2017 7:43 UTC
6 points
0 comments1 min readEA link
(www.youtube.com)

Sha­har Avin: Near-term AI se­cu­rity risks, and what to do about them

EA Global3 Nov 2017 7:43 UTC
6 points
0 comments1 min readEA link
(www.youtube.com)

Owen Cot­ton-Bar­ratt: What does (and doesn’t) AI mean for effec­tive al­tru­ism?

EA Global11 Aug 2017 8:19 UTC
8 points
0 comments12 min readEA link
(www.youtube.com)

Daniel Dewey: The Open Philan­thropy Pro­ject’s work on po­ten­tial risks from ad­vanced AI

EA Global11 Aug 2017 8:19 UTC
6 points
0 comments17 min readEA link
(www.youtube.com)

The AI rev­olu­tion and in­ter­na­tional poli­tics (Allan Dafoe)

EA Global2 Jun 2017 8:48 UTC
6 points
0 comments18 min readEA link
(www.youtube.com)

Some thoughts on risks from nar­row, non-agen­tic AI

richard_ngo19 Jan 2021 0:07 UTC
34 points
2 comments8 min readEA link

An overview of ar­gu­ments for con­cern about automation

alexlintz6 Aug 2019 7:56 UTC
34 points
3 comments13 min readEA link

[Question] Is there ev­i­dence that recom­mender sys­tems are chang­ing users’ prefer­ences?

zdgroff12 Apr 2021 19:11 UTC
60 points
15 comments1 min readEA link

In­for­ma­tion se­cu­rity ca­reers for GCR reduction

ClaireZabel20 Jun 2019 23:56 UTC
163 points
34 comments8 min readEA link

[Link] EAF Re­search agenda: “Co­op­er­a­tion, Con­flict, and Trans­for­ma­tive Ar­tifi­cial In­tel­li­gence”

stefan.torges17 Jan 2020 13:28 UTC
61 points
0 comments1 min readEA link

Fi­nal Re­port of the Na­tional Se­cu­rity Com­mis­sion on Ar­tifi­cial In­tel­li­gence (NSCAI, 2021)

MichaelA1 Jun 2021 8:19 UTC
51 points
3 comments4 min readEA link
(www.nscai.gov)

Hu­man­i­ties Re­search Ideas for Longtermists

Lizka9 Jun 2021 4:39 UTC
127 points
11 comments15 min readEA link

Shal­low eval­u­a­tions of longter­mist organizations

NunoSempere24 Jun 2021 15:31 UTC
159 points
34 comments34 min readEA link

Mauhn Re­leases AI Safety Documentation

Berg Severens2 Jul 2021 12:19 UTC
4 points
2 comments1 min readEA link

AI Gover­nance Read­ing Group Guide

Alex HT25 Jun 2020 10:16 UTC
24 points
2 comments3 min readEA link

[Question] Books and lec­ture se­ries rele­vant to AI gov­er­nance?

MichaelA18 Jul 2021 15:54 UTC
20 points
8 comments1 min readEA link

AMA: The new Open Philan­thropy Tech­nol­ogy Policy Fellowship

lukeprog26 Jul 2021 15:11 UTC
33 points
16 comments1 min readEA link

Ap­ply to the new Open Philan­thropy Tech­nol­ogy Policy Fel­low­ship!

lukeprog20 Jul 2021 18:41 UTC
77 points
7 comments5 min readEA link

NIST AI Risk Man­age­ment Frame­work re­quest for in­for­ma­tion (RFI)

Aryeh Englander31 Aug 2021 22:24 UTC
7 points
0 comments2 min readEA link

Les­sons for AI gov­er­nance from the Biolog­i­cal Weapons Convention

AryanYadav8 Sep 2021 14:50 UTC
29 points
4 comments4 min readEA link

What is the EU AI Act and why should you care about it?

MathiasKB10 Sep 2021 7:47 UTC
89 points
6 comments7 min readEA link

Deep­Mind is hiring Long-term Strat­egy & Gover­nance researchers

vishal13 Sep 2021 18:44 UTC
54 points
1 comment1 min readEA link

How to make the best of the most im­por­tant cen­tury?

Holden Karnofsky14 Sep 2021 21:05 UTC
44 points
4 comments13 min readEA link

UK’s new 10-year “Na­tional AI Strat­egy,” re­leased today

jared_m22 Sep 2021 11:18 UTC
28 points
7 comments1 min readEA link

[Job ad] Re­search im­por­tant longter­mist top­ics at Re­think Pri­ori­ties!

Linch6 Oct 2021 19:09 UTC
58 points
39 comments1 min readEA link

[Link and com­men­tary] Beyond Near- and Long-Term: Towards a Clearer Ac­count of Re­search Pri­ori­ties in AI Ethics and Society

MichaelA14 Mar 2020 9:04 UTC
17 points
0 comments6 min readEA link

[Question] What are the most press­ing is­sues in short-term AI policy?

evelynciara14 Jan 2020 22:05 UTC
9 points
0 comments1 min readEA link

AI Benefits Post 1: In­tro­duc­ing “AI Benefits”

Cullen_OKeefe22 Jun 2020 16:58 UTC
10 points
2 comments3 min readEA link

AI Benefits Post 2: How AI Benefits Differs from AI Align­ment & AI for Good

Cullen_OKeefe29 Jun 2020 16:59 UTC
9 points
0 comments2 min readEA link

AI Benefits Post 3: Direct and Indi­rect Ap­proaches to AI Benefits

Cullen_OKeefe6 Jul 2020 18:46 UTC
5 points
0 comments2 min readEA link

How Europe might mat­ter for AI governance

stefan.torges12 Jul 2019 23:42 UTC
48 points
13 comments8 min readEA link

Does gen­er­al­ity pay? GPT-3 can provide pre­limi­nary ev­i­dence.

evelynciara12 Jul 2020 18:53 UTC
21 points
4 comments2 min readEA link

AI Benefits Post 5: Out­stand­ing Ques­tions on Govern­ing Benefits

Cullen_OKeefe21 Jul 2020 16:45 UTC
5 points
0 comments4 min readEA link

Par­allels Between AI Safety by De­bate and Ev­i­dence Law

Cullen_OKeefe20 Jul 2020 22:52 UTC
30 points
2 comments2 min readEA link
(cullenokeefe.com)

[Question] What do we do if AI doesn’t take over the world, but still causes a sig­nifi­cant global prob­lem?

James_Banks2 Aug 2020 3:35 UTC
16 points
5 comments1 min readEA link

Book re­view: Ar­chi­tects of In­tel­li­gence by Martin Ford (2018)

ofer11 Aug 2020 17:24 UTC
11 points
1 comment2 min readEA link

A course for the gen­eral pub­lic on AI

LeandroD31 Aug 2020 1:29 UTC
1 point
0 comments1 min readEA link

4 Years Later: Pres­i­dent Trump and Global Catas­trophic Risk

HaydnBelfield25 Oct 2020 16:28 UTC
23 points
9 comments9 min readEA link

How Rood­man’s GWP model trans­lates to TAI timelines

kokotajlod16 Nov 2020 14:11 UTC
22 points
0 comments2 min readEA link

Cen­tre for the Study of Ex­is­ten­tial Risk Four Month Re­port June—Septem­ber 2020

HaydnBelfield2 Dec 2020 18:33 UTC
24 points
0 comments18 min readEA link

Idea: an AI gov­er­nance group colo­cated with ev­ery AI re­search group!

capybaralet7 Dec 2020 23:41 UTC
8 points
1 comment2 min readEA link

Against GDP as a met­ric for timelines and take­off speeds

kokotajlod29 Dec 2020 17:50 UTC
41 points
6 comments14 min readEA link

What does it mean to be­come an ex­pert in AI Hard­ware?

Christopher_Phenicie9 Jan 2021 4:15 UTC
67 points
10 comments11 min readEA link

Birds, Brains, Planes, and AI: Against Ap­peals to the Com­plex­ity/​Mys­te­ri­ous­ness/​Effi­ciency of the Brain

kokotajlod18 Jan 2021 12:39 UTC
27 points
2 comments1 min readEA link

[Pod­cast] Ajeya Co­tra on wor­ld­view di­ver­sifi­ca­tion and how big the fu­ture could be

evelynciara22 Jan 2021 23:57 UTC
56 points
17 comments1 min readEA link
(80000hours.org)

13 Re­cent Publi­ca­tions on Ex­is­ten­tial Risk (Jan 2021 up­date)

HaydnBelfield8 Feb 2021 12:42 UTC
7 points
2 comments10 min readEA link

Stu­art Rus­sell Hu­man Com­pat­i­ble AI Roundtable with Allan Dafoe, Rob Re­ich, & Ma­ri­etje Schaake

Mahendra Prasad11 Feb 2021 7:43 UTC
16 points
0 comments1 min readEA link

Google’s ethics is alarming

len.hoang.lnh25 Feb 2021 5:57 UTC
1 point
5 comments1 min readEA link

Re­port on Semi-in­for­ma­tive Pri­ors for AI timelines (Open Philan­thropy)

Tom_Davidson26 Mar 2021 17:46 UTC
62 points
6 comments2 min readEA link

The flaws that make to­day’s AI ar­chi­tec­ture un­safe and a new ap­proach that could fix it

80000_Hours22 Jun 2020 22:15 UTC
3 points
0 comments86 min readEA link
(80000hours.org)

Work­ing in Congress (Part #1): Back­ground and some EA cause area analysis

Locke_USA11 Apr 2021 18:24 UTC
69 points
3 comments35 min readEA link

In­ter­na­tional co­op­er­a­tion as a tool to re­duce two ex­is­ten­tial risks.

johl@umich.edu19 Apr 2021 16:51 UTC
26 points
4 comments27 min readEA link

Two Strange Things About AI Safety Policy

Jay_Shooster28 Sep 2016 16:23 UTC
22 points
28 commentsEA link

Sup­port­ing global co­or­di­na­tion in AI de­vel­op­ment: Why and how to con­tribute to in­ter­na­tional AI standards

pcihon17 Apr 2019 22:17 UTC
21 points
4 comments1 min readEA link

Sur­vey on AI ex­is­ten­tial risk scenarios

SamClarke8 Jun 2021 17:12 UTC
137 points
5 comments7 min readEA link

How to get tech­nolog­i­cal knowl­edge on AI/​ML (for non-tech peo­ple)

Leonie Koessler30 Jun 2021 7:53 UTC
61 points
4 comments5 min readEA link

What is Com­pute? - Trans­for­ma­tive AI and Com­pute [1/​4]

lennart23 Sep 2021 13:54 UTC
24 points
4 comments19 min readEA link

Trans­for­ma­tive AI and Com­pute [Sum­mary]

lennart23 Sep 2021 13:53 UTC
45 points
5 comments9 min readEA link

Fore­cast­ing Com­pute—Trans­for­ma­tive AI and Com­pute [2/​4]

lennart1 Oct 2021 8:25 UTC
6 points
4 comments19 min readEA link

A col­lec­tion of AI Gover­nance-re­lated Pod­casts, Newslet­ters, Blogs, and more

alexlintz2 Oct 2021 0:46 UTC
21 points
2 comments1 min readEA link

Nu­clear Es­pi­onage and AI Governance

GAA4 Oct 2021 18:21 UTC
20 points
2 comments24 min readEA link

AI Risk in Africa

Claude Formanek12 Oct 2021 2:28 UTC
16 points
0 comments10 min readEA link

Com­pute Gover­nance and Con­clu­sions—Trans­for­ma­tive AI and Com­pute [3/​4]

lennart14 Oct 2021 7:55 UTC
14 points
0 comments5 min readEA link

New Work­ing Paper Series of the Le­gal Pri­ori­ties Project

Legal Priorities Project18 Oct 2021 10:30 UTC
49 points
0 comments9 min readEA link
No comments.