RSS

AI governance

TagLast edit: 22 Jul 2022 19:52 UTC by Pablo

AI governance (or the governance of artificial intelligence) is the study of norms, policies, and institutions that can help humanity navigate the transition to a world with advanced artificial intelligence. This includes a broad range of subjects, from global coordination around regulating AI development to providing incentives for corporations to be more cautious in their AI research.

AI governance as a career

Long-term AI policy strategy research and implementation is one of 80,000 Hours’ “priority paths”—the most promising career opportunities the organization has identified so far.[1][2]

Further reading

Brundage, Miles (2017) Guide to working in AI policy and strategy, 80,000 Hours, June 7.

Cussins, Jessica (2020) Summaries of AI policy resources, Future of Life Institute.

Dafoe, Allan (2020) AI governance: opportunity and theory of impact, Effective Altruism Forum, September 17.

Muehlhauser, Luke (2021) A personal take on longtermist AI governance, Effective Altruism Forum, July 21.

Related entries

AI alignment | AI forecasting | alignment tax | antitrust law | compute governance | economics of artificial intelligence | ethics of artificial intelligence | global governance | standards and regulation

  1. ^

    Todd, Benjamin (2018) The highest impact career paths our research has identified so far, 80,000 Hours, August 12.

  2. ^

    Todd, Benjamin (2021) Long-term AI policy strategy research and implementation, 80,000 Hours, October.

AI Gover­nance: Op­por­tu­nity and The­ory of Impact

Allan Dafoe17 Sep 2020 6:30 UTC
262 points
19 comments12 min readEA link

Some AI Gover­nance Re­search Ideas

MarkusAnderljung3 Jun 2021 10:51 UTC
101 points
5 comments2 min readEA link

A per­sonal take on longter­mist AI governance

lukeprog16 Jul 2021 22:08 UTC
173 points
6 comments7 min readEA link

A Map to Nav­i­gate AI Governance

hanadulset14 Feb 2022 22:41 UTC
72 points
11 comments25 min readEA link

Katja Grace: Let’s think about slow­ing down AI

peterhartree23 Dec 2022 0:57 UTC
84 points
6 comments2 min readEA link
(worldspiritsockpuppet.substack.com)

Com­po­nents of Strate­gic Clar­ity [Strate­gic Per­spec­tives on Long-term AI Gover­nance, #2]

MMMaas2 Jul 2022 11:22 UTC
66 points
0 comments6 min readEA link

Sin­ga­pore AI Policy Ca­reer Guide

Yi-Yang21 Jan 2021 3:05 UTC
28 points
0 comments5 min readEA link

AI Gover­nance Ca­reer Paths for Europeans

careersthrowaway16 May 2020 6:40 UTC
83 points
1 comment12 min readEA link

FLI open let­ter: Pause gi­ant AI experiments

Zach Stein-Perlman29 Mar 2023 4:04 UTC
220 points
38 comments1 min readEA link

The longter­mist AI gov­er­nance land­scape: a ba­sic overview

Sam Clarke18 Jan 2022 12:58 UTC
163 points
13 comments9 min readEA link

Slow­ing down AI progress is an un­der­ex­plored al­ign­ment strategy

Michael Huang13 Jul 2022 3:22 UTC
92 points
11 comments3 min readEA link
(www.lesswrong.com)

Case stud­ies of self-gov­er­nance to re­duce tech­nol­ogy risk

jia6 Apr 2021 8:49 UTC
55 points
6 comments7 min readEA link

12 ten­ta­tive ideas for US AI policy (Luke Muehlhauser)

Lizka19 Apr 2023 21:05 UTC
117 points
12 comments4 min readEA link
(www.openphilanthropy.org)

Some un­der­rated rea­sons why the AI safety com­mu­nity should re­con­sider its em­brace of strict li­a­bil­ity

Cecil Abungu 8 Apr 2024 18:50 UTC
67 points
29 comments12 min readEA link

Strate­gic Per­spec­tives on Trans­for­ma­tive AI Gover­nance: Introduction

MMMaas2 Jul 2022 11:20 UTC
113 points
18 comments4 min readEA link

AI Gover­nance Course—Cur­ricu­lum and Application

Mau29 Nov 2021 13:29 UTC
94 points
9 comments1 min readEA link

Per­sonal thoughts on ca­reers in AI policy and strategy

carrickflynn27 Sep 2017 16:52 UTC
56 points
28 comments18 min readEA link

A sum­mary of cur­rent work in AI governance

constructive17 Jun 2023 16:58 UTC
86 points
4 comments11 min readEA link

Bi­den-Har­ris Ad­minis­tra­tion An­nounces First-Ever Con­sor­tium Ded­i­cated to AI Safety

ben.smith9 Feb 2024 6:40 UTC
15 points
1 comment1 min readEA link
(www.nist.gov)

GovAI: Towards best prac­tices in AGI safety and gov­er­nance: A sur­vey of ex­pert opinion

Zach Stein-Perlman15 May 2023 1:42 UTC
68 points
3 comments1 min readEA link

In­ter­ac­tive AI Gover­nance Map

Hamish McDoodles12 Mar 2024 10:02 UTC
66 points
8 comments1 min readEA link

[Question] Ex­am­ples of self-gov­er­nance to re­duce tech­nol­ogy risk?

jia25 Sep 2020 13:26 UTC
32 points
1 comment1 min readEA link

AI Safety Ac­tion Plan—A re­port com­mis­sioned by the US State Department

Agustín Covarrubias 🔸11 Mar 2024 22:13 UTC
25 points
1 comment1 min readEA link
(www.gladstone.ai)

The Gover­nance Prob­lem and the “Pretty Good” X-Risk

Zach Stein-Perlman28 Aug 2021 20:00 UTC
23 points
4 comments11 min readEA link

Jade Le­ung: Why com­pa­nies should be lead­ing on AI governance

EA Global15 May 2019 23:37 UTC
29 points
7 comments18 min readEA link
(www.youtube.com)

FLI re­port: Poli­cy­mak­ing in the Pause

Zach Stein-Perlman15 Apr 2023 17:01 UTC
29 points
4 comments1 min readEA link

Open Philan­thropy’s AI gov­er­nance grant­mak­ing (so far)

Aaron Gertler 🔸17 Dec 2020 12:00 UTC
63 points
0 comments6 min readEA link
(www.openphilanthropy.org)

Markus An­der­ljung and Ben Garfinkel: Fireside chat on AI governance

EA Global24 Jul 2020 14:56 UTC
25 points
0 comments16 min readEA link
(www.youtube.com)

Pro­ject ideas: Gover­nance dur­ing ex­plo­sive tech­nolog­i­cal growth

Lukas Finnveden4 Jan 2024 7:25 UTC
33 points
1 comment16 min readEA link
(lukasfinnveden.substack.com)

Large Lan­guage Models as Fi­du­cia­ries to Humans

johnjnay24 Jan 2023 19:53 UTC
25 points
0 comments34 min readEA link
(papers.ssrn.com)

AI policy ideas: Read­ing list

Zach Stein-Perlman17 Apr 2023 19:00 UTC
60 points
3 comments1 min readEA link

New Busi­ness Wars pod­cast sea­son on Sam Alt­man and OpenAI

Eevee🔹2 Apr 2024 6:22 UTC
10 points
0 comments1 min readEA link
(wondery.com)

“Pivotal Act” In­ten­tions: Nega­tive Con­se­quences and Fal­la­cious Arguments

Andrew Critch19 Apr 2022 20:24 UTC
80 points
10 comments7 min readEA link

Cor­po­rate cam­paigns work: a key learn­ing for AI Safety

Jamie_Harris17 Aug 2023 21:35 UTC
71 points
12 comments6 min readEA link

Cur­rent UK gov­ern­ment lev­ers on AI development

rosehadshar10 Apr 2023 13:16 UTC
82 points
3 comments4 min readEA link

Mud­dling Along Is More Likely Than Dystopia

Jeffrey Heninger21 Oct 2023 9:30 UTC
87 points
3 comments8 min readEA link
(blog.aiimpacts.org)

[Link post] Co­or­di­na­tion challenges for pre­vent­ing AI conflict

stefan.torges9 Mar 2021 9:39 UTC
58 points
0 comments1 min readEA link
(longtermrisk.org)

“Aligned with who?” Re­sults of sur­vey­ing 1,000 US par­ti­ci­pants on AI values

Holly Morgan21 Mar 2023 22:07 UTC
40 points
0 comments2 min readEA link
(www.lesswrong.com)

Overview of in­tro­duc­tory re­sources in AI Governance

Lucie Philippon 🔸27 May 2024 16:22 UTC
24 points
0 comments6 min readEA link
(www.lesswrong.com)

He­len Toner (ex-OpenAI board mem­ber): “We learned about ChatGPT on Twit­ter.”

defun 🔸29 May 2024 7:40 UTC
123 points
13 comments1 min readEA link
(x.com)

A Viral Li­cense for AI Safety

IvanVendrov5 Jun 2021 2:00 UTC
30 points
6 comments5 min readEA link

4 ways to think about de­moc­ra­tiz­ing AI [GovAI Linkpost]

Akash13 Feb 2023 18:06 UTC
35 points
0 comments1 min readEA link

Data Tax­a­tion: A Pro­posal for Slow­ing Down AGI Progress

Per Ivar Friborg11 Apr 2023 17:27 UTC
42 points
6 comments12 min readEA link

CSER Ad­vice to EU High-Level Ex­pert Group on AI

HaydnBelfield8 Mar 2019 20:42 UTC
14 points
0 comments5 min readEA link
(www.cser.ac.uk)

AGI safety ca­reer advice

richard_ngo2 May 2023 7:36 UTC
211 points
20 comments1 min readEA link

A Case for Su­per­hu­man Gover­nance, us­ing AI

Ozzie Gooen7 Jun 2024 0:10 UTC
53 points
26 comments10 min readEA link

Re­quest to AGI or­ga­ni­za­tions: Share your views on paus­ing AI progress

Akash11 Apr 2023 17:30 UTC
85 points
1 comment1 min readEA link

My fa­vorite AI gov­er­nance re­search this year so far

Zach Stein-Perlman23 Jul 2023 22:00 UTC
81 points
4 comments7 min readEA link
(blog.aiimpacts.org)

Slightly against al­ign­ing with neo-luddites

Matthew_Barnett26 Dec 2022 23:27 UTC
71 points
17 comments4 min readEA link

Par­tial Tran­script of Re­cent Se­nate Hear­ing Dis­cussing AI X-Risk

Daniel_Eth27 Jul 2023 9:16 UTC
150 points
2 comments22 min readEA link
(medium.com)

Some Things I Heard about AI Gover­nance at EAG

utilistrutil28 Feb 2023 21:27 UTC
35 points
5 comments6 min readEA link

A new pro­posal for reg­u­lat­ing AI in the EU

EdoArad26 Apr 2021 17:25 UTC
37 points
3 comments1 min readEA link
(www.bbc.com)

Sur­vey on in­ter­me­di­ate goals in AI governance

MichaelA🔸17 Mar 2023 12:44 UTC
155 points
4 comments1 min readEA link

[Question] Pre­dic­tions for fu­ture AI gov­er­nance?

jackchang1102 Apr 2023 16:43 UTC
4 points
1 comment1 min readEA link

Cur­rent paths to im­pact in EU AI Policy (Feb ’24)

JOMG_Monnet12 Feb 2024 15:57 UTC
47 points
0 comments5 min readEA link

Aus­trali­ans are con­cerned about AI risks and ex­pect strong gov­ern­ment action

Alexander Saeri8 Mar 2024 6:39 UTC
38 points
12 comments5 min readEA link
(aigovernance.org.au)

[link] Cen­tre for the Gover­nance of AI 2020 An­nual Report

MarkusAnderljung14 Jan 2021 10:23 UTC
11 points
5 comments1 min readEA link

EU AI Act now has a sec­tion on gen­eral pur­pose AI systems

MathiasKB🔸9 Dec 2021 12:40 UTC
64 points
10 comments1 min readEA link

What suc­cess looks like

mariushobbhahn28 Jun 2022 14:30 UTC
112 points
20 comments19 min readEA link

An ar­gu­ment for ac­cel­er­at­ing in­ter­na­tional AI gov­er­nance re­search (part 1)

MattThinks16 Aug 2023 5:40 UTC
9 points
0 comments3 min readEA link

Is Democ­racy a Fad?

bgarfinkel13 Mar 2021 12:40 UTC
165 points
36 comments18 min readEA link

AI and Work: Sum­maris­ing a New Liter­a­ture Review

cpeppiatt15 Jul 2024 10:27 UTC
13 points
0 comments2 min readEA link
(arxiv.org)

News: Span­ish AI image out­cry + US AI work­force “reg­u­la­tion”

Ulrik Horn26 Sep 2023 7:43 UTC
9 points
0 comments1 min readEA link

FHI Re­port: The Wind­fall Clause: Distribut­ing the Benefits of AI for the Com­mon Good

Cullen 🔸5 Feb 2020 23:49 UTC
54 points
21 comments2 min readEA link

Prospects for AI safety agree­ments be­tween countries

oeg14 Apr 2023 17:41 UTC
104 points
3 comments22 min readEA link

Assess­ing the Danger­ous­ness of Malev­olent Ac­tors in AGI Gover­nance: A Pre­limi­nary Exploration

Callum Hinchcliffe14 Oct 2023 21:18 UTC
28 points
4 comments9 min readEA link

AI-Rele­vant Reg­u­la­tion: IAEA

SWK15 Jul 2023 18:20 UTC
10 points
0 comments5 min readEA link

[US] NTIA: AI Ac­countabil­ity Policy Re­quest for Comment

Kyle J. Lucchese13 Apr 2023 16:12 UTC
47 points
4 comments1 min readEA link
(ntia.gov)

(Even) More Early-Ca­reer EAs Should Try AI Safety Tech­ni­cal Research

tlevin30 Jun 2022 21:14 UTC
86 points
40 comments11 min readEA link

AI-Rele­vant Reg­u­la­tion: CERN

SWK15 Jul 2023 18:40 UTC
12 points
0 comments6 min readEA link

What we’re miss­ing: the case for struc­tural risks from AI

Justin Olive9 Nov 2023 5:52 UTC
31 points
3 comments6 min readEA link

Map­ping How Alli­ances, Ac­qui­si­tions, and An­titrust are Shap­ing the Fron­tier AI Industry

t6aguirre3 Jun 2024 9:43 UTC
24 points
1 comment2 min readEA link

New Se­quence—Towards a wor­ld­wide, wa­ter­tight Wind­fall Clause

John Bridge 🔸7 Apr 2022 15:02 UTC
25 points
4 comments8 min readEA link

AGI ris­ing: why we are in a new era of acute risk and in­creas­ing pub­lic aware­ness, and what to do now

Greg_Colbourn2 May 2023 10:17 UTC
68 points
35 comments13 min readEA link

UNGA Re­s­olu­tion on AI: 5 Key Take­aways Look­ing to Fu­ture Policy

Heramb Podar24 Mar 2024 12:03 UTC
17 points
1 comment3 min readEA link

“Risk Aware­ness Mo­ments” (Rams): A con­cept for think­ing about AI gov­er­nance interventions

oeg14 Apr 2023 17:40 UTC
53 points
0 comments9 min readEA link

Are you re­ally in a race? The Cau­tion­ary Tales of Szilárd and Ellsberg

HaydnBelfield19 May 2022 8:42 UTC
482 points
44 comments18 min readEA link

Stan­dard policy frame­works for AI governance

Nathan_Barnard30 Jan 2024 18:14 UTC
26 points
2 comments3 min readEA link

Call for Papers on Global AI Gover­nance from the UN

Chris Leong20 Aug 2023 8:56 UTC
36 points
1 comment1 min readEA link
(www.linkedin.com)

A fic­tional AI law laced w/​ al­ign­ment theory

Miguel17 Jul 2023 3:26 UTC
3 points
0 comments2 min readEA link

AI policy & gov­er­nance in Aus­tralia: notes from an ini­tial discussion

Alexander Saeri15 May 2023 0:00 UTC
31 points
1 comment3 min readEA link

New US Se­nate Bill on X-Risk Miti­ga­tion [Linkpost]

Evan R. Murphy4 Jul 2022 1:28 UTC
22 points
12 comments1 min readEA link
(www.hsgac.senate.gov)

We are fight­ing a shared bat­tle (a call for a differ­ent ap­proach to AI Strat­egy)

Gideon Futerman16 Mar 2023 14:37 UTC
59 points
11 comments15 min readEA link

AI Risk Man­age­ment Frame­work | NIST

𝕮𝖎𝖓𝖊𝖗𝖆26 Jan 2023 15:27 UTC
50 points
0 comments1 min readEA link

My Feed­back to the UN Ad­vi­sory Body on AI

Heramb Podar4 Apr 2024 23:39 UTC
7 points
1 comment4 min readEA link

AGI mis­al­ign­ment x-risk may be lower due to an over­looked goal speci­fi­ca­tion technology

johnjnay21 Oct 2022 2:03 UTC
20 points
1 comment1 min readEA link

Should you work in the Euro­pean Union to do AGI gov­er­nance?

hanadulset31 Jan 2022 10:34 UTC
90 points
20 comments15 min readEA link

FHI Re­port: Stable Agree­ments in Tur­bu­lent Times

Cullen 🔸21 Feb 2019 17:12 UTC
25 points
2 comments4 min readEA link
(www.fhi.ox.ac.uk)

Eisen­hower’s Atoms for Peace Speech

Akash17 May 2023 16:10 UTC
17 points
1 comment1 min readEA link

List of pro­jects that seem im­pact­ful for AI Governance

JaimeRV14 Jan 2024 16:52 UTC
35 points
2 comments13 min readEA link

Prob­lem-solv­ing tasks in Graph The­ory for lan­guage mod­els

Bruno López Orozco1 Oct 2024 12:36 UTC
17 points
1 comment9 min readEA link

AI Benefits Post 4: Out­stand­ing Ques­tions on Select­ing Benefits

Cullen 🔸14 Jul 2020 17:24 UTC
6 points
0 comments5 min readEA link

Thoughts on the AI Safety Sum­mit com­pany policy re­quests and responses

So8res31 Oct 2023 23:54 UTC
42 points
3 comments1 min readEA link

UK AI Bill Anal­y­sis & Opinion

CAISID5 Feb 2024 0:12 UTC
18 points
0 comments15 min readEA link

It’s not ob­vi­ous that get­ting dan­ger­ous AI later is better

Aaron_Scher23 Sep 2023 5:35 UTC
23 points
9 comments16 min readEA link

Le­gal Pri­ori­ties Re­search: A Re­search Agenda

jonasschuett6 Jan 2021 21:47 UTC
58 points
4 comments1 min readEA link

Merger of Deep­Mind and Google Brain

Greg_Colbourn20 Apr 2023 20:16 UTC
11 points
12 comments1 min readEA link
(blog.google)

An­titrust-Com­pli­ant AI In­dus­try Self-Regulation

Cullen 🔸7 Jul 2020 20:52 UTC
26 points
1 comment1 min readEA link
(cullenokeefe.com)

AI In­ci­dent Re­port­ing: A Reg­u­la­tory Review

Deric Cheng11 Mar 2024 21:02 UTC
10 points
1 comment6 min readEA link

[Question] Know a grad stu­dent study­ing AI’s eco­nomic im­pacts?

Madhav Malhotra5 Jul 2023 0:07 UTC
7 points
0 comments1 min readEA link

What would a com­pute mon­i­tor­ing plan look like? [Linkpost]

Akash26 Mar 2023 19:33 UTC
61 points
1 comment1 min readEA link

AI labs’ state­ments on governance

Zach Stein-Perlman4 Jul 2023 16:30 UTC
28 points
1 comment1 min readEA link

Align­ing the Align­ers: En­sur­ing Aligned AI acts for the com­mon good of all mankind

timunderwood16 Jan 2023 11:13 UTC
40 points
2 comments4 min readEA link

How Could AI Gover­nance Go Wrong?

HaydnBelfield26 May 2022 21:29 UTC
40 points
7 comments18 min readEA link

FLI pod­cast se­ries, “Imag­ine A World”, about as­pira­tional fu­tures with AGI

Jackson Wagner13 Oct 2023 16:03 UTC
18 points
0 comments4 min readEA link

[Question] What are the best jour­nals to pub­lish AI gov­er­nance pa­pers in?

Caro2 May 2022 10:07 UTC
26 points
4 comments1 min readEA link

Trends in the dol­lar train­ing cost of ma­chine learn­ing systems

Ben Cottier1 Feb 2023 14:48 UTC
63 points
3 comments1 min readEA link

On the com­pute gov­er­nance era and what has to come af­ter (Len­nart Heim on The 80,000 Hours Pod­cast)

80000_Hours23 Jun 2023 20:11 UTC
37 points
0 comments18 min readEA link

Law-Fol­low­ing AI 1: Se­quence In­tro­duc­tion and Structure

Cullen 🔸27 Apr 2022 17:16 UTC
35 points
2 comments9 min readEA link

Thoughts on “The Offense-Defense Balance Rarely Changes”

Cullen 🔸12 Feb 2024 3:26 UTC
42 points
4 comments5 min readEA link

Giv­ing away copies of Un­con­trol­lable by Dar­ren McKee

Greg_Colbourn14 Dec 2023 17:00 UTC
39 points
2 comments1 min readEA link

Many AI gov­er­nance pro­pos­als have a trade­off be­tween use­ful­ness and feasibility

Akash3 Feb 2023 18:49 UTC
22 points
0 comments1 min readEA link

EU poli­cy­mak­ers reach an agree­ment on the AI Act

tlevin15 Dec 2023 6:03 UTC
109 points
13 comments1 min readEA link

Google in­vests $300mn in ar­tifi­cial in­tel­li­gence start-up An­thropic | FT

𝕮𝖎𝖓𝖊𝖗𝖆3 Feb 2023 19:43 UTC
155 points
5 comments1 min readEA link
(www.ft.com)

Dear An­thropic peo­ple, please don’t re­lease Claude

Joseph Miller8 Feb 2023 2:44 UTC
27 points
5 comments1 min readEA link

[Question] Will AGI cause mass tech­nolog­i­cal un­em­ploy­ment?

Eevee🔹22 Jun 2020 20:55 UTC
4 points
2 comments2 min readEA link

Cy­borg Pe­ri­ods: There will be mul­ti­ple AI transitions

Jan_Kulveit22 Feb 2023 16:09 UTC
68 points
1 comment1 min readEA link

Ap­ply to the new Open Philan­thropy Tech­nol­ogy Policy Fel­low­ship!

lukeprog20 Jul 2021 18:41 UTC
78 points
6 comments4 min readEA link

My ar­ti­cle in The Na­tion — Cal­ifor­nia’s AI Safety Bill Is a Mask-Off Mo­ment for the Industry

Garrison15 Aug 2024 19:25 UTC
134 points
0 comments1 min readEA link
(www.thenation.com)

[Question] What are the challenges and prob­lems with pro­gram­ming law-break­ing con­straints into AGI?

MichaelStJules2 Feb 2020 20:53 UTC
20 points
34 comments1 min readEA link

[Question] Do­ing Global Pri­ori­ties or AI Policy re­search from re­mote lo­ca­tion?

With Love from Israel29 Oct 2019 9:34 UTC
30 points
4 comments1 min readEA link

[Question] Is there ev­i­dence that recom­mender sys­tems are chang­ing users’ prefer­ences?

zdgroff12 Apr 2021 19:11 UTC
60 points
15 comments1 min readEA link

Owen Cot­ton-Bar­ratt: What does (and doesn’t) AI mean for effec­tive al­tru­ism?

EA Global11 Aug 2017 8:19 UTC
10 points
0 comments12 min readEA link
(www.youtube.com)

How ma­jor gov­ern­ments can help with the most im­por­tant century

Holden Karnofsky24 Feb 2023 19:37 UTC
56 points
4 comments4 min readEA link
(www.cold-takes.com)

In­ves­ti­gat­ing an in­surance-for-AI startup

L Rudolf L21 Sep 2024 15:29 UTC
40 points
1 comment1 min readEA link
(www.strataoftheworld.com)

[Question] Would an An­thropic/​OpenAI merger be good for AI safety?

M22 Nov 2023 20:21 UTC
6 points
1 comment1 min readEA link

Pal­isade is hiring: Exec As­sis­tant, Con­tent Lead, Ops Lead, and Policy Lead

Charlie Rogers-Smith9 Oct 2024 0:04 UTC
15 points
2 comments1 min readEA link

AI Gover­nance & Strat­egy: Pri­ori­ties, tal­ent gaps, & opportunities

Akash3 Mar 2023 18:09 UTC
21 points
0 comments1 min readEA link

The case for build­ing ex­per­tise to work on US AI policy, and how to do it

80000_Hours31 Jan 2019 22:44 UTC
37 points
2 comments2 min readEA link

[Question] Has An­thropic already made the ex­ter­nally leg­ible com­mit­ments that it planned to make?

Ofer12 Mar 2024 13:45 UTC
21 points
3 comments1 min readEA link

Jade Le­ung and Seth Baum: The role of ex­ist­ing in­sti­tu­tions in AI strategy

EA Global8 Jun 2018 7:15 UTC
9 points
0 comments28 min readEA link
(www.youtube.com)

AI gov­er­nance and strat­egy: a list of re­search agen­das and work that could be done.

Nathan_Barnard12 Mar 2024 11:21 UTC
33 points
4 comments17 min readEA link

A Wind­fall Clause for CEO could worsen AI race dynamics

Larks9 Mar 2023 18:02 UTC
69 points
12 comments7 min readEA link

AGI Safety Fun­da­men­tals cur­ricu­lum and application

richard_ngo20 Oct 2021 21:45 UTC
123 points
20 comments8 min readEA link
(docs.google.com)

[Question] Track­ing Com­pute Stocks and Flows: Case Stud­ies?

Cullen 🔸5 Oct 2022 17:54 UTC
34 points
1 comment1 min readEA link

What is the EU AI Act and why should you care about it?

MathiasKB🔸10 Sep 2021 7:47 UTC
116 points
10 comments7 min readEA link

AI policy ca­reers in the EU

Lauro Langosco11 Nov 2019 10:43 UTC
59 points
7 comments11 min readEA link

AI gov­er­nance tal­ent pro­files I’d like to see ap­ply for OP funding

JulianHazell19 Dec 2023 12:34 UTC
118 points
4 comments3 min readEA link
(www.openphilanthropy.org)

Shar­ing the AI Wind­fall: A Strate­gic Ap­proach to In­ter­na­tional Benefit-Sharing

michel16 Aug 2024 12:54 UTC
65 points
0 comments13 min readEA link
(wrtaigovernance.substack.com)

Open po­si­tions: Re­search An­a­lyst at the AI Stan­dards Lab

Koen Holtman22 Dec 2023 16:47 UTC
18 points
0 comments1 min readEA link

Pro­ject ideas: Epistemics

Lukas Finnveden4 Jan 2024 7:26 UTC
43 points
1 comment17 min readEA link
(lukasfinnveden.substack.com)

Non-al­ign­ment pro­ject ideas for mak­ing trans­for­ma­tive AI go well

Lukas Finnveden4 Jan 2024 7:23 UTC
66 points
1 comment3 min readEA link
(lukasfinnveden.substack.com)

Jeffrey Ding: Bring­ing techno-global­ism back: a ro­man­ti­cally re­al­ist re­fram­ing of the US-China tech relationship

EA Global21 Nov 2020 8:12 UTC
9 points
0 comments1 min readEA link
(www.youtube.com)

Po­ten­tial Risks from Ad­vanced AI

EA Global13 Aug 2017 7:00 UTC
9 points
0 comments18 min readEA link

Allan Dafoe: Prepar­ing for AI — risks and opportunities

EA Global3 Nov 2017 7:43 UTC
7 points
0 comments1 min readEA link
(www.youtube.com)

AI Gover­nance Needs Tech­ni­cal Work

Mau5 Sep 2022 22:25 UTC
117 points
3 comments8 min readEA link

Cog­ni­tive as­sets and defen­sive acceleration

JulianHazell3 Apr 2024 14:55 UTC
13 points
3 comments4 min readEA link
(muddyclothes.substack.com)

Dona­tion offsets for ChatGPT Plus subscriptions

Jeffrey Ladish16 Mar 2023 23:11 UTC
76 points
10 comments3 min readEA link

My thoughts on the so­cial re­sponse to AI risk

Matthew_Barnett1 Nov 2023 21:27 UTC
116 points
17 comments1 min readEA link

Some thoughts on risks from nar­row, non-agen­tic AI

richard_ngo19 Jan 2021 0:07 UTC
36 points
2 comments8 min readEA link

The new UK gov­ern­ment’s stance on AI safety

Elliot Mckernon31 Jul 2024 15:23 UTC
19 points
0 comments1 min readEA link

Ap­ply to fall policy in­tern­ships (we can help)

ES2 Jul 2023 21:37 UTC
57 points
4 comments1 min readEA link

Crises re­veal centralisation

Vasco Grilo🔸26 Mar 2024 18:00 UTC
31 points
2 comments5 min readEA link
(stefanschubert.substack.com)

[Question] Books and lec­ture se­ries rele­vant to AI gov­er­nance?

MichaelA🔸18 Jul 2021 15:54 UTC
22 points
8 comments1 min readEA link

In­sights from an ex­pert sur­vey about in­ter­me­di­ate goals in AI governance

Sebastian Schwiecker17 Mar 2023 14:59 UTC
11 points
2 comments1 min readEA link

Notes on nukes, IR, and AI from “Arse­nals of Folly” (and other books)

tlevin4 Sep 2023 19:02 UTC
20 points
2 comments6 min readEA link

Pile of Law and Law-Fol­low­ing AI

Cullen 🔸13 Jul 2022 0:29 UTC
28 points
2 comments3 min readEA link

Re­lease of UN’s draft re­lated to the gov­er­nance of AI (a sum­mary of the Si­mon In­sti­tute’s re­sponse)

SebastianSchmidt27 Apr 2024 18:27 UTC
22 points
0 comments1 min readEA link

The­o­ries of Change for Track II Di­plo­macy [Founders Pledge]

christian.r9 Jul 2024 13:31 UTC
19 points
2 comments33 min readEA link

Spicy takes about AI policy (Clark, 2022)

Will Aldred9 Aug 2022 13:49 UTC
44 points
0 comments3 min readEA link
(twitter.com)

Deep­Mind is hiring Long-term Strat­egy & Gover­nance researchers

vishal13 Sep 2021 18:44 UTC
54 points
1 comment1 min readEA link

Fore­sight for AGI Safety Strategy

jacquesthibs5 Dec 2022 16:09 UTC
14 points
1 comment1 min readEA link

Col­lec­tion of work on ‘Should you fo­cus on the EU if you’re in­ter­ested in AI gov­er­nance for longter­mist/​x-risk rea­sons?’

MichaelA🔸6 Aug 2022 16:49 UTC
45 points
3 comments1 min readEA link

Baobao Zhang: How so­cial sci­ence re­search can in­form AI governance

EA Global22 Jan 2021 15:10 UTC
9 points
0 comments16 min readEA link
(www.youtube.com)

Ross Gruet­zemacher: Defin­ing and un­pack­ing trans­for­ma­tive AI

EA Global18 Oct 2019 8:22 UTC
9 points
0 comments1 min readEA link
(www.youtube.com)

Im­por­tant, ac­tion­able re­search ques­tions for the most im­por­tant century

Holden Karnofsky24 Feb 2022 16:34 UTC
298 points
13 comments19 min readEA link

GovAI We­bi­nars on the Gover­nance and Eco­nomics of AI

MarkusAnderljung12 May 2020 15:00 UTC
16 points
0 comments1 min readEA link

New vol­un­tary com­mit­ments (AI Seoul Sum­mit)

Zach Stein-Perlman21 May 2024 11:00 UTC
12 points
1 comment1 min readEA link
(www.gov.uk)

Longter­mist rea­sons to work for in­no­va­tive governments

ac13 Oct 2020 16:32 UTC
74 points
8 comments1 min readEA link

[Question] What type of Master’s is best for AI policy work?

Milan_Griffes22 Feb 2019 20:04 UTC
14 points
7 comments1 min readEA link

Could Reg­u­la­tory Cost-Benefit Anal­y­sis Stop Fron­tier AI Reg­u­la­tions in the US?

Luise11 Jul 2024 15:25 UTC
21 points
1 comment14 min readEA link

UK policy and poli­tics careers

weeatquince28 Sep 2019 16:18 UTC
28 points
10 comments7 min readEA link

The U.S. and China Need an AI In­ci­dents Hotline

christian.r3 Jun 2024 18:46 UTC
25 points
0 comments1 min readEA link
(www.lawfaremedia.org)

An­nounc­ing Open Philan­thropy’s AI gov­er­nance and policy RFP

JulianHazell17 Jul 2024 0:25 UTC
73 points
2 comments1 min readEA link
(www.openphilanthropy.org)

Effec­tive En­force­abil­ity of EU Com­pe­ti­tion Law Un­der Differ­ent AI Devel­op­ment Sce­nar­ios: A Frame­work for Le­gal Analysis

HaydnBelfield19 Aug 2022 17:20 UTC
11 points
0 comments6 min readEA link
(verfassungsblog.de)

Thoughts on yes­ter­day’s UN Se­cu­rity Coun­cil meet­ing on AI

Greg_Colbourn19 Jul 2023 16:46 UTC
31 points
2 comments1 min readEA link

Shal­low eval­u­a­tions of longter­mist organizations

NunoSempere24 Jun 2021 15:31 UTC
192 points
34 comments34 min readEA link

US Congress in­tro­duces CREATE AI Act for es­tab­lish­ing Na­tional AI Re­search Resource

Daniel_Eth28 Jul 2023 23:27 UTC
9 points
1 comment1 min readEA link
(eshoo.house.gov)

Fron­tier Model Forum

Zach Stein-Perlman26 Jul 2023 14:30 UTC
40 points
7 comments1 min readEA link
(blog.google)

Seek­ing Mechanism De­signer for Re­search into In­ter­nal­iz­ing Catas­trophic Externalities

c.trout11 Sep 2024 15:09 UTC
11 points
0 comments1 min readEA link

In­stead of tech­ni­cal re­search, more peo­ple should fo­cus on buy­ing time

Akash5 Nov 2022 20:43 UTC
107 points
31 comments1 min readEA link

Law-Fol­low­ing AI 4: Don’t Rely on Vi­car­i­ous Liability

Cullen 🔸2 Aug 2022 23:23 UTC
13 points
0 comments3 min readEA link

Some cruxes on im­pact­ful al­ter­na­tives to AI policy work

richard_ngo22 Nov 2018 13:43 UTC
28 points
2 comments12 min readEA link

AMA: Fu­ture of Life In­sti­tute’s EU Team

Risto Uuk31 Jan 2022 17:14 UTC
44 points
15 comments2 min readEA link

Linkpost: 7 A.I. Com­pa­nies Agree to Safe­guards After Pres­sure From the White House

MHR21 Jul 2023 13:23 UTC
61 points
4 comments1 min readEA link
(www.nytimes.com)

CSER and FHI ad­vice to UN High-level Panel on Digi­tal Co­op­er­a­tion

HaydnBelfield8 Mar 2019 20:39 UTC
22 points
7 comments6 min readEA link
(www.cser.ac.uk)

Read­ing list on AI agents and as­so­ci­ated policy

Peter Wildeford9 Aug 2024 17:40 UTC
79 points
2 comments1 min readEA link

[Question] How to Im­prove China-Western Co­or­di­na­tion on EA Is­sues?

Michael Kehoe3 Nov 2021 7:28 UTC
15 points
2 comments1 min readEA link

Con­crete ac­tion­able poli­cies rele­vant to AI safety (writ­ten 2019)

weeatquince16 Dec 2022 18:41 UTC
48 points
0 comments22 min readEA link

Sym­bio­sis, not al­ign­ment, as the goal for liberal democ­ra­cies in the tran­si­tion to ar­tifi­cial gen­eral intelligence

simonfriederich17 Mar 2023 13:04 UTC
18 points
2 comments24 min readEA link
(rdcu.be)

Yud­kowsky and Chris­ti­ano dis­cuss “Take­off Speeds”

EliezerYudkowsky22 Nov 2021 19:42 UTC
42 points
0 comments60 min readEA link

Law-Fol­low­ing AI 2: In­tent Align­ment + Su­per­in­tel­li­gence → Lawless AI (By De­fault)

Cullen 🔸27 Apr 2022 17:18 UTC
19 points
0 comments6 min readEA link

AMA: The new Open Philan­thropy Tech­nol­ogy Policy Fellowship

lukeprog26 Jul 2021 15:11 UTC
38 points
14 comments1 min readEA link

I’m Cul­len O’Keefe, a Policy Re­searcher at OpenAI, AMA

Cullen 🔸11 Jan 2020 4:13 UTC
45 points
68 comments1 min readEA link

Dis­cus­sion with Eliezer Yud­kowsky on AGI interventions

RobBensinger11 Nov 2021 3:21 UTC
60 points
33 comments34 min readEA link

The Ri­val AI De­ploy­ment Prob­lem: a Pre-de­ploy­ment Agree­ment as the least-bad response

HaydnBelfield23 Sep 2022 9:28 UTC
39 points
1 comment12 min readEA link

Jaan Tal­linn: Fireside chat (2020)

EA Global21 Nov 2020 8:12 UTC
7 points
0 comments1 min readEA link
(www.youtube.com)

GovAI An­nual Re­port 2021

GovAI5 Jan 2022 16:57 UTC
52 points
2 comments9 min readEA link

Suc­ces­sif: Join our AI pro­gram to help miti­gate the catas­trophic risks of AI

ClaireB25 Oct 2023 16:51 UTC
15 points
0 comments5 min readEA link

FLI launches Wor­ld­build­ing Con­test with $100,000 in prizes

ggilgallon17 Jan 2022 13:54 UTC
87 points
55 comments6 min readEA link

[Job ad] Re­search im­por­tant longter­mist top­ics at Re­think Pri­ori­ties!

Linch6 Oct 2021 19:09 UTC
65 points
46 comments1 min readEA link

Three Im­pacts of Ma­chine Intelligence

Paul_Christiano23 Aug 2013 10:10 UTC
33 points
5 comments8 min readEA link
(rationalaltruist.com)

How to make the best of the most im­por­tant cen­tury?

Holden Karnofsky14 Sep 2021 21:05 UTC
54 points
5 comments12 min readEA link

FHI Re­port: How Will Na­tional Se­cu­rity Con­sid­er­a­tions Affect An­titrust De­ci­sions in AI? An Ex­am­i­na­tion of His­tor­i­cal Precedents

Cullen 🔸28 Jul 2020 18:33 UTC
13 points
0 comments1 min readEA link
(www.fhi.ox.ac.uk)

Mauhn Re­leases AI Safety Documentation

Berg Severens2 Jul 2021 12:19 UTC
4 points
2 comments1 min readEA link

TAI Safety Biblio­graphic Database

Jess_Riedel22 Dec 2020 16:03 UTC
61 points
9 comments17 min readEA link

[Question] What kind of or­ga­ni­za­tion should be the first to de­velop AGI in a po­ten­tial arms race?

Eevee🔹17 Jul 2022 17:41 UTC
10 points
2 comments1 min readEA link

Hooray for step­ping out of the limelight

So8res1 Apr 2023 2:45 UTC
103 points
0 comments1 min readEA link

EU’s im­por­tance for AI gov­er­nance is con­di­tional on AI tra­jec­to­ries—a case study

MathiasKB🔸13 Jan 2022 14:58 UTC
31 points
2 comments3 min readEA link

Ar­gu­ment Against Im­pact: EU Is Not an AI Su­per­power

EU AI Governance31 Jan 2022 9:48 UTC
35 points
9 comments4 min readEA link

An ‘AGI Emer­gency Eject Cri­te­ria’ con­sen­sus could be re­ally use­ful.

tcelferact7 Apr 2023 16:21 UTC
27 points
3 comments1 min readEA link

Daniel Dewey: The Open Philan­thropy Pro­ject’s work on po­ten­tial risks from ad­vanced AI

EA Global11 Aug 2017 8:19 UTC
7 points
0 comments18 min readEA link
(www.youtube.com)

An overview of ar­gu­ments for con­cern about automation

alexlintz6 Aug 2019 7:56 UTC
34 points
3 comments13 min readEA link

New sur­vey: 46% of Amer­i­cans are con­cerned about ex­tinc­tion from AI; 69% sup­port a six-month pause in AI development

Akash5 Apr 2023 1:26 UTC
143 points
34 comments1 min readEA link

Pause For Thought: The AI Pause Debate

Scott Alexander10 Oct 2023 15:34 UTC
109 points
20 comments14 min readEA link
(www.astralcodexten.com)

Com­pute & An­titrust: Reg­u­la­tory im­pli­ca­tions of the AI hard­ware sup­ply chain, from chip de­sign to cloud APIs

HaydnBelfield19 Aug 2022 17:20 UTC
32 points
0 comments6 min readEA link
(verfassungsblog.de)

Fi­nal Re­port of the Na­tional Se­cu­rity Com­mis­sion on Ar­tifi­cial In­tel­li­gence (NSCAI, 2021)

MichaelA🔸1 Jun 2021 8:19 UTC
51 points
3 comments4 min readEA link
(www.nscai.gov)

How tech­ni­cal safety stan­dards could pro­mote TAI safety

Cullen 🔸8 Aug 2022 16:57 UTC
128 points
15 comments7 min readEA link

Up­dates from Cam­paign for AI Safety

Jolyn Khoo27 Sep 2023 2:44 UTC
16 points
0 comments2 min readEA link
(www.campaignforaisafety.org)

Is it time for a pause?

Kelsey Piper6 Apr 2023 11:48 UTC
103 points
6 comments5 min readEA link

UK AI Policy Re­port: Con­tent, Sum­mary, and its Im­pact on EA Cause Areas

Algo_Law21 Jul 2022 17:32 UTC
9 points
1 comment9 min readEA link

Nav­i­gat­ing the Open-Source AI Land­scape: Data, Fund­ing, and Safety

AndreFerretti12 Apr 2023 10:30 UTC
23 points
3 comments10 min readEA link

Nav­i­gat­ing AI Risks (NAIR) #1: Slow­ing Down AI

simeon_c14 Apr 2023 14:35 UTC
12 points
1 comment1 min readEA link

AI & Policy 1/​3: On know­ing the effect of to­day’s poli­cies on Trans­for­ma­tive AI risks, and the case for in­sti­tu­tional im­prove­ments.

weeatquince27 Aug 2019 11:04 UTC
27 points
3 comments10 min readEA link

Here are the fi­nal­ists from FLI’s $100K Wor­ld­build­ing Contest

Jackson Wagner6 Jun 2022 18:42 UTC
44 points
5 comments2 min readEA link

The AI rev­olu­tion and in­ter­na­tional poli­tics (Allan Dafoe)

EA Global2 Jun 2017 8:48 UTC
8 points
0 comments18 min readEA link
(www.youtube.com)

What does (and doesn’t) AI mean for effec­tive al­tru­ism?

EA Global12 Aug 2017 7:00 UTC
9 points
0 comments12 min readEA link

Ngo and Yud­kowsky on AI ca­pa­bil­ity gains

richard_ngo19 Nov 2021 1:54 UTC
23 points
4 comments39 min readEA link

Good policy ideas that won’t hap­pen (yet)

Niel_Bowerman11 Sep 2014 12:29 UTC
28 points
8 comments14 min readEA link

Chris­ti­ano, Co­tra, and Yud­kowsky on AI progress

Ajeya25 Nov 2021 16:30 UTC
18 points
6 comments68 min readEA link

No­body’s on the ball on AGI alignment

leopold29 Mar 2023 14:26 UTC
327 points
65 comments9 min readEA link
(www.forourposterity.com)

How evals might (or might not) pre­vent catas­trophic risks from AI

Akash7 Feb 2023 20:16 UTC
28 points
0 comments1 min readEA link

AI Safety Newslet­ter #3: AI policy pro­pos­als and a new challenger approaches

Oliver Z25 Apr 2023 16:15 UTC
35 points
1 comment4 min readEA link
(newsletter.safe.ai)

[Link] EAF Re­search agenda: “Co­op­er­a­tion, Con­flict, and Trans­for­ma­tive Ar­tifi­cial In­tel­li­gence”

stefan.torges17 Jan 2020 13:28 UTC
64 points
0 comments1 min readEA link

Law-Fol­low­ing AI 3: Lawless AI Agents Un­der­mine Sta­bi­liz­ing Agreements

Cullen 🔸27 Apr 2022 17:20 UTC
28 points
3 comments3 min readEA link

P(doom|AGI) is high: why the de­fault out­come of AGI is doom

Greg_Colbourn2 May 2023 10:40 UTC
13 points
28 comments3 min readEA link

Three pillars for avoid­ing AGI catas­tro­phe: Tech­ni­cal al­ign­ment, de­ploy­ment de­ci­sions, and co­or­di­na­tion

alexlintz3 Aug 2022 21:24 UTC
93 points
4 comments12 min readEA link

How CISA can Sup­port the Se­cu­rity of Large AI Models Against Theft [Grad School As­sign­ment]

Marcel D3 May 2023 15:36 UTC
7 points
0 comments13 min readEA link

[Link Post: New York Times] White House Un­veils Ini­ti­a­tives to Re­duce Risks of A.I.

Rockwell4 May 2023 14:04 UTC
50 points
1 comment2 min readEA link

[Fic­tion] Im­proved Gover­nance on the Crit­i­cal Path to AI Align­ment by 2045.

Jackson Wagner18 May 2022 15:50 UTC
20 points
1 comment12 min readEA link

An in­ter­ven­tion to shape policy di­alogue, com­mu­ni­ca­tion, and AI re­search norms for AI safety

Lee_Sharkey1 Oct 2017 18:29 UTC
9 points
28 comments10 min readEA link

An­nounc­ing the EU Tech Policy Fellowship

Jan-Willem30 Mar 2022 8:15 UTC
53 points
4 comments5 min readEA link

AI Safety Newslet­ter #5: Ge­offrey Hin­ton speaks out on AI risk, the White House meets with AI labs, and Tro­jan at­tacks on lan­guage models

Center for AI Safety9 May 2023 15:26 UTC
60 points
0 comments4 min readEA link
(newsletter.safe.ai)

Cruxes on US lead for some do­mes­tic AI regulation

Zach Stein-Perlman10 Sep 2023 18:00 UTC
20 points
6 comments2 min readEA link

Un­veiling the Amer­i­can Public Opinion on AI Mo­ra­to­rium and Govern­ment In­ter­ven­tion: The Im­pact of Me­dia Exposure

Otto8 May 2023 10:49 UTC
28 points
5 comments6 min readEA link

AI Risk & Policy Fore­casts from Me­tac­u­lus & FLI’s AI Path­ways Workshop

Will Aldred16 May 2023 8:53 UTC
41 points
0 comments8 min readEA link

Jeffrey Ding: Re-de­ci­pher­ing China’s AI dream

EA Global18 Oct 2019 18:05 UTC
13 points
0 comments1 min readEA link
(www.youtube.com)

AMA: Markus An­der­ljung (PM at GovAI, FHI)

MarkusAnderljung21 Sep 2020 11:23 UTC
49 points
24 comments2 min readEA link

Co­or­di­na­tion by com­mon knowl­edge to pre­vent un­con­trol­lable AI

Karl von Wendt14 May 2023 13:37 UTC
14 points
0 comments1 min readEA link

The state of AI in differ­ent coun­tries — an overview

Lizka14 Sep 2023 10:37 UTC
68 points
6 comments13 min readEA link
(aisafetyfundamentals.com)

Truth­ful AI

Owen Cotton-Barratt20 Oct 2021 15:11 UTC
55 points
14 comments10 min readEA link

[Question] What should I ask Ezra Klein about AI policy pro­pos­als?

Robert_Wiblin23 Jun 2023 16:36 UTC
21 points
4 comments1 min readEA link

Some AI re­search ar­eas and their rele­vance to ex­is­ten­tial safety

Andrew Critch15 Dec 2020 12:15 UTC
12 points
1 comment56 min readEA link
(alignmentforum.org)

Sum­mary of Si­tu­a­tional Aware­ness—The Decade Ahead

OscarD🔸8 Jun 2024 11:29 UTC
140 points
5 comments18 min readEA link

Con­crete ac­tions to im­prove AI gov­er­nance: the be­havi­our sci­ence approach

Alexander Saeri1 Dec 2022 21:34 UTC
31 points
0 comments11 min readEA link

Pod­cast (+tran­script): Nathan Barnard on how US fi­nan­cial reg­u­la­tion can in­form AI governance

Aaron Bergman8 Aug 2023 21:46 UTC
12 points
0 comments23 min readEA link
(www.aaronbergman.net)

UK’s new 10-year “Na­tional AI Strat­egy,” re­leased today

jared_m22 Sep 2021 11:18 UTC
28 points
7 comments1 min readEA link

[Question] AI strat­egy ca­reer pipeline

Zach Stein-Perlman22 May 2023 0:00 UTC
72 points
23 comments1 min readEA link

List #1: Why stop­ping the de­vel­op­ment of AGI is hard but doable

Remmelt24 Dec 2022 9:52 UTC
24 points
2 comments1 min readEA link

Ideal gov­er­nance (for com­pa­nies, coun­tries and more)

Holden Karnofsky7 Apr 2022 16:54 UTC
80 points
19 comments14 min readEA link

The Im­por­tance of Ar­tifi­cial Sentience

Jamie_Harris3 Mar 2021 17:17 UTC
70 points
10 comments11 min readEA link
(www.sentienceinstitute.org)

[Link] Cen­ter for the Gover­nance of AI (GovAI) An­nual Re­port 2018

MarkusAnderljung21 Dec 2018 16:17 UTC
24 points
0 comments1 min readEA link

Why don’t gov­ern­ments seem to mind that com­pa­nies are ex­plic­itly try­ing to make AGIs?

Ozzie Gooen23 Dec 2021 7:08 UTC
82 points
49 comments2 min readEA link

[Linkpost] OpenAI is award­ing ten 100k grants for build­ing pro­to­types of a demo­cratic pro­cess for steer­ing AI

pseudonym26 May 2023 12:49 UTC
36 points
2 comments1 min readEA link
(openai.com)

The Case for AI Adap­ta­tion: The Per­ils of Liv­ing in a World with Aligned and Well-De­ployed Trans­for­ma­tive Ar­tifi­cial Intelligence

HTC30 May 2023 18:29 UTC
3 points
1 comment7 min readEA link

The EU AI Act needs a defi­ni­tion of high-risk foun­da­tion mod­els to avoid reg­u­la­tory over­reach and backlash

matthias_samwald31 May 2023 15:34 UTC
17 points
0 comments4 min readEA link

NIST AI Risk Man­age­ment Frame­work re­quest for in­for­ma­tion (RFI)

Aryeh Englander31 Aug 2021 22:24 UTC
7 points
0 comments2 min readEA link

AI Gover­nance Read­ing Group Guide

Alex HT25 Jun 2020 10:16 UTC
26 points
2 comments3 min readEA link

Assess­ing the state of AI R&D in the US, China, and Europe – Part 1: Out­put indicators

stefan.torges1 Nov 2019 14:41 UTC
21 points
0 comments14 min readEA link

In­for­ma­tion se­cu­rity ca­reers for GCR reduction

ClaireZabel20 Jun 2019 23:56 UTC
187 points
35 comments8 min readEA link

Two con­trast­ing mod­els of “in­tel­li­gence” and fu­ture growth

Magnus Vinding24 Nov 2022 11:54 UTC
74 points
32 comments22 min readEA link

Sup­ple­ment to “The Brus­sels Effect and AI: How EU AI reg­u­la­tion will im­pact the global AI mar­ket”

MarkusAnderljung16 Aug 2022 20:55 UTC
109 points
7 comments8 min readEA link

Re­think Pri­ori­ties is hiring a Com­pute Gover­nance Re­searcher or Re­search Assistant

MichaelA🔸7 Jun 2023 13:22 UTC
36 points
2 comments8 min readEA link
(careers.rethinkpriorities.org)

Cal­ifor­ni­ans, tell your reps to vote yes on SB 1047!

Holly Elmore ⏸️ 🔸12 Aug 2024 19:49 UTC
102 points
6 comments1 min readEA link

Care­less talk on US-China AI com­pe­ti­tion? (and crit­i­cism of CAIS cov­er­age)

Oliver Sourbut20 Sep 2023 12:46 UTC
46 points
19 comments1 min readEA link
(www.oliversourbut.net)

AI gov­er­nance stu­dent hackathon on Satur­day, April 23: reg­ister now!

mic12 Apr 2022 4:39 UTC
18 points
0 comments1 min readEA link

Pal­isade is hiring Re­search Engineers

Charlie Rogers-Smith11 Nov 2023 3:09 UTC
23 points
0 comments3 min readEA link

Some tal­ent needs in AI governance

Sam Clarke13 Jun 2023 13:53 UTC
132 points
10 comments8 min readEA link

Ap­ti­tudes for AI gov­er­nance work

Sam Clarke13 Jun 2023 13:54 UTC
67 points
0 comments7 min readEA link

OpenAI’s grant pro­gram for demo­cratic pro­cess for de­cid­ing what rules AI sys­tems should follow

Ronen Bar23 Jun 2023 10:46 UTC
7 points
0 comments1 min readEA link

Hu­man­i­ties Re­search Ideas for Longtermists

Lizka9 Jun 2021 4:39 UTC
151 points
13 comments13 min readEA link

[Question] What would you do if you had a lot of money/​power/​in­fluence and you thought that AI timelines were very short?

Greg_Colbourn12 Nov 2021 21:59 UTC
29 points
8 comments1 min readEA link

Un­jour­nal: Eval­u­a­tions of “Ar­tifi­cial In­tel­li­gence and Eco­nomic Growth”, and new host­ing space

david_reinstein17 Mar 2023 20:20 UTC
47 points
0 comments2 min readEA link
(unjournal.pubpub.org)

UN Sec­re­tary-Gen­eral recog­nises ex­is­ten­tial threat from AI

Greg_Colbourn15 Jun 2023 17:03 UTC
58 points
1 comment1 min readEA link

UK gov­ern­ment to host first global sum­mit on AI Safety

DavidNash8 Jun 2023 13:24 UTC
78 points
1 comment5 min readEA link
(www.gov.uk)

Race to the Top: Bench­marks for AI Safety

isaduan4 Dec 2022 22:50 UTC
51 points
8 comments1 min readEA link

Sum­mary of the AI Bill of Rights and Policy Implications

Tristan Williams20 Jun 2023 9:28 UTC
16 points
0 comments22 min readEA link

Sha­har Avin: Near-term AI se­cu­rity risks, and what to do about them

EA Global3 Nov 2017 7:43 UTC
7 points
0 comments1 min readEA link
(www.youtube.com)

RP’s AI Gover­nance & Strat­egy team—June 2023 in­terim overview

MichaelA🔸22 Jun 2023 13:45 UTC
68 points
1 comment7 min readEA link

Re­port: Ar­tifi­cial In­tel­li­gence Risk Man­age­ment in Spain

JorgeTorresC15 Jun 2023 16:08 UTC
22 points
0 comments3 min readEA link
(riesgoscatastroficosglobales.com)

AI Safety Strat­egy—A new or­ga­ni­za­tion for bet­ter timelines

Prometheus14 Jun 2023 20:41 UTC
8 points
0 comments2 min readEA link

Prin­ci­ples for AI Welfare Research

jeffsebo19 Jun 2023 11:30 UTC
138 points
16 comments13 min readEA link

Join the Vir­tual AI Safety Un­con­fer­ence (VAISU)!

Nguyên21 Jun 2023 4:46 UTC
23 points
0 comments1 min readEA link
(vaisu.ai)

Me­tac­u­lus Pre­sents — View From the En­ter­prise Suite: How Ap­plied AI Gover­nance Works Today

christian20 Jun 2023 22:24 UTC
4 points
0 comments1 min readEA link

Up­dates from Cam­paign for AI Safety

Jolyn Khoo31 Oct 2023 5:46 UTC
14 points
1 comment2 min readEA link
(www.campaignforaisafety.org)

AI-Rele­vant Reg­u­la­tion: CPSC

SWK13 Aug 2023 15:44 UTC
3 points
0 comments6 min readEA link

Cer­tified Safe: A Schematic for Ap­proval Reg­u­la­tion of Fron­tier AI

Cole S🔸13 Aug 2024 13:15 UTC
9 points
0 comments4 min readEA link

(Re­port) Eval­u­at­ing Taiwan’s Tac­tics to Safe­guard its Semi­con­duc­tor As­sets Against a Chi­nese Invasion

Yadav7 Dec 2023 0:01 UTC
16 points
0 comments22 min readEA link
(bristolaisafety.org)

Sce­nario plan­ning for AI x-risk

Corin Katzke10 Feb 2024 0:07 UTC
40 points
0 comments15 min readEA link
(www.convergenceanalysis.org)

[Question] How in­de­pen­dent is the re­search com­ing out of OpenAI’s pre­pared­ness team?

Earthling10 Feb 2024 16:59 UTC
18 points
0 comments1 min readEA link

An EA used de­cep­tive mes­sag­ing to ad­vance her pro­ject; we need mechanisms to avoid de­on­tolog­i­cally du­bi­ous plans

MikhailSamin13 Feb 2024 23:11 UTC
24 points
39 comments5 min readEA link

Recom­men­da­tion to Ap­ply ISIC and NAICS to AI In­ci­dent Database

Ben Turse21 Jul 2024 7:25 UTC
3 points
0 comments2 min readEA link

Re­sults from the AI x Democ­racy Re­search Sprint

Esben Kran14 Jun 2024 16:40 UTC
19 points
1 comment1 min readEA link

In­tro­duc­ing StakeOut.AI

Harry Luk17 Feb 2024 0:21 UTC
52 points
6 comments9 min readEA link

AISN #31: A New AI Policy Bill in Cal­ifor­nia Plus, Prece­dents for AI Gover­nance and The EU AI Office

Center for AI Safety21 Feb 2024 21:55 UTC
27 points
0 comments6 min readEA link
(newsletter.safe.ai)

AI Policy In­sights from the AIMS Survey

Janet Pauketat22 Feb 2024 19:17 UTC
10 points
1 comment18 min readEA link
(www.sentienceinstitute.org)

Cor­po­rate Gover­nance for Fron­tier AI Labs: A Re­search Agenda

Matthew Wearden28 Feb 2024 11:32 UTC
17 points
3 comments16 min readEA link
(matthewwearden.co.uk)

‘Surveillance Cap­i­tal­ism’ & AI Gover­nance: Slip­pery Busi­ness Models, Se­cu­ri­ti­sa­tion, and Self-Regulation

Charlie Harrison29 Feb 2024 15:47 UTC
19 points
2 comments12 min readEA link

Is Text Water­mark­ing a lost cause?

Egor Timatkov1 Oct 2024 13:07 UTC
3 points
0 comments10 min readEA link

Re­duc­ing global AI com­pe­ti­tion through the Com­merce Con­trol List and Im­mi­gra­tion re­form: a dual-pronged approach

ben.smith3 Sep 2024 5:28 UTC
15 points
0 comments9 min readEA link

AI gov­er­nance tracker of each coun­try per re­gion

Alix Ramillon24 Jul 2024 17:39 UTC
16 points
2 comments23 min readEA link

An­nounc­ing Con­ver­gence Anal­y­sis: An In­sti­tute for AI Sce­nario & Gover­nance Research

David_Kristoffersson7 Mar 2024 21:18 UTC
46 points
0 comments4 min readEA link

AI gov­er­nance & China: Read­ing list

Zach Stein-Perlman18 Dec 2023 15:30 UTC
14 points
0 comments1 min readEA link
(docs.google.com)

China x AI Refer­ence List

Saad Siddiqui13 Mar 2024 18:57 UTC
61 points
3 comments3 min readEA link
(docs.google.com)

More ev­i­dence X-risk am­plifies ac­tion against cur­rent AI harms

Daniel_Friedrich22 Dec 2023 15:21 UTC
27 points
2 comments2 min readEA link
(osf.io)

Me­tac­u­lus Launches Fu­ture of AI Series, Based on Re­search Ques­tions by Arb Research

christian13 Mar 2024 21:14 UTC
34 points
0 comments1 min readEA link
(www.metaculus.com)

Lab Col­lab­o­ra­tion on AI Safety Best Prac­tices

amta17 Mar 2024 12:20 UTC
3 points
0 comments20 min readEA link

Mid­dle Pow­ers in AI Gover­nance: Po­ten­tial paths to im­pact and re­lated ques­tions.

EffectiveAdvocate🔸15 Mar 2024 20:11 UTC
5 points
1 comment5 min readEA link

Trans­for­ma­tive trust­build­ing via ad­vance­ments in de­cen­tral­ized lie detection

trevor116 Mar 2024 5:56 UTC
4 points
1 comment1 min readEA link
(www.ncbi.nlm.nih.gov)

NAIRA—An ex­er­cise in reg­u­la­tory, com­pet­i­tive safety gov­er­nance [AI Gover­nance In­sti­tu­tional De­sign idea]

Heramb Podar19 Mar 2024 14:55 UTC
5 points
1 comment6 min readEA link

AI Safety Eval­u­a­tions: A Reg­u­la­tory Review

Elliot Mckernon19 Mar 2024 15:09 UTC
12 points
2 comments11 min readEA link

Is Paus­ing AI Pos­si­ble?

Richard Annilo9 Oct 2024 13:22 UTC
86 points
4 comments18 min readEA link

AI safety ad­vo­cates should con­sider pro­vid­ing gen­tle push­back fol­low­ing the events at OpenAI

I_machinegun_Kelly22 Dec 2023 21:05 UTC
86 points
5 comments3 min readEA link
(www.lesswrong.com)

AGI will be made of het­ero­ge­neous com­po­nents, Trans­former and Selec­tive SSM blocks will be among them

Roman Leventov27 Dec 2023 14:51 UTC
5 points
0 comments1 min readEA link

2024 CFP for APSA, Largest An­nual Meet­ing of Poli­ti­cal Science

nemeryxu3 Jan 2024 19:43 UTC
2 points
0 comments1 min readEA link

Win­ning Non-Triv­ial Pro­ject: Set­ting a high stan­dard for fron­tier model security

XaviCF8 Jan 2024 11:20 UTC
31 points
0 comments18 min readEA link

AI Dis­clo­sures: A Reg­u­la­tory Review

Elliot Mckernon29 Mar 2024 11:46 UTC
12 points
1 comment7 min readEA link

Have your say on the fu­ture of AI reg­u­la­tion: Dead­line ap­proach­ing for your feed­back on UN High-Level Ad­vi­sory Body on AI In­terim Re­port ‘Govern­ing AI for Hu­man­ity’

Deborah W.A. Foulkes29 Mar 2024 6:37 UTC
17 points
1 comment1 min readEA link

God Coin: A Modest Pro­posal

Mahdi Complex1 Apr 2024 12:02 UTC
4 points
0 comments22 min readEA link

Con­scious AI con­cerns all of us. [Con­scious AI & Public Per­cep­tions]

ixex3 Jul 2024 3:12 UTC
25 points
1 comment12 min readEA link

Will we ever run out of new jobs?

Kevin Kohler19 Aug 2024 15:03 UTC
11 points
4 comments7 min readEA link
(machinocene.substack.com)

Re­port: Eval­u­at­ing an AI Chip Regis­tra­tion Policy

Deric Cheng12 Apr 2024 4:40 UTC
15 points
0 comments5 min readEA link
(www.convergenceanalysis.org)

Con­scious AI & Public Per­cep­tion: Four futures

nicoleta-k3 Jul 2024 23:06 UTC
12 points
1 comment16 min readEA link

Con­scious AI: Will we know it when we see it? [Con­scious AI & Public Per­cep­tion]

ixex4 Jul 2024 20:30 UTC
13 points
1 comment12 min readEA link

How to re­duce risks re­lated to con­scious AI: A user guide [Con­scious AI & Public Per­cep­tion]

sableye5 Jul 2024 14:19 UTC
9 points
1 comment15 min readEA link

The case for con­scious AI: Clear­ing the record [AI Con­scious­ness & Public Per­cep­tion]

sableye5 Jul 2024 20:29 UTC
3 points
7 comments8 min readEA link

De­mon­strate and eval­u­ate risks from AI to so­ciety at the AI x Democ­racy re­search hackathon

Esben Kran19 Apr 2024 14:46 UTC
24 points
0 comments6 min readEA link
(www.apartresearch.com)

Max Teg­mark — The AGI En­tente Delusion

Matrice Jacobine13 Oct 2024 17:42 UTC
0 points
1 comment1 min readEA link
(www.lesswrong.com)

Ad­vice to ju­nior AI gov­er­nance researchers

Akash8 Jul 2024 19:19 UTC
38 points
3 comments1 min readEA link

Why I’m do­ing PauseAI

Joseph Miller30 Apr 2024 16:21 UTC
141 points
34 comments1 min readEA link

AI Safety Newslet­ter #42: New­som Ve­toes SB 1047 Plus, OpenAI’s o1, and AI Gover­nance Summary

Center for AI Safety1 Oct 2024 20:33 UTC
10 points
0 comments6 min readEA link
(newsletter.safe.ai)

AI Model Registries: A Foun­da­tional Tool for AI Governance

Elliot Mckernon7 Oct 2024 13:59 UTC
18 points
0 comments1 min readEA link
(www.convergenceanalysis.org)

Ret­ro­spec­tive Case Study of Com­mu­nity Build­ing Land­scape in China | Run­ning Arete Fel­low­ship in NYU Shanghai

arghyas9 Jul 2024 18:35 UTC
18 points
1 comment12 min readEA link

An­thropic rewrote its RSP

Zach Stein-Perlman15 Oct 2024 14:30 UTC
29 points
1 comment1 min readEA link

ML4Good Brasil—Ap­pli­ca­tions Open

Nia3 May 2024 10:39 UTC
28 points
1 comment1 min readEA link

Risk Align­ment in Agen­tic AI Systems

Hayley Clatterbuck1 Oct 2024 22:51 UTC
31 points
1 comment3 min readEA link
(static1.squarespace.com)

Re­view­ing the Struc­ture of Cur­rent AI Regulations

Deric Cheng7 May 2024 12:34 UTC
32 points
1 comment13 min readEA link

AI and Chem­i­cal, Biolog­i­cal, Ra­diolog­i­cal, & Nu­clear Hazards: A Reg­u­la­tory Review

Elliot Mckernon10 May 2024 8:41 UTC
8 points
1 comment1 min readEA link

In DC, a new wave of AI lob­by­ists gains the up­per hand

Chris Leong13 May 2024 7:31 UTC
97 points
7 comments1 min readEA link
(www.politico.com)

The two-tiered society

Roman Leventov13 May 2024 7:53 UTC
14 points
5 comments1 min readEA link

Com­par­i­son of LLM scal­a­bil­ity and perfor­mance be­tween the U.S. and China based on benchmark

Ivanna_alvarado12 Oct 2024 21:51 UTC
8 points
0 comments34 min readEA link

Ad­vice for Ac­tivists from the His­tory of Environmentalism

Jeffrey Heninger16 May 2024 20:36 UTC
48 points
2 comments1 min readEA link
(blog.aiimpacts.org)

The Prob­lem With the Word ‘Align­ment’

Peli Grietzer21 May 2024 21:37 UTC
13 points
1 comment6 min readEA link

The ne­ces­sity of “Guardian AI” and two con­di­tions for its achievement

Proica28 May 2024 11:42 UTC
1 point
1 comment15 min readEA link

2024 State of AI Reg­u­la­tory Landscape

Deric Cheng28 May 2024 12:00 UTC
12 points
1 comment2 min readEA link
(www.convergenceanalysis.org)

AISN #36: Vol­un­tary Com­mit­ments are In­suffi­cient Plus, a Se­nate AI Policy Roadmap, and Chap­ter 1: An Overview of Catas­trophic Risks

Center for AI Safety30 May 2024 18:23 UTC
6 points
0 comments5 min readEA link
(newsletter.safe.ai)

Ge­offrey Hin­ton on the Past, Pre­sent, and Fu­ture of AI

Stephen McAleese12 Oct 2024 16:41 UTC
5 points
1 comment1 min readEA link

New OGL and ITAR changes are shift­ing AI Gover­nance and Policy be­low the sur­face: A sim­plified up­date

CAISID31 May 2024 7:54 UTC
12 points
2 comments3 min readEA link

Thoughts on SB-1047

Ryan Greenblatt30 May 2024 0:19 UTC
53 points
4 comments1 min readEA link

Soft Na­tion­al­iza­tion: How the US Govern­ment Will Con­trol AI Labs

Deric Cheng27 Aug 2024 15:10 UTC
98 points
5 comments21 min readEA link
(www.convergenceanalysis.org)

AI Open Source De­bate Comes Down to Trust in In­sti­tu­tions, and AI Policy Mak­ers Should Con­sider How We Can Foster It

another-anon-do-gooder20 Jan 2024 13:47 UTC
6 points
2 comments1 min readEA link

Reg­u­la­tion of AI Use for Per­sonal Data Pro­tec­tion: Com­par­i­son of Global Strate­gies and Op­por­tu­ni­ties for Latin Amer­ica

Lisbeth Guzman 14 Oct 2024 13:22 UTC
10 points
1 comment21 min readEA link

Differ­en­tial knowl­edge interconnection

Roman Leventov12 Oct 2024 12:52 UTC
3 points
1 comment1 min readEA link

Shut­ting down all com­pet­ing AI pro­jects might not buy a lot of time due to In­ter­nal Time Pressure

ThomasCederborg3 Oct 2024 0:05 UTC
6 points
1 comment12 min readEA link

[Linkpost] A Nar­row Path—How to Se­cure our Future

MathiasKB🔸2 Oct 2024 22:50 UTC
63 points
0 comments1 min readEA link
(www.narrowpath.co)

AI data gaps could lead to on­go­ing An­i­mal Suffering

Darkness8i817 Oct 2024 10:52 UTC
7 points
3 comments5 min readEA link

What AI com­pa­nies should do: Some rough ideas

Zach Stein-Perlman21 Oct 2024 14:00 UTC
14 points
1 comment1 min readEA link

The ELYSIUM Proposal

Roko16 Oct 2024 2:14 UTC
−9 points
0 comments1 min readEA link
(transhumanaxiology.substack.com)

Are we drop­ping the ball on Recom­men­da­tion AIs?

Raphaël S23 Oct 2024 19:37 UTC
5 points
0 comments1 min readEA link

Ex-OpenAI re­searcher says OpenAI mass-vi­o­lated copy­right law

Remmelt24 Oct 2024 1:00 UTC
9 points
0 comments1 min readEA link
(suchir.net)

Miles Brundage re­signed from OpenAI, and his AGI readi­ness team was disbanded

Garrison23 Oct 2024 23:42 UTC
55 points
4 comments7 min readEA link
(garrisonlovely.substack.com)

Finish­ing The SB-1047 Doc­u­men­tary In 6 Weeks

Michaël Trazzi28 Oct 2024 20:26 UTC
67 points
0 comments4 min readEA link

In­tro­duc­ing Tech Gover­nance Pro­ject

Zakariyau Yusuf29 Oct 2024 9:20 UTC
51 points
5 comments8 min readEA link

Stable to­tal­i­tar­i­anism: an overview

80000_Hours29 Oct 2024 16:07 UTC
35 points
1 comment20 min readEA link
(80000hours.org)

The Com­pendium, A full ar­gu­ment about ex­tinc­tion risk from AGI

adamShimi31 Oct 2024 12:02 UTC
9 points
1 comment2 min readEA link
(www.thecompendium.ai)

Op­tion control

Joe_Carlsmith4 Nov 2024 17:54 UTC
11 points
0 comments1 min readEA link

[Question] Can we train AI so that fu­ture philan­thropy is more effec­tive?

Ricardo Pimentel3 Nov 2024 15:08 UTC
3 points
0 comments1 min readEA link

The cur­rent state of RSPs

Zach Stein-Perlman4 Nov 2024 16:00 UTC
19 points
1 comment1 min readEA link

Eth­i­cal Roots of Chi­nese AI

Vasiliy Kondyrev5 Nov 2024 14:07 UTC
2 points
0 comments6 min readEA link

A brief his­tory of the au­to­mated corporation

Owen Cotton-Barratt4 Nov 2024 14:37 UTC
21 points
0 comments5 min readEA link
(strangecities.substack.com)

Cut­ting AI Safety down to size

Holly Elmore ⏸️ 🔸9 Nov 2024 23:40 UTC
72 points
1 comment5 min readEA link

Don’t Let Other Global Catas­trophic Risks Fall Be­hind: Sup­port ORCG in 2024

JorgeTorresC11 Nov 2024 18:27 UTC
33 points
0 comments4 min readEA link

A se­lec­tion of les­sons from Se­bas­tian Lodemann

ClaireB11 Nov 2024 21:33 UTC
54 points
1 comment7 min readEA link

AI Risk in Africa

Claude Formanek12 Oct 2021 2:28 UTC
18 points
0 comments10 min readEA link

Sha­har Avin on How to Strate­gi­cally Reg­u­late Ad­vanced AI Systems

Michaël Trazzi23 Sep 2022 15:49 UTC
48 points
2 comments4 min readEA link
(theinsideview.ai)

Idea: an AI gov­er­nance group colo­cated with ev­ery AI re­search group!

capybaralet7 Dec 2020 23:41 UTC
8 points
1 comment2 min readEA link

Nu­clear Es­pi­onage and AI Governance

GAA4 Oct 2021 18:21 UTC
32 points
3 comments24 min readEA link

The Wind­fall Clause has a reme­dies problem

John Bridge 🔸23 May 2022 10:31 UTC
40 points
0 comments17 min readEA link

Ques­tions for fur­ther in­ves­ti­ga­tion of AI diffusion

Ben Cottier21 Dec 2022 13:50 UTC
28 points
0 comments11 min readEA link

Google could build a con­scious AI in three months

Derek Shiller1 Oct 2022 13:24 UTC
16 points
22 comments7 min readEA link

On Ar­tifi­cial Gen­eral In­tel­li­gence: Ask­ing the Right Questions

Heather Douglas2 Oct 2022 5:00 UTC
−1 points
7 comments3 min readEA link

What if AI de­vel­op­ment goes well?

RoryG3 Aug 2022 8:57 UTC
25 points
7 comments12 min readEA link

Mas­sive Scal­ing Should be Frowned Upon

harsimony17 Nov 2022 17:44 UTC
9 points
0 comments5 min readEA link

Safety with­out op­pres­sion: an AI gov­er­nance problem

Nathan_Barnard28 Jul 2022 10:19 UTC
3 points
0 comments8 min readEA link

An­nounc­ing the SPT Model Web App for AI Governance

Paolo Bova4 Aug 2022 10:45 UTC
42 points
0 comments5 min readEA link

Cryp­tocur­rency Ex­ploits Show the Im­por­tance of Proac­tive Poli­cies for AI X-Risk

eSpencer16 Sep 2022 4:44 UTC
14 points
1 comment4 min readEA link

[Question] Does China have AI al­ign­ment re­sources/​in­sti­tu­tions? How can we pri­ori­tize cre­at­ing more?

JakubK4 Aug 2022 19:23 UTC
18 points
9 comments1 min readEA link

AI Alter­na­tive Fu­tures: Ex­plo­ra­tory Sce­nario Map­ping for Ar­tifi­cial In­tel­li­gence Risk—Re­quest for Par­ti­ci­pa­tion [Linkpost]

Kiliank9 May 2022 19:53 UTC
17 points
2 comments8 min readEA link

AGI al­ign­ment re­sults from a se­ries of al­igned ac­tions

hanadulset27 Dec 2021 19:33 UTC
15 points
1 comment6 min readEA link

Im­pli­ca­tions of large lan­guage model diffu­sion for AI governance

Ben Cottier21 Dec 2022 13:50 UTC
14 points
0 comments38 min readEA link

What is Com­pute? - Trans­for­ma­tive AI and Com­pute [1/​4]

lennart23 Sep 2021 13:54 UTC
48 points
6 comments18 min readEA link

CNAS re­port: ‘Ar­tifi­cial In­tel­li­gence and Arms Con­trol’

MMMaas13 Oct 2022 8:35 UTC
16 points
0 comments1 min readEA link
(www.cnas.org)

[Question] What are the most press­ing is­sues in short-term AI policy?

Eevee🔹14 Jan 2020 22:05 UTC
9 points
0 comments1 min readEA link

Who owns AI-gen­er­ated con­tent?

Johan S Daniel7 Dec 2022 3:03 UTC
−2 points
0 comments2 min readEA link

Against GDP as a met­ric for timelines and take­off speeds

kokotajlod29 Dec 2020 17:50 UTC
47 points
6 comments14 min readEA link

“Nor­mal ac­ci­dents” and AI sys­tems

Eleni_A8 Aug 2022 18:43 UTC
5 points
1 comment1 min readEA link
(www.achan.ca)

Trans­for­ma­tive AI and Com­pute [Sum­mary]

lennart23 Sep 2021 13:53 UTC
60 points
5 comments9 min readEA link

[Question] What do we do if AI doesn’t take over the world, but still causes a sig­nifi­cant global prob­lem?

James_Banks2 Aug 2020 3:35 UTC
16 points
5 comments1 min readEA link

AI Safety Overview: CERI Sum­mer Re­search Fellowship

Jamie B24 Mar 2022 15:12 UTC
29 points
0 comments2 min readEA link

Sce­nario Map­ping Ad­vanced AI Risk: Re­quest for Par­ti­ci­pa­tion with Data Collection

Kiliank27 Mar 2022 11:44 UTC
14 points
0 comments5 min readEA link

When is AI safety re­search harm­ful?

Nathan_Barnard9 May 2022 10:36 UTC
13 points
6 comments9 min readEA link

Credo AI is hiring for sev­eral roles

IanEisenberg11 Apr 2022 15:58 UTC
14 points
2 comments1 min readEA link

Where are the red lines for AI?

Karl von Wendt5 Aug 2022 9:41 UTC
13 points
3 comments6 min readEA link

Deep­Mind’s gen­er­al­ist AI, Gato: A non-tech­ni­cal explainer

frances_lorenz16 May 2022 21:19 UTC
128 points
13 comments6 min readEA link

The case for long-term cor­po­rate gov­er­nance of AI

SethBaum3 Nov 2021 10:50 UTC
42 points
3 comments8 min readEA link

Google’s ethics is alarming

len.hoang.lnh25 Feb 2021 5:57 UTC
6 points
5 comments1 min readEA link

Let’s think about slow­ing down AI

Katja_Grace23 Dec 2022 19:56 UTC
334 points
9 comments1 min readEA link

AI Benefits Post 2: How AI Benefits Differs from AI Align­ment & AI for Good

Cullen 🔸29 Jun 2020 16:59 UTC
9 points
0 comments2 min readEA link

Long-term AI policy strat­egy re­search and implementation

Benjamin_Todd9 Nov 2021 0:00 UTC
1 point
0 comments7 min readEA link
(80000hours.org)

An­nounc­ing the GovAI Policy Team

MarkusAnderljung1 Aug 2022 22:46 UTC
107 points
11 comments2 min readEA link

Fore­cast­ing Com­pute—Trans­for­ma­tive AI and Com­pute [2/​4]

lennart1 Oct 2021 8:25 UTC
39 points
6 comments19 min readEA link

Data Publi­ca­tion for the 2021 Ar­tifi­cial In­tel­li­gence, Mo­ral­ity, and Sen­tience (AIMS) Sur­vey

Janet Pauketat24 Mar 2022 15:43 UTC
21 points
0 comments3 min readEA link
(www.sentienceinstitute.org)

How to get tech­nolog­i­cal knowl­edge on AI/​ML (for non-tech peo­ple)

FangFang30 Jun 2021 7:53 UTC
62 points
7 comments5 min readEA link

What if we don’t need a “Hard Left Turn” to reach AGI?

Eigengender15 Jul 2022 9:49 UTC
39 points
7 comments4 min readEA link

England & Wales & Windfalls

John Bridge 🔸3 Jun 2022 10:26 UTC
13 points
1 comment24 min readEA link

AI Benefits Post 5: Out­stand­ing Ques­tions on Govern­ing Benefits

Cullen 🔸21 Jul 2020 16:45 UTC
5 points
0 comments4 min readEA link

Ap­ply now for the EU Tech Policy Fel­low­ship 2023

Jan-Willem11 Nov 2022 6:16 UTC
64 points
1 comment5 min readEA link

In­tro­duc­ing a New Course on the Eco­nomics of AI

akorinek21 Dec 2021 4:55 UTC
84 points
6 comments2 min readEA link

The repli­ca­tion and em­u­la­tion of GPT-3

Ben Cottier21 Dec 2022 13:49 UTC
14 points
0 comments33 min readEA link

Toby Ord’s new re­port on les­sons from the de­vel­op­ment of the atomic bomb

Ishan Mukherjee22 Nov 2022 10:37 UTC
65 points
3 comments1 min readEA link
(www.governance.ai)

Train­ing for Good—Up­date & Plans for 2023

Cillian_15 Nov 2022 16:02 UTC
80 points
1 comment10 min readEA link

Publi­ca­tion de­ci­sions for large lan­guage mod­els, and their impacts

Ben Cottier21 Dec 2022 13:50 UTC
14 points
0 comments16 min readEA link

4 Years Later: Pres­i­dent Trump and Global Catas­trophic Risk

HaydnBelfield25 Oct 2020 16:28 UTC
43 points
10 comments10 min readEA link

How long till Brus­sels?: A light in­ves­ti­ga­tion into the Brus­sels Gap

Yadav26 Dec 2022 7:49 UTC
50 points
2 comments5 min readEA link

GPT-3-like mod­els are now much eas­ier to ac­cess and de­ploy than to develop

Ben Cottier21 Dec 2022 13:49 UTC
22 points
3 comments19 min readEA link

Ap­pli­ca­tions Open: GovAI Sum­mer Fel­low­ship 2023

GovAI21 Dec 2022 15:00 UTC
28 points
0 comments2 min readEA link

Re­search + Real­ity Graph­ing to Sup­port AI Policy (and more): Sum­mary of a Frozen Project

Marcel D2 Jul 2022 20:58 UTC
34 points
2 comments8 min readEA link

A Brief Sum­mary Of The Most Im­por­tant Century

Maynk0225 Oct 2022 15:28 UTC
3 points
0 comments5 min readEA link

The AIA and its Brus­sels Effect

Kathryn O'Rourke27 Dec 2022 16:01 UTC
16 points
0 comments5 min readEA link

13 Re­cent Publi­ca­tions on Ex­is­ten­tial Risk (Jan 2021 up­date)

HaydnBelfield8 Feb 2021 12:42 UTC
7 points
2 comments10 min readEA link

A Cal­ifor­nia Effect for Ar­tifi­cial Intelligence

henryj9 Sep 2022 14:17 UTC
73 points
1 comment4 min readEA link
(docs.google.com)

Back­ground for “Un­der­stand­ing the diffu­sion of large lan­guage mod­els”

Ben Cottier21 Dec 2022 13:49 UTC
12 points
0 comments23 min readEA link

[Job]: AI Stan­dards Devel­op­ment Re­search Assistant

Tony Barrett14 Oct 2022 20:18 UTC
13 points
0 comments2 min readEA link

CSER is hiring for a se­nior re­search as­so­ci­ate on longterm AI risk and governance

Sam Clarke24 Jan 2022 13:24 UTC
9 points
4 comments1 min readEA link

In­for­ma­tion in risky tech­nol­ogy races

nemeryxu2 Aug 2022 23:35 UTC
15 points
2 comments3 min readEA link

Com­pute Gover­nance and Con­clu­sions—Trans­for­ma­tive AI and Com­pute [3/​4]

lennart14 Oct 2021 7:55 UTC
20 points
3 comments5 min readEA link

Tips for con­duct­ing wor­ld­view investigations

lukeprog12 Apr 2022 19:28 UTC
88 points
4 comments2 min readEA link

The His­tory, Episte­mol­ogy and Strat­egy of Tech­nolog­i­cal Res­traint, and les­sons for AI (short es­say)

MMMaas10 Aug 2022 11:00 UTC
90 points
6 comments9 min readEA link
(verfassungsblog.de)

In­tent al­ign­ment should not be the goal for AGI x-risk reduction

johnjnay26 Oct 2022 1:24 UTC
7 points
1 comment1 min readEA link

Com­pute Re­search Ques­tions and Met­rics—Trans­for­ma­tive AI and Com­pute [4/​4]

lennart28 Nov 2021 22:18 UTC
18 points
2 comments1 min readEA link

A Primer on God, Liber­al­ism and the End of History

Mahdi Complex28 Mar 2022 5:26 UTC
8 points
3 comments14 min readEA link

AGI Risk: How to in­ter­na­tion­ally reg­u­late in­dus­tries in non-democracies

Timothy_Liptrot16 May 2022 22:45 UTC
9 points
2 comments9 min readEA link

In­for­ma­tion se­cu­rity con­sid­er­a­tions for AI and the long term future

Jeffrey Ladish2 May 2022 20:53 UTC
127 points
8 comments11 min readEA link

[Question] AI Eth­i­cal Committee

eaaicommittee1 Mar 2022 23:35 UTC
8 points
0 comments1 min readEA link

Ar­tifi­cial In­tel­li­gence and Nu­clear Com­mand, Con­trol, & Com­mu­ni­ca­tions: The Risks of Integration

Peter Rautenbach18 Nov 2022 13:01 UTC
60 points
3 comments50 min readEA link

New Work­ing Paper Series of the Le­gal Pri­ori­ties Project

Legal Priorities Project18 Oct 2021 10:30 UTC
60 points
0 comments9 min readEA link

Cen­tre for the Study of Ex­is­ten­tial Risk Four Month Re­port June—Septem­ber 2020

HaydnBelfield2 Dec 2020 18:33 UTC
24 points
0 comments17 min readEA link

Sup­port­ing global co­or­di­na­tion in AI de­vel­op­ment: Why and how to con­tribute to in­ter­na­tional AI standards

pcihon17 Apr 2019 22:17 UTC
21 points
4 comments1 min readEA link

The Ter­minol­ogy of Ar­tifi­cial Sentience

Janet Pauketat28 Nov 2021 7:52 UTC
29 points
0 comments1 min readEA link
(www.sentienceinstitute.org)

Pivotal out­comes and pivotal processes

Andrew Critch17 Jun 2022 23:43 UTC
49 points
1 comment4 min readEA link

Is Eric Sch­midt fund­ing AI ca­pa­bil­ities re­search by the US gov­ern­ment?

Pranay K24 Dec 2022 8:32 UTC
46 points
3 comments2 min readEA link
(www.politico.com)

Drivers of large lan­guage model diffu­sion: in­cre­men­tal re­search, pub­lic­ity, and cascades

Ben Cottier21 Dec 2022 13:50 UTC
21 points
0 comments29 min readEA link

[Question] Slow­ing down AI progress?

Eleni_A26 Jul 2022 8:46 UTC
16 points
9 comments1 min readEA link

Ac­tion­able-guidance and roadmap recom­men­da­tions for the NIST AI Risk Man­age­ment Framework

Tony Barrett17 May 2022 15:27 UTC
11 points
0 comments3 min readEA link

Euro­pean Union AI Devel­op­ment and Gover­nance Part­ner­ships

EU AI Governance19 Jan 2022 10:26 UTC
22 points
1 comment4 min readEA link

Should AI fo­cus on prob­lem-solv­ing or strate­gic plan­ning? Why not both?

oliver_siegel1 Nov 2022 9:53 UTC
1 point
0 comments1 min readEA link

AI Safety Endgame Stories

IvanVendrov28 Sep 2022 17:12 UTC
31 points
1 comment1 min readEA link

Par­allels Between AI Safety by De­bate and Ev­i­dence Law

Cullen 🔸20 Jul 2020 22:52 UTC
30 points
2 comments2 min readEA link
(cullenokeefe.com)

FYI: I’m work­ing on a book about the threat of AGI/​ASI for a gen­eral au­di­ence. I hope it will be of value to the cause and the community

Darren McKee17 Jun 2022 11:52 UTC
32 points
1 comment2 min readEA link

Re­port on Semi-in­for­ma­tive Pri­ors for AI timelines (Open Philan­thropy)

Tom_Davidson26 Mar 2021 17:46 UTC
62 points
6 comments2 min readEA link

AI Benefits Post 1: In­tro­duc­ing “AI Benefits”

Cullen 🔸22 Jun 2020 16:58 UTC
10 points
2 comments3 min readEA link

Tony Blair In­sti­tute—Com­pute for AI In­dex ( Seek­ing a Sup­plier)

TomWestgarth3 Oct 2022 10:25 UTC
29 points
8 comments1 min readEA link

AI Benefits Post 3: Direct and Indi­rect Ap­proaches to AI Benefits

Cullen 🔸6 Jul 2020 18:46 UTC
5 points
0 comments2 min readEA link

Ar­tifi­cial In­tel­li­gence, Mo­ral­ity, and Sen­tience (AIMS) Sur­vey: 2021

Janet Pauketat1 Jul 2022 7:47 UTC
36 points
0 comments2 min readEA link
(www.sentienceinstitute.org)

AGI Timelines in Gover­nance: Differ­ent Strate­gies for Differ­ent Timeframes

simeon_c19 Dec 2022 21:31 UTC
110 points
19 comments1 min readEA link

How Rood­man’s GWP model trans­lates to TAI timelines

kokotajlod16 Nov 2020 14:11 UTC
22 points
0 comments2 min readEA link

Con­clu­sion and Bibliog­ra­phy for “Un­der­stand­ing the diffu­sion of large lan­guage mod­els”

Ben Cottier21 Dec 2022 13:50 UTC
12 points
0 comments11 min readEA link

The flaws that make to­day’s AI ar­chi­tec­ture un­safe and a new ap­proach that could fix it

80000_Hours22 Jun 2020 22:15 UTC
3 points
0 comments86 min readEA link
(80000hours.org)

HIRING: In­form and shape a new pro­ject on AI safety at Part­ner­ship on AI

Madhulika Srikumar24 Nov 2021 16:29 UTC
11 points
2 comments1 min readEA link

Any fur­ther work on AI Safety Suc­cess Sto­ries?

Krieger2 Oct 2022 11:59 UTC
4 points
0 comments1 min readEA link

[Question] What “defense lay­ers” should gov­ern­ments, AI labs, and busi­nesses use to pre­vent catas­trophic AI failures?

alexlintz3 Dec 2021 14:24 UTC
37 points
3 comments1 min readEA link

In­ter­na­tional co­op­er­a­tion as a tool to re­duce two ex­is­ten­tial risks.

johl@umich.edu19 Apr 2021 16:51 UTC
28 points
4 comments23 min readEA link

Stu­art Rus­sell Hu­man Com­pat­i­ble AI Roundtable with Allan Dafoe, Rob Re­ich, & Ma­ri­etje Schaake

Mahendra Prasad11 Feb 2021 7:43 UTC
16 points
0 comments1 min readEA link

Align­ing AI with Hu­mans by Lev­er­ag­ing Le­gal Informatics

johnjnay18 Sep 2022 7:43 UTC
20 points
11 comments3 min readEA link

Pos­si­ble di­rec­tions in AI ideal gov­er­nance research

RoryG10 Aug 2022 8:36 UTC
5 points
0 comments3 min readEA link

Con­tribute by fa­cil­i­tat­ing the AGI Safety Fun­da­men­tals Programme

Jamie B6 Dec 2021 11:50 UTC
27 points
0 comments2 min readEA link

A challenge for AGI or­ga­ni­za­tions, and a challenge for readers

RobBensinger1 Dec 2022 23:11 UTC
172 points
13 comments1 min readEA link

How Open Source Ma­chine Learn­ing Soft­ware Shapes AI

Max L28 Sep 2022 17:49 UTC
11 points
3 comments15 min readEA link
(maxlangenkamp.me)

Credo AI is hiring!

IanEisenberg3 Mar 2022 18:02 UTC
16 points
6 comments4 min readEA link

*New* Canada AI Safety & Gover­nance community

Wyatt Tessari L'Allié29 Aug 2022 15:58 UTC
32 points
2 comments1 min readEA link

A col­lec­tion of AI Gover­nance-re­lated Pod­casts, Newslet­ters, Blogs, and more

alexlintz2 Oct 2021 0:46 UTC
24 points
1 comment1 min readEA link

Nine Points of Col­lec­tive Insanity

Remmelt27 Dec 2022 3:14 UTC
1 point
0 comments1 min readEA link

A course for the gen­eral pub­lic on AI

LeandroD31 Aug 2020 1:29 UTC
1 point
0 comments1 min readEA link

Ap­pendix to Bridg­ing Demonstration

mako yass1 Jun 2022 20:30 UTC
18 points
2 comments28 min readEA link

Does gen­er­al­ity pay? GPT-3 can provide pre­limi­nary ev­i­dence.

Eevee🔹12 Jul 2020 18:53 UTC
21 points
4 comments2 min readEA link

Main paths to im­pact in EU AI Policy

JOMG_Monnet8 Dec 2022 16:17 UTC
69 points
2 comments8 min readEA link

Les­sons from Three Mile Is­land for AI Warn­ing Shots

NickGabs26 Sep 2022 2:47 UTC
42 points
0 comments15 min readEA link

Un­der­stand­ing the diffu­sion of large lan­guage mod­els: summary

Ben Cottier21 Dec 2022 13:49 UTC
127 points
18 comments22 min readEA link

Book re­view: Ar­chi­tects of In­tel­li­gence by Martin Ford (2018)

Ofer11 Aug 2020 17:24 UTC
11 points
1 comment2 min readEA link

[Link and com­men­tary] Beyond Near- and Long-Term: Towards a Clearer Ac­count of Re­search Pri­ori­ties in AI Ethics and Society

MichaelA🔸14 Mar 2020 9:04 UTC
18 points
0 comments6 min readEA link

The ‘Old AI’: Les­sons for AI gov­er­nance from early elec­tric­ity regulation

Sam Clarke19 Dec 2022 2:46 UTC
58 points
1 comment13 min readEA link

FLI is hiring a new Direc­tor of US Policy

aaguirre27 Jul 2022 0:07 UTC
14 points
0 comments1 min readEA link

Why we need a new agency to reg­u­late ad­vanced ar­tifi­cial intelligence

Michael Huang4 Aug 2022 13:38 UTC
25 points
0 comments1 min readEA link
(www.brookings.edu)

The Slip­pery Slope from DALLE-2 to Deep­fake Anarchy

stecas5 Nov 2022 14:47 UTC
55 points
11 comments17 min readEA link

[Pod­cast] Ajeya Co­tra on wor­ld­view di­ver­sifi­ca­tion and how big the fu­ture could be

Eevee🔹22 Jan 2021 23:57 UTC
57 points
20 comments1 min readEA link
(80000hours.org)

Will the EU reg­u­la­tions on AI mat­ter to the rest of the world?

hanadulset1 Jan 2022 21:56 UTC
33 points
5 comments5 min readEA link

In­sti­tu­tions Can­not Res­train Dark-Triad AI Exploitation

Remmelt27 Dec 2022 10:34 UTC
8 points
0 comments1 min readEA link

Sur­vey on AI ex­is­ten­tial risk scenarios

Sam Clarke8 Jun 2021 17:12 UTC
154 points
11 comments6 min readEA link

How might we al­ign trans­for­ma­tive AI if it’s de­vel­oped very soon?

Holden Karnofsky29 Aug 2022 15:48 UTC
163 points
17 comments44 min readEA link

What does it mean to be­come an ex­pert in AI Hard­ware?

Toph9 Jan 2021 4:15 UTC
87 points
10 comments11 min readEA link

Three new re­ports re­view­ing re­search and con­cepts in ad­vanced AI governance

MMMaas28 Nov 2023 9:21 UTC
32 points
0 comments2 min readEA link
(www.legalpriorities.org)

‘Ar­tifi­cial In­tel­li­gence Gover­nance un­der Change’ (PhD dis­ser­ta­tion)

MMMaas15 Sep 2022 12:10 UTC
54 points
1 comment2 min readEA link
(drive.google.com)

Birds, Brains, Planes, and AI: Against Ap­peals to the Com­plex­ity/​Mys­te­ri­ous­ness/​Effi­ciency of the Brain

kokotajlod18 Jan 2021 12:39 UTC
27 points
2 comments1 min readEA link

The Pug­wash Con­fer­ences and the Anti-Bal­lis­tic Mis­sile Treaty as a case study of Track II diplomacy

rani_martin16 Sep 2022 10:42 UTC
82 points
5 comments27 min readEA link

Quick Thoughts on A.I. Governance

Nicholas / Heather Kross30 Apr 2022 14:49 UTC
43 points
0 comments2 min readEA link
(www.thinkingmuchbetter.com)

[Linkpost] “Blueprint for an AI Bill of Rights”—Office of Science and Tech­nol­ogy Policy, USA (2022)

QubitSwarm995 Oct 2022 16:48 UTC
15 points
0 comments1 min readEA link

How Europe might mat­ter for AI governance

stefan.torges12 Jul 2019 23:42 UTC
52 points
13 comments8 min readEA link

Rac­ing through a minefield: the AI de­ploy­ment problem

Holden Karnofsky31 Dec 2022 21:44 UTC
79 points
1 comment13 min readEA link
(www.cold-takes.com)

Large Lan­guage Models as Cor­po­rate Lob­by­ists, and Im­pli­ca­tions for So­cietal-AI Alignment

johnjnay4 Jan 2023 22:22 UTC
10 points
6 comments8 min readEA link

Went­worth and Larsen on buy­ing time

Akash9 Jan 2023 21:31 UTC
48 points
0 comments1 min readEA link

[Ru­mour] Microsoft to in­vest $10B in OpenAI, will re­ceive 75% of prof­its un­til they re­coup in­vest­ment: GPT would be in­te­grated with Office

𝕮𝖎𝖓𝖊𝖗𝖆10 Jan 2023 23:43 UTC
25 points
2 comments1 min readEA link

Slay­ing the Hy­dra: to­ward a new game board for AI

Prometheus23 Jun 2023 17:04 UTC
3 points
2 comments1 min readEA link

[Question] Should AI writ­ers be pro­hibited in ed­u­ca­tion?

Eleni_A16 Jan 2023 22:29 UTC
3 points
2 comments1 min readEA link

Are New Ideas in AI Get­ting Harder to Find?

Charlie Harrison9 Jun 2024 15:35 UTC
21 points
0 comments5 min readEA link

AI safety mile­stones?

Zach Stein-Perlman23 Jan 2023 21:30 UTC
6 points
0 comments1 min readEA link

AI Gover­nance Read­ing Group [Toronto+re­mote]

Liav.Koren24 Jan 2023 22:05 UTC
2 points
0 comments1 min readEA link

Ap­ply to HAIST/​MAIA’s AI Gover­nance Work­shop in DC (Feb 17-20)

Phosphorous28 Jan 2023 0:45 UTC
15 points
0 comments1 min readEA link
(www.lesswrong.com)

Assess­ing China’s im­por­tance as an AI superpower

JulianHazell3 Feb 2023 11:08 UTC
89 points
7 comments1 min readEA link
(muddyclothes.substack.com)

Launch­ing The Col­lec­tive In­tel­li­gence Pro­ject: Whitepa­per and Pilots

jasmine_wang6 Feb 2023 17:00 UTC
38 points
8 comments2 min readEA link
(cip.org)

High im­pact job op­por­tu­nity at ARIA (UK)

Rasool12 Feb 2023 10:35 UTC
80 points
0 comments1 min readEA link

How to ‘troll for good’: Lev­er­ag­ing IP for AI governance

Michael Huang26 Feb 2023 6:34 UTC
26 points
3 comments1 min readEA link
(www.science.org)

Very Briefly: The CHIPS Act

Yadav26 Feb 2023 13:53 UTC
40 points
3 comments1 min readEA link
(www.y1d2.com)

[Question] An eco­nomics of AI gov—best re­sources for

Liv26 Feb 2023 11:11 UTC
10 points
4 comments1 min readEA link

Call for Cruxes by Rhyme, a Longter­mist His­tory Con­sul­tancy

Lara_TH1 Mar 2023 10:20 UTC
147 points
6 comments3 min readEA link

[Question] What are some sources re­lated to big-pic­ture AI strat­egy?

Jacob Watts🔸2 Mar 2023 5:04 UTC
9 points
4 comments1 min readEA link

Distil­la­tion of The Offense-Defense Balance of Scien­tific Knowledge

Arjun Yadav12 Aug 2022 7:01 UTC
17 points
0 comments2 min readEA link

A con­cern­ing ob­ser­va­tion from me­dia cov­er­age of AI in­dus­try dynamics

Justin Olive2 Mar 2023 23:56 UTC
48 points
5 comments3 min readEA link

Paper Sum­mary: The Effec­tive­ness of AI Ex­is­ten­tial Risk Com­mu­ni­ca­tion to the Amer­i­can and Dutch Public

Otto9 Mar 2023 10:40 UTC
97 points
11 comments4 min readEA link

[Question] What would need to be true for AI to trans­late a le­gal con­tract to a smart con­tract?

Patrick Liu18 Mar 2023 16:42 UTC
−1 points
0 comments1 min readEA link

Ques­tions about Con­je­cure’s CoEm proposal

Akash9 Mar 2023 19:32 UTC
19 points
0 comments1 min readEA link

[Linkpost] Scott Alexan­der re­acts to OpenAI’s lat­est post

Akash11 Mar 2023 22:24 UTC
105 points
4 comments1 min readEA link

Video and Tran­script of Pre­sen­ta­tion on Ex­is­ten­tial Risk from Power-Seek­ing AI

Joe_Carlsmith8 May 2022 3:52 UTC
97 points
7 comments30 min readEA link

[Question] Is AI like disk drives?

Tanae2 Sep 2023 19:12 UTC
8 points
1 comment1 min readEA link

Trans­for­ma­tive AI and Com­pute—Read­ing List

Frederik Berg4 Sep 2023 6:21 UTC
24 points
0 comments1 min readEA link
(docs.google.com)

Five ne­glected work ar­eas that could re­duce AI risk

Aaron_Scher24 Sep 2023 2:09 UTC
22 points
0 comments9 min readEA link

Look­ing for Cana­dian sum­mer co-op po­si­tion in AI Governance

tcelferact26 Jun 2023 17:27 UTC
6 points
2 comments1 min readEA link

Let’s set new AI safety ac­tors up for success

michel26 Jun 2023 21:17 UTC
33 points
1 comment9 min readEA link

How to pur­sue a ca­reer in AI gov­er­nance and coordination

Cody_Fenwick25 Sep 2023 12:00 UTC
32 points
1 comment29 min readEA link
(80000hours.org)

Biosafety Reg­u­la­tions (BMBL) and their rele­vance for AI

stepanlos29 Jun 2023 19:20 UTC
7 points
0 comments4 min readEA link

Open Agency model can solve the AI reg­u­la­tion dilemma

Roman Leventov9 Nov 2023 15:22 UTC
4 points
0 comments2 min readEA link

Public Opinion on AI Safety: AIMS 2023 and 2021 Summary

Janet Pauketat25 Sep 2023 18:09 UTC
19 points
0 comments3 min readEA link
(www.sentienceinstitute.org)

Fun­da­men­tal Challenges in AI Governance

Tharin23 Oct 2023 1:30 UTC
7 points
1 comment7 min readEA link

An­nounc­ing New Begin­ner-friendly Book on AI Safety and Risk

Darren McKee25 Nov 2023 15:57 UTC
112 points
9 comments1 min readEA link

AI Safety is Drop­ping the Ball on Clown Attacks

trevor121 Oct 2023 23:15 UTC
−17 points
0 comments1 min readEA link

On ex­clud­ing dan­ger­ous in­for­ma­tion from training

ShayBenMoshe17 Nov 2023 20:09 UTC
8 points
0 comments3 min readEA link
(www.lesswrong.com)

The Wizard of Oz Prob­lem: How in­cen­tives and nar­ra­tives can skew our per­cep­tion of AI developments

Akash20 Mar 2023 22:36 UTC
16 points
0 comments1 min readEA link

An­nounc­ing #AISum­mitTalks fea­tur­ing Pro­fes­sor Stu­art Rus­sell and many others

Otto24 Oct 2023 10:16 UTC
9 points
1 comment1 min readEA link

[Question] Am I tak­ing crazy pills? Why aren’t EAs ad­vo­cat­ing for a pause on AI ca­pa­bil­ities?

yanni kyriacos15 Aug 2023 23:29 UTC
18 points
21 comments1 min readEA link

Credo AI is hiring for AI Gov Re­searcher & more!

IanEisenberg15 Aug 2023 21:10 UTC
8 points
0 comments3 min readEA link

Cap­ping AGI profits

Luke Frymire21 Mar 2023 13:29 UTC
12 points
2 comments4 min readEA link

Go Mo­bi­lize? Les­sons from GM Protests for Paus­ing AI

Charlie Harrison24 Oct 2023 15:01 UTC
48 points
11 comments31 min readEA link

What is ev­ery­one do­ing in AI governance

Igor Ivanov8 Jul 2023 15:19 UTC
30 points
0 comments5 min readEA link

AI Risk and Sur­vivor­ship Bias—How An­dreessen and LeCun got it wrong

stepanlos14 Jul 2023 17:10 UTC
5 points
1 comment6 min readEA link

Scal­ing and Sus­tain­ing Stan­dards: A Case Study on the Basel Accords

Conrad K.16 Jul 2023 18:18 UTC
18 points
0 comments7 min readEA link
(docs.google.com)

Aus­trali­ans call for AI safety to be taken seriously

Alexander Saeri21 Jul 2023 1:16 UTC
51 points
1 comment1 min readEA link

AI-Rele­vant Reg­u­la­tion: In­surance in Safety-Crit­i­cal Industries

SWK22 Jul 2023 17:52 UTC
5 points
0 comments6 min readEA link

Ap­ply to CEEALAR to do AGI mora­to­rium work

Greg_Colbourn26 Jul 2023 21:24 UTC
62 points
0 comments1 min readEA link

Com­pli­ance Mon­i­tor­ing as an Im­pact­ful Mechanism of AI Safety Policy

CAISID7 Feb 2024 16:10 UTC
4 points
3 comments9 min readEA link

Join the AI gov­er­nance and in­ter­pretabil­ity hackathons!

Esben Kran23 Mar 2023 14:39 UTC
33 points
1 comment5 min readEA link
(alignmentjam.com)

[Cross­post] An AI Pause Is Hu­man­ity’s Best Bet For Prevent­ing Ex­tinc­tion (TIME)

Otto24 Jul 2023 10:18 UTC
36 points
3 comments7 min readEA link
(time.com)

[Question] Should we na­tion­al­ize AI de­vel­op­ment?

Jadon Schmitt20 Jul 2023 5:31 UTC
5 points
4 comments1 min readEA link

EU’s AI am­bi­tions at risk as US pushes to wa­ter down in­ter­na­tional treaty (linkpost)

mic31 Jul 2023 0:34 UTC
9 points
0 comments1 min readEA link
(www.euractiv.com)

Towards ev­i­dence gap-maps for AI safety

dEAsign25 Jul 2023 8:13 UTC
6 points
1 comment2 min readEA link

Open ques­tions on a Chi­nese in­va­sion of Taiwan and its effects on the semi­con­duc­tor stock

Yadav7 Dec 2023 16:39 UTC
21 points
0 comments2 min readEA link

What term to use for AI in differ­ent policy con­texts?

oeg6 Sep 2023 15:08 UTC
18 points
3 comments9 min readEA link

Carl Shul­man on AI takeover mechanisms (& more): Part II of Dwarkesh Pa­tel in­ter­view for The Lu­nar Society

Alejandro Ortega25 Jul 2023 18:31 UTC
28 points
0 comments5 min readEA link
(www.dwarkeshpatel.com)

How long will reach­ing a Risk Aware­ness Mo­ment and CHARTS agree­ment take?

Yadav6 Sep 2023 16:39 UTC
12 points
0 comments14 min readEA link

What we can learn from stress test­ing for AI regulation

Nathan_Barnard17 Jul 2023 19:56 UTC
27 points
0 comments26 min readEA link

LawAI’s Sum­mer Re­search Fel­low­ship – ap­ply by Fe­bru­ary 16

LawAI7 Feb 2024 21:01 UTC
51 points
2 comments2 min readEA link

As­ter­isk Magaz­ine Is­sue 03: AI

Alejandro Ortega24 Jul 2023 15:53 UTC
34 points
3 comments1 min readEA link
(asteriskmag.com)

In­ter­na­tional AI In­sti­tu­tions: a liter­a­ture re­view of mod­els, ex­am­ples, and pro­pos­als

MMMaas26 Sep 2023 15:26 UTC
53 points
0 comments2 min readEA link

Thoughts on re­spon­si­ble scal­ing poli­cies and regulation

Paul_Christiano24 Oct 2023 22:25 UTC
179 points
5 comments6 min readEA link

We are already in a per­sua­sion-trans­formed world and must take precautions

trevor14 Nov 2023 15:53 UTC
1 point
0 comments1 min readEA link

The 6D effect: When com­pa­nies take risks, one email can be very pow­er­ful.

stecas4 Nov 2023 20:08 UTC
40 points
1 comment1 min readEA link

(4 min read) An in­tu­itive ex­pla­na­tion of the AI in­fluence situation

trevor113 Jan 2024 17:34 UTC
1 point
1 comment1 min readEA link

Tran­script: NBC Nightly News: AI ‘race to reck­less­ness’ w/​ Tris­tan Har­ris, Aza Raskin

WilliamKiely23 Mar 2023 3:45 UTC
47 points
1 comment1 min readEA link

ChatGPT bug leaked users’ con­ver­sa­tion histories

Ian Turner27 Mar 2023 0:17 UTC
15 points
2 comments1 min readEA link
(www.bbc.com)

Govern­ing High-Im­pact AI Sys­tems: Un­der­stand­ing Canada’s Pro­posed AI Bill. April 15, Car­leton Univer­sity, Ottawa

Liav.Koren27 Mar 2023 23:11 UTC
3 points
0 comments1 min readEA link
(www.eventbrite.com)

Paus­ing AI Devel­op­ments Isn’t Enough. We Need to Shut it All Down by Eliezer Yudkowsky

jacquesthibs29 Mar 2023 23:30 UTC
211 points
75 comments3 min readEA link
(time.com)

[Question] What are the ar­gu­ments that sup­port China build­ing AGI+ if Western com­pa­nies de­lay/​pause AI de­vel­op­ment?

DMMF29 Mar 2023 18:53 UTC
32 points
9 comments1 min readEA link

Want to win the AGI race? Solve al­ign­ment.

leopold29 Mar 2023 15:19 UTC
56 points
6 comments5 min readEA link
(www.forourposterity.com)

Nu­clear brinks­man­ship is not a good AI x-risk strategy

titotal30 Mar 2023 22:07 UTC
19 points
8 comments5 min readEA link

The fun­da­men­tal hu­man value is power.

Linyphia30 Mar 2023 15:15 UTC
−1 points
5 comments1 min readEA link

Gover­nance of AI, Break­fast Ce­real, Car Fac­to­ries, Etc.

Jeff Martin6 Nov 2023 1:44 UTC
2 points
0 comments3 min readEA link

Pes­simism about AI Safety

Max_He-Ho2 Apr 2023 7:57 UTC
5 points
0 comments25 min readEA link
(www.lesswrong.com)

Re­duc­ing profit mo­ti­va­tions in AI development

Luke Frymire3 Apr 2023 20:04 UTC
19 points
1 comment6 min readEA link

If in­ter­pretabil­ity re­search goes well, it may get dangerous

So8res3 Apr 2023 21:48 UTC
33 points
0 comments1 min readEA link

What to sug­gest com­pa­nies & en­trepreneurs do to use AI safely?

AlfalfaBloom5 Apr 2023 22:36 UTC
11 points
1 comment1 min readEA link

[Question] How should tech­ni­cal AI re­searchers best tran­si­tion into AI gov­er­nance and policy?

GabeM10 Sep 2023 5:29 UTC
12 points
5 comments1 min readEA link

Paus­ing AI Devel­op­ments Isn’t Enough. We Need to Shut it All Down

EliezerYudkowsky9 Apr 2023 15:53 UTC
50 points
3 comments1 min readEA link

A New Model for Com­pute Cen­ter Verification

Damin Curtis🔹10 Oct 2023 19:23 UTC
21 points
2 comments5 min readEA link

Re­spon­si­ble Scal­ing Poli­cies Are Risk Man­age­ment Done Wrong

simeon_c25 Oct 2023 23:46 UTC
42 points
1 comment1 min readEA link
(www.navigatingrisks.ai)

Scal­able And Trans­fer­able Black-Box Jailbreaks For Lan­guage Models Via Per­sona Modulation

soroushjp7 Nov 2023 18:00 UTC
10 points
0 comments2 min readEA link
(arxiv.org)

[linkpost] AI NOW In­sti­tute’s 2023 An­nual Re­port & Roadmap

Tristan Williams12 Apr 2023 20:00 UTC
9 points
0 comments2 min readEA link
(ainowinstitute.org)

[linkpost] “What Are Rea­son­able AI Fears?” by Robin Han­son, 2023-04-23

Arjun Panickssery14 Apr 2023 23:26 UTC
41 points
3 comments4 min readEA link
(quillette.com)

Ge­offrey Miller on Cross-Cul­tural Un­der­stand­ing Between China and Western Coun­tries as a Ne­glected Con­sid­er­a­tion in AI Alignment

Evan_Gaensbauer17 Apr 2023 3:26 UTC
25 points
2 comments4 min readEA link

Sum­mary: The Case for Halt­ing AI Devel­op­ment—Max Teg­mark on the Lex Frid­man Podcast

Madhav Malhotra16 Apr 2023 22:28 UTC
38 points
4 comments4 min readEA link
(youtu.be)

No, the EMH does not im­ply that mar­kets have long AGI timelines

Jakob24 Apr 2023 8:27 UTC
83 points
21 comments8 min readEA link

Un-un­plug­ga­bil­ity—can’t we just un­plug it?

Oliver Sourbut15 May 2023 13:23 UTC
15 points
0 comments1 min readEA link
(www.oliversourbut.net)

AI Im­pacts Quar­terly Newslet­ter, Jan-Mar 2023

Harlan17 Apr 2023 23:07 UTC
20 points
1 comment3 min readEA link
(blog.aiimpacts.org)

[Opz­ionale] Il panorama della gov­er­nance lun­goter­minista delle in­tel­li­genze artificiali

EA Italy17 Jan 2023 11:03 UTC
1 point
0 comments10 min readEA link

OPEC for a slow AGI takeoff

vyrax21 Apr 2023 10:53 UTC
4 points
0 comments3 min readEA link

Deep­Mind and Google Brain are merg­ing [Linkpost]

Akash20 Apr 2023 18:47 UTC
32 points
1 comment1 min readEA link

Stu­dent com­pe­ti­tion for draft­ing a treaty on mora­to­rium of large-scale AI ca­pa­bil­ities R&D

Nayanika24 Apr 2023 13:15 UTC
36 points
4 comments2 min readEA link

Briefly how I’ve up­dated since ChatGPT

rime25 Apr 2023 19:39 UTC
29 points
7 comments2 min readEA link
(www.lesswrong.com)

Refram­ing the bur­den of proof: Com­pa­nies should prove that mod­els are safe (rather than ex­pect­ing au­di­tors to prove that mod­els are dan­ger­ous)

Akash25 Apr 2023 18:49 UTC
35 points
1 comment1 min readEA link

Pro­pos­als for the AI Reg­u­la­tory Sand­box in Spain

Guillem Bas27 Apr 2023 10:33 UTC
55 points
2 comments11 min readEA link
(riesgoscatastroficosglobales.com)

An ar­gu­ment for ac­cel­er­at­ing in­ter­na­tional AI gov­er­nance re­search (part 2)

MattThinks22 Aug 2023 22:40 UTC
3 points
0 comments10 min readEA link

In­tro­duc­ing the AI Ob­jec­tives In­sti­tute’s Re­search: Differ­en­tial Paths to­ward Safe and Benefi­cial AI

cmck5 May 2023 20:26 UTC
43 points
1 comment8 min readEA link

Im­pli­ca­tions of the White­house meet­ing with AI CEOs for AI su­per­in­tel­li­gence risk—a first-step to­wards evals?

Jamie B7 May 2023 17:33 UTC
78 points
3 comments7 min readEA link

[Question] Ben Horow­itz and oth­ers are spread­ing a “reg­u­la­tion is bad” view. Would it be use­ful to have a pub­lic bet on “would Ben up­date his view if he had 1-1 with X-Risk re­searcher?”, and urge Ben to run such an ex­per­i­ment?

AntonOsika8 Aug 2023 6:36 UTC
2 points
0 comments1 min readEA link

Open call: AI Act Stan­dard for Dev. Phase Risk Assess­ment

miller-max8 Dec 2023 19:57 UTC
5 points
1 comment1 min readEA link

Tar­bell Fel­low­ship 2024 - Ap­pli­ca­tions Open (AI Jour­nal­ism)

Cillian_28 Sep 2023 10:38 UTC
58 points
1 comment3 min readEA link

The In­ter­na­tional PauseAI Protest: Ac­tivism un­der uncertainty

Joseph Miller12 Oct 2023 17:36 UTC
129 points
3 comments4 min readEA link

Ap­pli­ca­tions for EU Tech Policy Fel­low­ship 2024 now open

Jan-Willem13 Sep 2023 16:17 UTC
22 points
2 comments1 min readEA link

[Cross­post] AI Reg­u­la­tion May Be More Im­por­tant Than AI Align­ment For Ex­is­ten­tial Safety

Otto24 Aug 2023 16:01 UTC
14 points
2 comments5 min readEA link

Effi­cacy of AI Ac­tivism: Have We Ever Said No?

Charlie Harrison27 Oct 2023 16:52 UTC
78 points
25 comments20 min readEA link

Op­por­tu­ni­ties for Im­pact Beyond the EU AI Act

Cillian_12 Oct 2023 15:06 UTC
27 points
2 comments4 min readEA link

Re­sources & op­por­tu­ni­ties for ca­reers in Euro­pean AI Policy

Cillian_12 Oct 2023 15:02 UTC
13 points
1 comment2 min readEA link

Re­think Pri­ori­ties is look­ing for a (Co-)Founder for a New Pro­ject: Field Build­ing in Univer­si­ties for AI Policy Ca­reers in the US

KevinN28 Aug 2023 16:01 UTC
59 points
0 comments6 min readEA link
(careers.rethinkpriorities.org)

Re­boot­ing AI Gover­nance: An AI-Driven Ap­proach to AI Governance

Utilon20 May 2023 19:06 UTC
38 points
4 comments30 min readEA link

What AI could mean for al­ter­na­tive proteins

Max Taylor9 Feb 2024 10:13 UTC
32 points
3 comments16 min readEA link

[Linkpost] “Gover­nance of su­per­in­tel­li­gence” by OpenAI

Daniel_Eth22 May 2023 20:15 UTC
51 points
6 comments2 min readEA link
(openai.com)

Some gov­er­nance re­search ideas to pre­vent malev­olent con­trol over AGI and why this might mat­ter a hell of a lot

Jim Buhler23 May 2023 13:07 UTC
63 points
5 comments16 min readEA link

AI Safety Newslet­ter #7: Dis­in­for­ma­tion, Gover­nance Recom­men­da­tions for AI labs, and Se­nate Hear­ings on AI

Center for AI Safety23 May 2023 21:42 UTC
23 points
0 comments6 min readEA link
(newsletter.safe.ai)

Deep­Mind: Model eval­u­a­tion for ex­treme risks

Zach Stein-Perlman25 May 2023 3:00 UTC
48 points
2 comments1 min readEA link

By failing to take se­ri­ous AI ac­tion, the US could be in vi­o­la­tion of its in­ter­na­tional law obligations

Cecil Abungu 27 May 2023 4:25 UTC
44 points
1 comment10 min readEA link

List of Masters Pro­grams in Tech Policy, Public Policy and Se­cu­rity (Europe)

sberg29 May 2023 10:23 UTC
47 points
0 comments3 min readEA link

An­nounc­ing Apollo Research

mariushobbhahn30 May 2023 16:17 UTC
156 points
5 comments1 min readEA link

Catas­trophic Risks from Un­safe AI: Nav­i­gat­ing a Tightrope Sce­nario (Ben Garfinkel, EAG Lon­don 2023)

Alexander Saeri2 Jun 2023 9:59 UTC
19 points
1 comment10 min readEA link

A sur­vey of con­crete risks de­rived from Ar­tifi­cial Intelligence

Guillem Bas8 Jun 2023 22:09 UTC
36 points
2 comments6 min readEA link
(riesgoscatastroficosglobales.com)

Ap­pli­ca­tions open for AI Safety Fun­da­men­tals: Gover­nance Course

Jamie B2 Jun 2023 16:08 UTC
79 points
3 comments2 min readEA link
(www.aisafetyfundamentals.com)

The Risks of AI-Gen­er­ated Con­tent on the EA Forum

WobblyPanda24 Jun 2023 5:33 UTC
−1 points
0 comments1 min readEA link

From vol­un­tary to manda­tory, are the ESG dis­clo­sure frame­works still fer­tile ground for un­re­al­ised EA ca­reer path­ways? – A 2023 up­date on ESG po­ten­tial impact

Christopher Chan4 Jun 2023 12:00 UTC
21 points
5 comments11 min readEA link

Sur­vey: How Do Elite Chi­nese Stu­dents Feel About the Risks of AI?

Nick Corvino2 Sep 2024 9:14 UTC
107 points
9 comments10 min readEA link

Me­tac­u­lus Launches Chi­nese AI Chips Tour­na­ment, Sup­port­ing In­sti­tute for AI Policy and Strat­egy Research

christian6 Dec 2023 11:26 UTC
27 points
0 comments1 min readEA link
(www.metaculus.com)

Hiring a CEO & EU Tech Policy Lead to launch an AI policy ca­reer org in Europe

Cillian_6 Dec 2023 13:52 UTC
50 points
0 comments7 min readEA link
No comments.