RSS

AI governance

TagLast edit: Jul 22, 2022, 7:52 PM by Pablo

AI governance (or the governance of artificial intelligence) is the study of norms, policies, and institutions that can help humanity navigate the transition to a world with advanced artificial intelligence. This includes a broad range of subjects, from global coordination around regulating AI development to providing incentives for corporations to be more cautious in their AI research.

AI governance as a career

Long-term AI policy strategy research and implementation is one of 80,000 Hours’ “priority paths”—the most promising career opportunities the organization has identified so far.[1][2]

Further reading

Brundage, Miles (2017) Guide to working in AI policy and strategy, 80,000 Hours, June 7.

Cussins, Jessica (2020) Summaries of AI policy resources, Future of Life Institute.

Dafoe, Allan (2020) AI governance: opportunity and theory of impact, Effective Altruism Forum, September 17.

Muehlhauser, Luke (2021) A personal take on longtermist AI governance, Effective Altruism Forum, July 21.

Related entries

AI alignment | AI forecasting | alignment tax | antitrust law | compute governance | economics of artificial intelligence | ethics of artificial intelligence | global governance | standards and regulation

  1. ^

    Todd, Benjamin (2018) The highest impact career paths our research has identified so far, 80,000 Hours, August 12.

  2. ^

    Todd, Benjamin (2021) Long-term AI policy strategy research and implementation, 80,000 Hours, October.

AI Gover­nance: Op­por­tu­nity and The­ory of Impact

Allan DafoeSep 17, 2020, 6:30 AM
262 points
19 comments12 min readEA link

Some AI Gover­nance Re­search Ideas

MarkusAnderljungJun 3, 2021, 10:51 AM
102 points
5 comments2 min readEA link

A per­sonal take on longter­mist AI governance

lukeprogJul 16, 2021, 10:08 PM
173 points
6 comments7 min readEA link

Sin­ga­pore AI Policy Ca­reer Guide

Yi-YangJan 21, 2021, 3:05 AM
28 points
0 comments5 min readEA link

A Map to Nav­i­gate AI Governance

hanadulsetFeb 14, 2022, 10:41 PM
72 points
11 comments25 min readEA link

Katja Grace: Let’s think about slow­ing down AI

peterhartreeDec 23, 2022, 12:57 AM
84 points
6 comments2 min readEA link
(worldspiritsockpuppet.substack.com)

Com­po­nents of Strate­gic Clar­ity [Strate­gic Per­spec­tives on Long-term AI Gover­nance, #2]

MMMaasJul 2, 2022, 11:22 AM
66 points
0 comments6 min readEA link

AI Gover­nance Ca­reer Paths for Europeans

careersthrowawayMay 16, 2020, 6:40 AM
83 points
1 comment12 min readEA link

The longter­mist AI gov­er­nance land­scape: a ba­sic overview

Sam ClarkeJan 18, 2022, 12:58 PM
168 points
13 comments9 min readEA link

FLI open let­ter: Pause gi­ant AI experiments

Zach Stein-PerlmanMar 29, 2023, 4:04 AM
220 points
38 comments1 min readEA link

Slow­ing down AI progress is an un­der­ex­plored al­ign­ment strategy

Michael HuangJul 13, 2022, 3:22 AM
92 points
11 comments3 min readEA link
(www.lesswrong.com)

Case stud­ies of self-gov­er­nance to re­duce tech­nol­ogy risk

jiaApr 6, 2021, 8:49 AM
55 points
6 comments7 min readEA link

12 ten­ta­tive ideas for US AI policy (Luke Muehlhauser)

LizkaApr 19, 2023, 9:05 PM
117 points
12 comments4 min readEA link
(www.openphilanthropy.org)

Some un­der­rated rea­sons why the AI safety com­mu­nity should re­con­sider its em­brace of strict li­a­bil­ity

Cecil Abungu Apr 8, 2024, 6:50 PM
67 points
29 comments12 min readEA link

Per­sonal thoughts on ca­reers in AI policy and strategy

carrickflynnSep 27, 2017, 4:52 PM
56 points
28 comments18 min readEA link

AI Gover­nance Course—Cur­ricu­lum and Application

MauNov 29, 2021, 1:29 PM
94 points
9 comments1 min readEA link

Strate­gic Per­spec­tives on Trans­for­ma­tive AI Gover­nance: Introduction

MMMaasJul 2, 2022, 11:20 AM
115 points
18 comments4 min readEA link

Bi­den-Har­ris Ad­minis­tra­tion An­nounces First-Ever Con­sor­tium Ded­i­cated to AI Safety

ben.smithFeb 9, 2024, 6:40 AM
15 points
1 comment1 min readEA link
(www.nist.gov)

Con­sider grant­ing AIs freedom

Matthew_BarnettDec 6, 2024, 12:55 AM
80 points
22 comments5 min readEA link

A sum­mary of cur­rent work in AI governance

constructiveJun 17, 2023, 4:58 PM
88 points
4 comments11 min readEA link

GovAI: Towards best prac­tices in AGI safety and gov­er­nance: A sur­vey of ex­pert opinion

Zach Stein-PerlmanMay 15, 2023, 1:42 AM
68 points
3 comments1 min readEA link

FLI re­port: Poli­cy­mak­ing in the Pause

Zach Stein-PerlmanApr 15, 2023, 5:01 PM
29 points
4 comments1 min readEA link

Some Things I Heard about AI Gover­nance at EAG

utilistrutilFeb 28, 2023, 9:27 PM
35 points
5 comments6 min readEA link

Large Lan­guage Models as Fi­du­cia­ries to Humans

johnjnayJan 24, 2023, 7:53 PM
25 points
0 comments34 min readEA link
(papers.ssrn.com)

Pro­ject ideas: Gover­nance dur­ing ex­plo­sive tech­nolog­i­cal growth

Lukas FinnvedenJan 4, 2024, 7:25 AM
33 points
1 comment16 min readEA link
(lukasfinnveden.substack.com)

Cur­rent UK gov­ern­ment lev­ers on AI development

rosehadsharApr 10, 2023, 1:16 PM
82 points
3 comments4 min readEA link

My fa­vorite AI gov­er­nance re­search this year so far

Zach Stein-PerlmanJul 23, 2023, 10:00 PM
81 points
4 comments7 min readEA link
(blog.aiimpacts.org)

In­ter­ac­tive AI Gover­nance Map

Hamish McDoodlesMar 12, 2024, 10:02 AM
67 points
8 comments1 min readEA link

Data Tax­a­tion: A Pro­posal for Slow­ing Down AGI Progress

Per Ivar FriborgApr 11, 2023, 5:27 PM
42 points
6 comments12 min readEA link

Re­quest to AGI or­ga­ni­za­tions: Share your views on paus­ing AI progress

AkashApr 11, 2023, 5:30 PM
85 points
1 comment1 min readEA link

Overview of in­tro­duc­tory re­sources in AI Governance

Lucie Philippon 🔸May 27, 2024, 4:22 PM
26 points
1 comment6 min readEA link
(www.lesswrong.com)

He­len Toner (ex-OpenAI board mem­ber): “We learned about ChatGPT on Twit­ter.”

defun 🔸May 29, 2024, 7:40 AM
123 points
13 comments1 min readEA link
(x.com)

[Question] Ex­am­ples of self-gov­er­nance to re­duce tech­nol­ogy risk?

jiaSep 25, 2020, 1:26 PM
32 points
1 comment1 min readEA link

AI Safety Ac­tion Plan—A re­port com­mis­sioned by the US State Department

Agustín Covarrubias 🔸Mar 11, 2024, 10:13 PM
25 points
1 comment1 min readEA link
(www.gladstone.ai)

AI policy ideas: Read­ing list

Zach Stein-PerlmanApr 17, 2023, 7:00 PM
60 points
3 comments1 min readEA link

New Busi­ness Wars pod­cast sea­son on Sam Alt­man and OpenAI

Eevee🔹Apr 2, 2024, 6:22 AM
10 points
0 comments1 min readEA link
(wondery.com)

Par­tial Tran­script of Re­cent Se­nate Hear­ing Dis­cussing AI X-Risk

Daniel_EthJul 27, 2023, 9:16 AM
150 points
2 comments22 min readEA link
(medium.com)

4 ways to think about de­moc­ra­tiz­ing AI [GovAI Linkpost]

AkashFeb 13, 2023, 6:06 PM
35 points
0 comments1 min readEA link

A Case for Su­per­hu­man Gover­nance, us­ing AI

Ozzie GooenJun 7, 2024, 12:10 AM
57 points
26 comments10 min readEA link

AGI safety ca­reer advice

richard_ngoMay 2, 2023, 7:36 AM
211 points
20 comments1 min readEA link

Slightly against al­ign­ing with neo-luddites

Matthew_BarnettDec 26, 2022, 11:27 PM
77 points
17 comments4 min readEA link

CSER Ad­vice to EU High-Level Ex­pert Group on AI

HaydnBelfieldMar 8, 2019, 8:42 PM
14 points
0 comments5 min readEA link
(www.cser.ac.uk)

A Viral Li­cense for AI Safety

IvanVendrovJun 5, 2021, 2:00 AM
30 points
6 comments5 min readEA link

Cor­po­rate cam­paigns work: a key learn­ing for AI Safety

Jamie_HarrisAug 17, 2023, 9:35 PM
72 points
12 comments6 min readEA link

The Gover­nance Prob­lem and the “Pretty Good” X-Risk

Zach Stein-PerlmanAug 28, 2021, 8:00 PM
23 points
4 comments11 min readEA link

Markus An­der­ljung and Ben Garfinkel: Fireside chat on AI governance

EA GlobalJul 24, 2020, 2:56 PM
25 points
0 comments16 min readEA link
(www.youtube.com)

Open Philan­thropy’s AI gov­er­nance grant­mak­ing (so far)

Aaron Gertler 🔸Dec 17, 2020, 12:00 PM
63 points
0 comments6 min readEA link
(www.openphilanthropy.org)

Mud­dling Along Is More Likely Than Dystopia

Jeffrey HeningerOct 21, 2023, 9:30 AM
87 points
3 comments8 min readEA link
(blog.aiimpacts.org)

A new pro­posal for reg­u­lat­ing AI in the EU

EdoAradApr 26, 2021, 5:25 PM
37 points
3 comments1 min readEA link
(www.bbc.com)

The U.S. Na­tional Se­cu­rity State is Here to Make AI Even Less Trans­par­ent and Accountable

Matrice JacobineNov 24, 2024, 9:34 AM
7 points
0 comments2 min readEA link
(www.eff.org)

“Pivotal Act” In­ten­tions: Nega­tive Con­se­quences and Fal­la­cious Arguments

Andrew CritchApr 19, 2022, 8:24 PM
80 points
10 comments7 min readEA link

“Aligned with who?” Re­sults of sur­vey­ing 1,000 US par­ti­ci­pants on AI values

Holly MorganMar 21, 2023, 10:07 PM
41 points
0 comments2 min readEA link
(www.lesswrong.com)

[Link post] Co­or­di­na­tion challenges for pre­vent­ing AI conflict

stefan.torgesMar 9, 2021, 9:39 AM
58 points
0 comments1 min readEA link
(longtermrisk.org)

Prob­lem-solv­ing tasks in Graph The­ory for lan­guage mod­els

Bruno López OrozcoOct 1, 2024, 12:36 PM
21 points
1 comment9 min readEA link

Align­ing the Align­ers: En­sur­ing Aligned AI acts for the com­mon good of all mankind

timunderwoodJan 16, 2023, 11:13 AM
40 points
2 comments4 min readEA link

FHI Re­port: Stable Agree­ments in Tur­bu­lent Times

Cullen 🔸Feb 21, 2019, 5:12 PM
25 points
2 comments4 min readEA link
(www.fhi.ox.ac.uk)

“Risk Aware­ness Mo­ments” (Rams): A con­cept for think­ing about AI gov­er­nance interventions

oegApr 14, 2023, 5:40 PM
53 points
0 comments9 min readEA link

[US] NTIA: AI Ac­countabil­ity Policy Re­quest for Comment

Kyle J. LuccheseApr 13, 2023, 4:12 PM
47 points
4 comments1 min readEA link
(ntia.gov)

An­titrust-Com­pli­ant AI In­dus­try Self-Regulation

Cullen 🔸Jul 7, 2020, 8:52 PM
26 points
1 comment1 min readEA link
(cullenokeefe.com)

AI and Work: Sum­maris­ing a New Liter­a­ture Review

cpeppiattJul 15, 2024, 10:27 AM
13 points
0 comments2 min readEA link
(arxiv.org)

AI In­ci­dent Re­port­ing: A Reg­u­la­tory Review

Deric ChengMar 11, 2024, 9:02 PM
10 points
1 comment6 min readEA link

Are you re­ally in a race? The Cau­tion­ary Tales of Szilárd and Ellsberg

HaydnBelfieldMay 19, 2022, 8:42 AM
487 points
44 comments18 min readEA link

[Question] Know a grad stu­dent study­ing AI’s eco­nomic im­pacts?

Madhav MalhotraJul 5, 2023, 12:07 AM
7 points
0 comments1 min readEA link

New US Se­nate Bill on X-Risk Miti­ga­tion [Linkpost]

Evan R. MurphyJul 4, 2022, 1:28 AM
22 points
12 comments1 min readEA link
(www.hsgac.senate.gov)

AI policy & gov­er­nance in Aus­tralia: notes from an ini­tial discussion

Alexander SaeriMay 15, 2023, 12:00 AM
31 points
1 comment3 min readEA link

A fic­tional AI law laced w/​ al­ign­ment theory

MiguelJul 17, 2023, 3:26 AM
3 points
0 comments2 min readEA link

A case for donat­ing to AI risk re­duc­tion (in­clud­ing if you work in AI)

tlevinDec 2, 2024, 7:05 PM
118 points
5 comments3 min readEA link

Le­gal Pri­ori­ties Re­search: A Re­search Agenda

jonasschuettJan 6, 2021, 9:47 PM
58 points
4 comments1 min readEA link

It’s not ob­vi­ous that get­ting dan­ger­ous AI later is better

Aaron_ScherSep 23, 2023, 5:35 AM
23 points
9 comments16 min readEA link

AI Benefits Post 4: Out­stand­ing Ques­tions on Select­ing Benefits

Cullen 🔸Jul 14, 2020, 5:24 PM
6 points
0 comments5 min readEA link

Should you work in the Euro­pean Union to do AGI gov­er­nance?

hanadulsetJan 31, 2022, 10:34 AM
90 points
20 comments15 min readEA link

AI labs’ state­ments on governance

Zach Stein-PerlmanJul 4, 2023, 4:30 PM
28 points
1 comment1 min readEA link

List of pro­jects that seem im­pact­ful for AI Governance

JaimeRVJan 14, 2024, 4:52 PM
35 points
2 comments13 min readEA link

AI-Rele­vant Reg­u­la­tion: CERN

SWKJul 15, 2023, 6:40 PM
12 points
0 comments6 min readEA link

New Se­quence—Towards a wor­ld­wide, wa­ter­tight Wind­fall Clause

John Bridge 🔸Apr 7, 2022, 3:02 PM
25 points
4 comments8 min readEA link

Eisen­hower’s Atoms for Peace Speech

AkashMay 17, 2023, 4:10 PM
17 points
1 comment1 min readEA link

What suc­cess looks like

mariushobbhahnJun 28, 2022, 2:30 PM
112 points
20 comments19 min readEA link

Aus­trali­ans are con­cerned about AI risks and ex­pect strong gov­ern­ment action

Alexander SaeriMar 8, 2024, 6:39 AM
38 points
12 comments5 min readEA link
(aigovernance.org.au)

Sur­vey on in­ter­me­di­ate goals in AI governance

MichaelA🔸Mar 17, 2023, 12:44 PM
155 points
4 comments1 min readEA link

UK AI Bill Anal­y­sis & Opinion

CAISIDFeb 5, 2024, 12:12 AM
18 points
0 comments15 min readEA link

Cur­rent paths to im­pact in EU AI Policy (Feb ’24)

JOMG_MonnetFeb 12, 2024, 3:57 PM
47 points
0 comments5 min readEA link

(Even) More Early-Ca­reer EAs Should Try AI Safety Tech­ni­cal Research

tlevinJun 30, 2022, 9:14 PM
86 points
40 comments11 min readEA link

UNGA Re­s­olu­tion on AI: 5 Key Take­aways Look­ing to Fu­ture Policy

Heramb PodarMar 24, 2024, 12:03 PM
17 points
1 comment3 min readEA link

An ar­gu­ment for ac­cel­er­at­ing in­ter­na­tional AI gov­er­nance re­search (part 1)

MattThinksAug 16, 2023, 5:40 AM
10 points
0 comments3 min readEA link

[Question] Pre­dic­tions for fu­ture AI gov­er­nance?

jackchang110Apr 2, 2023, 4:43 PM
4 points
1 comment1 min readEA link

Nav­i­gat­ing the New Real­ity in DC: An EIP Primer

IanDavidMossDec 20, 2024, 4:59 PM
20 points
1 comment13 min readEA link
(effectiveinstitutionsproject.substack.com)

What is com­pute gov­er­nance?

Vishakha AgrawalDec 23, 2024, 6:45 AM
5 points
0 comments2 min readEA link
(aisafety.info)

EU AI Act now has a sec­tion on gen­eral pur­pose AI systems

MathiasKB🔸Dec 9, 2021, 12:40 PM
64 points
10 comments1 min readEA link

Is Democ­racy a Fad?

bgarfinkelMar 13, 2021, 12:40 PM
165 points
36 comments18 min readEA link

AGI mis­al­ign­ment x-risk may be lower due to an over­looked goal speci­fi­ca­tion technology

johnjnayOct 21, 2022, 2:03 AM
20 points
1 comment1 min readEA link

Map­ping How Alli­ances, Ac­qui­si­tions, and An­titrust are Shap­ing the Fron­tier AI Industry

t6aguirreJun 3, 2024, 9:43 AM
24 points
1 comment2 min readEA link

Thoughts on the AI Safety Sum­mit com­pany policy re­quests and responses

So8resOct 31, 2023, 11:54 PM
42 points
3 comments1 min readEA link

Merger of Deep­Mind and Google Brain

Greg_Colbourn ⏸️ Apr 20, 2023, 8:16 PM
11 points
12 comments1 min readEA link
(blog.google)

My Feed­back to the UN Ad­vi­sory Body on AI

Heramb PodarApr 4, 2024, 11:39 PM
7 points
1 comment4 min readEA link

Assess­ing the Danger­ous­ness of Malev­olent Ac­tors in AGI Gover­nance: A Pre­limi­nary Exploration

Callum HinchcliffeOct 14, 2023, 9:18 PM
28 points
4 comments9 min readEA link

AI Risk Man­age­ment Frame­work | NIST

𝕮𝖎𝖓𝖊𝖗𝖆Jan 26, 2023, 3:27 PM
50 points
0 comments1 min readEA link

Prospects for AI safety agree­ments be­tween countries

oegApr 14, 2023, 5:41 PM
104 points
3 comments22 min readEA link

Stan­dard policy frame­works for AI governance

Nathan_BarnardJan 30, 2024, 6:14 PM
26 points
2 comments3 min readEA link

[link] Cen­tre for the Gover­nance of AI 2020 An­nual Report

MarkusAnderljungJan 14, 2021, 10:23 AM
11 points
5 comments1 min readEA link

News: Span­ish AI image out­cry + US AI work­force “reg­u­la­tion”

Benevolent_RainSep 26, 2023, 7:43 AM
9 points
0 comments1 min readEA link

AI-Rele­vant Reg­u­la­tion: IAEA

SWKJul 15, 2023, 6:20 PM
10 points
0 comments5 min readEA link

AGI ris­ing: why we are in a new era of acute risk and in­creas­ing pub­lic aware­ness, and what to do now

Greg_Colbourn ⏸️ May 2, 2023, 10:17 AM
68 points
35 comments13 min readEA link

We are fight­ing a shared bat­tle (a call for a differ­ent ap­proach to AI Strat­egy)

Gideon FutermanMar 16, 2023, 2:37 PM
59 points
11 comments15 min readEA link

What would a com­pute mon­i­tor­ing plan look like? [Linkpost]

AkashMar 26, 2023, 7:33 PM
61 points
1 comment1 min readEA link

What we’re miss­ing: the case for struc­tural risks from AI

Justin OliveNov 9, 2023, 5:52 AM
31 points
3 comments6 min readEA link

Call for Papers on Global AI Gover­nance from the UN

Chris LeongAug 20, 2023, 8:56 AM
36 points
1 comment1 min readEA link
(www.linkedin.com)

FHI Re­port: The Wind­fall Clause: Distribut­ing the Benefits of AI for the Com­mon Good

Cullen 🔸Feb 5, 2020, 11:49 PM
54 points
21 comments2 min readEA link

FHI Re­port: How Will Na­tional Se­cu­rity Con­sid­er­a­tions Affect An­titrust De­ci­sions in AI? An Ex­am­i­na­tion of His­tor­i­cal Precedents

Cullen 🔸Jul 28, 2020, 6:33 PM
13 points
0 comments1 min readEA link
(www.fhi.ox.ac.uk)

TAI Safety Biblio­graphic Database

Jess_RiedelDec 22, 2020, 4:03 PM
61 points
9 comments17 min readEA link

[Question] What kind of or­ga­ni­za­tion should be the first to de­velop AGI in a po­ten­tial arms race?

Eevee🔹Jul 17, 2022, 5:41 PM
10 points
2 comments1 min readEA link

EU’s im­por­tance for AI gov­er­nance is con­di­tional on AI tra­jec­to­ries—a case study

MathiasKB🔸Jan 13, 2022, 2:58 PM
31 points
2 comments3 min readEA link

Ar­gu­ment Against Im­pact: EU Is Not an AI Su­per­power

EU AI GovernanceJan 31, 2022, 9:48 AM
35 points
9 comments4 min readEA link

Com­pute & An­titrust: Reg­u­la­tory im­pli­ca­tions of the AI hard­ware sup­ply chain, from chip de­sign to cloud APIs

HaydnBelfieldAug 19, 2022, 5:20 PM
32 points
0 comments6 min readEA link
(verfassungsblog.de)

Why Did Elon Musk Just Offer to Buy Con­trol of OpenAI for $100 Billion?

GarrisonFeb 11, 2025, 12:20 AM
152 points
2 comments6 min readEA link
(garrisonlovely.substack.com)

Suc­ces­sif: Join our AI pro­gram to help miti­gate the catas­trophic risks of AI

ClaireBOct 25, 2023, 4:51 PM
15 points
0 comments5 min readEA link

An overview of ar­gu­ments for con­cern about automation

LintzAAug 6, 2019, 7:56 AM
34 points
3 comments13 min readEA link

Daniel Dewey: The Open Philan­thropy Pro­ject’s work on po­ten­tial risks from ad­vanced AI

EA GlobalAug 11, 2017, 8:19 AM
7 points
0 comments18 min readEA link
(www.youtube.com)

[Question] Would an An­thropic/​OpenAI merger be good for AI safety?

MNov 22, 2023, 8:21 PM
6 points
1 comment1 min readEA link

Fi­nal Re­port of the Na­tional Se­cu­rity Com­mis­sion on Ar­tifi­cial In­tel­li­gence (NSCAI, 2021)

MichaelA🔸Jun 1, 2021, 8:19 AM
51 points
3 comments4 min readEA link
(www.nscai.gov)

AI & Policy 1/​3: On know­ing the effect of to­day’s poli­cies on Trans­for­ma­tive AI risks, and the case for in­sti­tu­tional im­prove­ments.

weeatquinceAug 27, 2019, 11:04 AM
27 points
3 comments10 min readEA link

UK AI Policy Re­port: Con­tent, Sum­mary, and its Im­pact on EA Cause Areas

Algo_LawJul 21, 2022, 5:32 PM
9 points
1 comment9 min readEA link

The AI rev­olu­tion and in­ter­na­tional poli­tics (Allan Dafoe)

EA GlobalJun 2, 2017, 8:48 AM
8 points
0 comments18 min readEA link
(www.youtube.com)

Hooray for step­ping out of the limelight

So8resApr 1, 2023, 2:45 AM
103 points
0 comments1 min readEA link

What does (and doesn’t) AI mean for effec­tive al­tru­ism?

EA GlobalAug 12, 2017, 7:00 AM
9 points
0 comments12 min readEA link

Ngo and Yud­kowsky on AI ca­pa­bil­ity gains

richard_ngoNov 19, 2021, 1:54 AM
23 points
4 comments39 min readEA link

An ‘AGI Emer­gency Eject Cri­te­ria’ con­sen­sus could be re­ally use­ful.

tcelferactApr 7, 2023, 4:21 PM
27 points
3 comments1 min readEA link

Here are the fi­nal­ists from FLI’s $100K Wor­ld­build­ing Contest

Jackson WagnerJun 6, 2022, 6:42 PM
44 points
5 comments2 min readEA link

[Link] EAF Re­search agenda: “Co­op­er­a­tion, Con­flict, and Trans­for­ma­tive Ar­tifi­cial In­tel­li­gence”

stefan.torgesJan 17, 2020, 1:28 PM
64 points
0 comments1 min readEA link

New sur­vey: 46% of Amer­i­cans are con­cerned about ex­tinc­tion from AI; 69% sup­port a six-month pause in AI development

AkashApr 5, 2023, 1:26 AM
143 points
34 comments1 min readEA link

Pause For Thought: The AI Pause Debate

Scott AlexanderOct 10, 2023, 3:34 PM
109 points
20 comments14 min readEA link
(www.astralcodexten.com)

Law-Fol­low­ing AI 3: Lawless AI Agents Un­der­mine Sta­bi­liz­ing Agreements

Cullen 🔸Apr 27, 2022, 5:20 PM
28 points
3 comments3 min readEA link

Rol­ling Thresh­olds for AGI Scal­ing Regulation

LarksJan 12, 2025, 1:30 AM
60 points
4 comments6 min readEA link

Good policy ideas that won’t hap­pen (yet)

Niel_BowermanSep 11, 2014, 12:29 PM
28 points
8 comments14 min readEA link

Up­dates from Cam­paign for AI Safety

Jolyn KhooSep 27, 2023, 2:44 AM
16 points
0 comments2 min readEA link
(www.campaignforaisafety.org)

Chris­ti­ano, Co­tra, and Yud­kowsky on AI progress

AjeyaNov 25, 2021, 4:30 PM
18 points
6 comments68 min readEA link

Is it time for a pause?

Kelsey PiperApr 6, 2023, 11:48 AM
103 points
6 comments5 min readEA link

Nav­i­gat­ing the Open-Source AI Land­scape: Data, Fund­ing, and Safety

AndreFerrettiApr 12, 2023, 10:30 AM
23 points
3 comments10 min readEA link

Nav­i­gat­ing AI Risks (NAIR) #1: Slow­ing Down AI

simeon_cApr 14, 2023, 2:35 PM
12 points
1 comment1 min readEA link

An­nounc­ing the EU Tech Policy Fellowship

Jan-WillemMar 30, 2022, 8:15 AM
53 points
4 comments5 min readEA link

Jeffrey Ding: Re-de­ci­pher­ing China’s AI dream

EA GlobalOct 18, 2019, 6:05 PM
13 points
0 comments1 min readEA link
(www.youtube.com)

Three pillars for avoid­ing AGI catas­tro­phe: Tech­ni­cal al­ign­ment, de­ploy­ment de­ci­sions, and co­or­di­na­tion

LintzAAug 3, 2022, 9:24 PM
93 points
4 comments11 min readEA link

[Fic­tion] Im­proved Gover­nance on the Crit­i­cal Path to AI Align­ment by 2045.

Jackson WagnerMay 18, 2022, 3:50 PM
20 points
1 comment12 min readEA link

An in­ter­ven­tion to shape policy di­alogue, com­mu­ni­ca­tion, and AI re­search norms for AI safety

Lee_SharkeyOct 1, 2017, 6:29 PM
9 points
28 comments10 min readEA link

AMA: Markus An­der­ljung (PM at GovAI, FHI)

MarkusAnderljungSep 21, 2020, 11:23 AM
49 points
24 comments2 min readEA link

AI welfare vs. AI rights

Matthew_BarnettFeb 4, 2025, 6:28 PM
37 points
20 comments3 min readEA link

Some AI re­search ar­eas and their rele­vance to ex­is­ten­tial safety

Andrew CritchDec 15, 2020, 12:15 PM
12 points
1 comment56 min readEA link
(alignmentforum.org)

No­body’s on the ball on AGI alignment

leopoldMar 29, 2023, 2:26 PM
327 points
65 comments9 min readEA link
(www.forourposterity.com)

How evals might (or might not) pre­vent catas­trophic risks from AI

AkashFeb 7, 2023, 8:16 PM
28 points
0 comments1 min readEA link

AI Safety Newslet­ter #3: AI policy pro­pos­als and a new challenger approaches

Oliver ZApr 25, 2023, 4:15 PM
35 points
1 comment4 min readEA link
(newsletter.safe.ai)

Con­crete ac­tions to im­prove AI gov­er­nance: the be­havi­our sci­ence approach

Alexander SaeriDec 1, 2022, 9:34 PM
31 points
0 comments11 min readEA link

UK’s new 10-year “Na­tional AI Strat­egy,” re­leased today

jared_mSep 22, 2021, 11:18 AM
28 points
7 comments1 min readEA link

List #1: Why stop­ping the de­vel­op­ment of AGI is hard but doable

RemmeltDec 24, 2022, 9:52 AM
24 points
2 comments1 min readEA link

P(doom|AGI) is high: why the de­fault out­come of AGI is doom

Greg_Colbourn ⏸️ May 2, 2023, 10:40 AM
13 points
28 comments3 min readEA link

Truth­ful AI

Owen Cotton-BarrattOct 20, 2021, 3:11 PM
55 points
14 comments10 min readEA link

How CISA can Sup­port the Se­cu­rity of Large AI Models Against Theft [Grad School As­sign­ment]

Marcel DMay 3, 2023, 3:36 PM
7 points
0 comments13 min readEA link

[Link Post: New York Times] White House Un­veils Ini­ti­a­tives to Re­duce Risks of A.I.

RockwellMay 4, 2023, 2:04 PM
50 points
1 comment2 min readEA link

[Question] What should I ask Ezra Klein about AI policy pro­pos­als?

Robert_WiblinJun 23, 2023, 4:36 PM
21 points
4 comments1 min readEA link

[Question] What are the challenges and prob­lems with pro­gram­ming law-break­ing con­straints into AGI?

MichaelStJulesFeb 2, 2020, 8:53 PM
20 points
34 comments1 min readEA link

Sum­mary of Si­tu­a­tional Aware­ness—The Decade Ahead

OscarD🔸Jun 8, 2024, 11:29 AM
143 points
5 comments18 min readEA link

Why don’t gov­ern­ments seem to mind that com­pa­nies are ex­plic­itly try­ing to make AGIs?

Ozzie GooenDec 23, 2021, 7:08 AM
82 points
49 comments2 min readEA link

AI Safety Newslet­ter #5: Ge­offrey Hin­ton speaks out on AI risk, the White House meets with AI labs, and Tro­jan at­tacks on lan­guage models

Center for AI SafetyMay 9, 2023, 3:26 PM
60 points
0 comments4 min readEA link
(newsletter.safe.ai)

Effec­tive Utopia: 100% Safe AI, Place AI, Si­mu­lat­ing a Mul­ti­verse & How It Looks

ankMar 2, 2025, 3:14 AM
1 point
3 comments35 min readEA link

Cruxes on US lead for some do­mes­tic AI regulation

Zach Stein-PerlmanSep 10, 2023, 6:00 PM
20 points
6 comments2 min readEA link

Un­veiling the Amer­i­can Public Opinion on AI Mo­ra­to­rium and Govern­ment In­ter­ven­tion: The Im­pact of Me­dia Exposure

OttoMay 8, 2023, 10:49 AM
28 points
5 comments6 min readEA link

AI Risk & Policy Fore­casts from Me­tac­u­lus & FLI’s AI Path­ways Workshop

Will AldredMay 16, 2023, 8:53 AM
41 points
0 comments8 min readEA link

Ideal gov­er­nance (for com­pa­nies, coun­tries and more)

Holden KarnofskyApr 7, 2022, 4:54 PM
80 points
19 comments14 min readEA link

The Im­por­tance of Ar­tifi­cial Sentience

Jamie_HarrisMar 3, 2021, 5:17 PM
70 points
10 comments11 min readEA link
(www.sentienceinstitute.org)

Co­or­di­na­tion by com­mon knowl­edge to pre­vent un­con­trol­lable AI

Karl von WendtMay 14, 2023, 1:37 PM
14 points
0 comments1 min readEA link

The state of AI in differ­ent coun­tries — an overview

LizkaSep 14, 2023, 10:37 AM
68 points
6 comments13 min readEA link
(aisafetyfundamentals.com)

An­thropic’s sub­mis­sion to the White House’s RFI on AI policy

Agustín Covarrubias 🔸Mar 6, 2025, 10:47 PM
47 points
7 comments1 min readEA link
(www.anthropic.com)

[Link] Cen­ter for the Gover­nance of AI (GovAI) An­nual Re­port 2018

MarkusAnderljungDec 21, 2018, 4:17 PM
24 points
0 comments1 min readEA link

Assess­ing the state of AI R&D in the US, China, and Europe – Part 1: Out­put indicators

stefan.torgesNov 1, 2019, 2:41 PM
21 points
0 comments14 min readEA link

[Question] Do­ing Global Pri­ori­ties or AI Policy re­search from re­mote lo­ca­tion?

With Love from IsraelOct 29, 2019, 9:34 AM
30 points
4 comments1 min readEA link

NIST AI Risk Man­age­ment Frame­work re­quest for in­for­ma­tion (RFI)

Aryeh EnglanderAug 31, 2021, 10:24 PM
7 points
0 comments2 min readEA link

In­for­ma­tion se­cu­rity ca­reers for GCR reduction

ClaireZabelJun 20, 2019, 11:56 PM
187 points
35 comments8 min readEA link

Pod­cast (+tran­script): Nathan Barnard on how US fi­nan­cial reg­u­la­tion can in­form AI governance

Aaron BergmanAug 8, 2023, 9:46 PM
12 points
0 comments23 min readEA link
(www.aaronbergman.net)

Two con­trast­ing mod­els of “in­tel­li­gence” and fu­ture growth

Magnus VindingNov 24, 2022, 11:54 AM
74 points
32 comments22 min readEA link

[Question] AI strat­egy ca­reer pipeline

Zach Stein-PerlmanMay 22, 2023, 12:00 AM
72 points
23 comments1 min readEA link

AI gov­er­nance stu­dent hackathon on Satur­day, April 23: reg­ister now!

micApr 12, 2022, 4:39 AM
18 points
0 comments1 min readEA link

[Question] What would you do if you had a lot of money/​power/​in­fluence and you thought that AI timelines were very short?

Greg_Colbourn ⏸️ Nov 12, 2021, 9:59 PM
29 points
8 comments1 min readEA link

Mak­ing a con­ser­va­tive case for alignment

LarksNov 17, 2024, 1:45 AM
44 points
0 comments1 min readEA link
(www.lesswrong.com)

Hu­man­i­ties Re­search Ideas for Longtermists

LizkaJun 9, 2021, 4:39 AM
151 points
13 comments13 min readEA link

[Question] Will AGI cause mass tech­nolog­i­cal un­em­ploy­ment?

Eevee🔹Jun 22, 2020, 8:55 PM
4 points
2 comments2 min readEA link

[Linkpost] OpenAI is award­ing ten 100k grants for build­ing pro­to­types of a demo­cratic pro­cess for steer­ing AI

pseudonymMay 26, 2023, 12:49 PM
36 points
2 comments1 min readEA link
(openai.com)

Race to the Top: Bench­marks for AI Safety

isaduanDec 4, 2022, 10:50 PM
52 points
8 comments1 min readEA link

Sha­har Avin: Near-term AI se­cu­rity risks, and what to do about them

EA GlobalNov 3, 2017, 7:43 AM
7 points
0 comments1 min readEA link
(www.youtube.com)

The Case for AI Adap­ta­tion: The Per­ils of Liv­ing in a World with Aligned and Well-De­ployed Trans­for­ma­tive Ar­tifi­cial Intelligence

HTCMay 30, 2023, 6:29 PM
3 points
1 comment7 min readEA link

The EU AI Act needs a defi­ni­tion of high-risk foun­da­tion mod­els to avoid reg­u­la­tory over­reach and backlash

matthias_samwaldMay 31, 2023, 3:34 PM
17 points
0 comments4 min readEA link

[Question] What are some crit­i­cisms of PauseAI?

Eevee🔹Nov 23, 2024, 5:49 PM
53 points
69 comments1 min readEA link

OpenAI’s grant pro­gram for demo­cratic pro­cess for de­cid­ing what rules AI sys­tems should follow

Ronen BarJun 23, 2023, 10:46 AM
7 points
0 comments1 min readEA link

How Could AI Gover­nance Go Wrong?

HaydnBelfieldMay 26, 2022, 9:29 PM
40 points
7 comments18 min readEA link

[Question] What are the best jour­nals to pub­lish AI gov­er­nance pa­pers in?

CaroMay 2, 2022, 10:07 AM
26 points
4 comments1 min readEA link

Law-Fol­low­ing AI 1: Se­quence In­tro­duc­tion and Structure

Cullen 🔸Apr 27, 2022, 5:16 PM
35 points
2 comments9 min readEA link

[Question] How com­mit­ted to AGI safety are the cur­rent OpenAI non­profit board mem­bers?

Eevee🔹Dec 2, 2024, 4:03 AM
14 points
1 comment1 min readEA link

Should there be just one west­ern AGI pro­ject?

rosehadsharDec 4, 2024, 2:41 PM
49 points
3 comments1 min readEA link
(www.forethought.org)

Un­jour­nal: Eval­u­a­tions of “Ar­tifi­cial In­tel­li­gence and Eco­nomic Growth”, and new host­ing space

david_reinsteinMar 17, 2023, 8:20 PM
47 points
0 comments2 min readEA link
(unjournal.pubpub.org)

How tech­ni­cal safety stan­dards could pro­mote TAI safety

Cullen 🔸Aug 8, 2022, 4:57 PM
128 points
15 comments7 min readEA link

Re­think Pri­ori­ties is hiring a Com­pute Gover­nance Re­searcher or Re­search Assistant

MichaelA🔸Jun 7, 2023, 1:22 PM
36 points
2 comments8 min readEA link
(careers.rethinkpriorities.org)

Cal­ifor­ni­ans, tell your reps to vote yes on SB 1047!

Holly Elmore ⏸️ 🔸Aug 12, 2024, 7:49 PM
106 points
6 comments1 min readEA link

Care­less talk on US-China AI com­pe­ti­tion? (and crit­i­cism of CAIS cov­er­age)

Oliver SourbutSep 20, 2023, 12:46 PM
52 points
19 comments1 min readEA link
(www.oliversourbut.net)

Ap­ply to the new Open Philan­thropy Tech­nol­ogy Policy Fel­low­ship!

lukeprogJul 20, 2021, 6:41 PM
78 points
6 comments4 min readEA link

Pal­isade is hiring Re­search Engineers

Charlie Rogers-SmithNov 11, 2023, 3:09 AM
23 points
0 comments3 min readEA link

Some tal­ent needs in AI governance

Sam ClarkeJun 13, 2023, 1:53 PM
133 points
10 comments8 min readEA link

Ap­ti­tudes for AI gov­er­nance work

Sam ClarkeJun 13, 2023, 1:54 PM
68 points
0 comments7 min readEA link

AGI Safety Fun­da­men­tals cur­ricu­lum and application

richard_ngoOct 20, 2021, 9:45 PM
123 points
20 comments8 min readEA link
(docs.google.com)

AI Gover­nance Needs Tech­ni­cal Work

MauSep 5, 2022, 10:25 PM
121 points
3 comments8 min readEA link

[Question] Is there ev­i­dence that recom­mender sys­tems are chang­ing users’ prefer­ences?

zdgroffApr 12, 2021, 7:11 PM
60 points
15 comments1 min readEA link

Owen Cot­ton-Bar­ratt: What does (and doesn’t) AI mean for effec­tive al­tru­ism?

EA GlobalAug 11, 2017, 8:19 AM
10 points
0 comments12 min readEA link
(www.youtube.com)

UN Sec­re­tary-Gen­eral recog­nises ex­is­ten­tial threat from AI

Greg_Colbourn ⏸️ Jun 15, 2023, 5:03 PM
58 points
1 comment1 min readEA link

Trends in the dol­lar train­ing cost of ma­chine learn­ing systems

Ben CottierFeb 1, 2023, 2:48 PM
63 points
3 comments1 min readEA link

UK gov­ern­ment to host first global sum­mit on AI Safety

DavidNashJun 8, 2023, 1:24 PM
78 points
1 comment5 min readEA link
(www.gov.uk)

On the com­pute gov­er­nance era and what has to come af­ter (Len­nart Heim on The 80,000 Hours Pod­cast)

80000_HoursJun 23, 2023, 8:11 PM
37 points
0 comments18 min readEA link

Sum­mary of the AI Bill of Rights and Policy Implications

Tristan WilliamsJun 20, 2023, 9:28 AM
16 points
0 comments22 min readEA link

Many AI gov­er­nance pro­pos­als have a trade­off be­tween use­ful­ness and feasibility

AkashFeb 3, 2023, 6:49 PM
22 points
0 comments1 min readEA link

Google in­vests $300mn in ar­tifi­cial in­tel­li­gence start-up An­thropic | FT

𝕮𝖎𝖓𝖊𝖗𝖆Feb 3, 2023, 7:43 PM
155 points
5 comments1 min readEA link
(www.ft.com)

RP’s AI Gover­nance & Strat­egy team—June 2023 in­terim overview

MichaelA🔸Jun 22, 2023, 1:45 PM
68 points
1 comment7 min readEA link

UK policy and poli­tics careers

weeatquinceSep 28, 2019, 4:18 PM
28 points
10 comments7 min readEA link

FLI pod­cast se­ries, “Imag­ine A World”, about as­pira­tional fu­tures with AGI

Jackson WagnerOct 13, 2023, 4:03 PM
18 points
0 comments4 min readEA link

The case for build­ing ex­per­tise to work on US AI policy, and how to do it

80000_HoursJan 31, 2019, 10:44 PM
37 points
2 comments2 min readEA link

Dear An­thropic peo­ple, please don’t re­lease Claude

Joseph MillerFeb 8, 2023, 2:44 AM
27 points
5 comments1 min readEA link

Jade Le­ung and Seth Baum: The role of ex­ist­ing in­sti­tu­tions in AI strategy

EA GlobalJun 8, 2018, 7:15 AM
9 points
0 comments28 min readEA link
(www.youtube.com)

Cy­borg Pe­ri­ods: There will be mul­ti­ple AI transitions

Jan_KulveitFeb 22, 2023, 4:09 PM
68 points
1 comment1 min readEA link

Thoughts on “The Offense-Defense Balance Rarely Changes”

Cullen 🔸Feb 12, 2024, 3:26 AM
42 points
4 comments5 min readEA link

Giv­ing away copies of Un­con­trol­lable by Dar­ren McKee

Greg_Colbourn ⏸️ Dec 14, 2023, 5:00 PM
39 points
2 comments1 min readEA link

[Question] Track­ing Com­pute Stocks and Flows: Case Stud­ies?

Cullen 🔸Oct 5, 2022, 5:54 PM
34 points
1 comment1 min readEA link

EU poli­cy­mak­ers reach an agree­ment on the AI Act

tlevinDec 15, 2023, 6:03 AM
109 points
13 comments1 min readEA link

What is the EU AI Act and why should you care about it?

MathiasKB🔸Sep 10, 2021, 7:47 AM
116 points
10 comments7 min readEA link

How ma­jor gov­ern­ments can help with the most im­por­tant century

Holden KarnofskyFeb 24, 2023, 7:37 PM
56 points
4 comments4 min readEA link
(www.cold-takes.com)

AI policy ca­reers in the EU

Lauro LangoscoNov 11, 2019, 10:43 AM
60 points
7 comments11 min readEA link

AI Gover­nance & Strat­egy: Pri­ori­ties, tal­ent gaps, & opportunities

AkashMar 3, 2023, 6:09 PM
21 points
0 comments1 min readEA link

My ar­ti­cle in The Na­tion — Cal­ifor­nia’s AI Safety Bill Is a Mask-Off Mo­ment for the Industry

GarrisonAug 15, 2024, 7:25 PM
134 points
0 comments1 min readEA link
(www.thenation.com)

Jeffrey Ding: Bring­ing techno-global­ism back: a ro­man­ti­cally re­al­ist re­fram­ing of the US-China tech relationship

EA GlobalNov 21, 2020, 8:12 AM
9 points
0 comments1 min readEA link
(www.youtube.com)

Po­ten­tial Risks from Ad­vanced AI

EA GlobalAug 13, 2017, 7:00 AM
9 points
0 comments18 min readEA link

A Wind­fall Clause for CEO could worsen AI race dynamics

LarksMar 9, 2023, 6:02 PM
69 points
12 comments7 min readEA link

Allan Dafoe: Prepar­ing for AI — risks and opportunities

EA GlobalNov 3, 2017, 7:43 AM
7 points
0 comments1 min readEA link
(www.youtube.com)

Spicy takes about AI policy (Clark, 2022)

Will AldredAug 9, 2022, 1:49 PM
44 points
0 comments3 min readEA link
(twitter.com)

In­ves­ti­gat­ing an in­surance-for-AI startup

L Rudolf LSep 21, 2024, 3:29 PM
40 points
1 comment1 min readEA link
(www.strataoftheworld.com)

Some thoughts on risks from nar­row, non-agen­tic AI

richard_ngoJan 19, 2021, 12:07 AM
36 points
2 comments8 min readEA link

[Question] Books and lec­ture se­ries rele­vant to AI gov­er­nance?

MichaelA🔸Jul 18, 2021, 3:54 PM
22 points
8 comments1 min readEA link

Pile of Law and Law-Fol­low­ing AI

Cullen 🔸Jul 13, 2022, 12:29 AM
28 points
2 comments3 min readEA link

Pal­isade is hiring: Exec As­sis­tant, Con­tent Lead, Ops Lead, and Policy Lead

Charlie Rogers-SmithOct 9, 2024, 12:04 AM
15 points
2 comments1 min readEA link

FLI launches Wor­ld­build­ing Con­test with $100,000 in prizes

ggilgallonJan 17, 2022, 1:54 PM
87 points
55 comments6 min readEA link

[Question] Has An­thropic already made the ex­ter­nally leg­ible com­mit­ments that it planned to make?

OferMar 12, 2024, 1:45 PM
21 points
3 comments1 min readEA link

Deep­Mind is hiring Long-term Strat­egy & Gover­nance researchers

vishalSep 13, 2021, 6:44 PM
54 points
1 comment1 min readEA link

AI gov­er­nance and strat­egy: a list of re­search agen­das and work that could be done.

Nathan_BarnardMar 12, 2024, 11:21 AM
33 points
4 comments17 min readEA link

How to make the best of the most im­por­tant cen­tury?

Holden KarnofskySep 14, 2021, 9:05 PM
54 points
5 comments12 min readEA link

Fore­sight for AGI Safety Strategy

jacquesthibsDec 5, 2022, 4:09 PM
14 points
1 comment1 min readEA link

Col­lec­tion of work on ‘Should you fo­cus on the EU if you’re in­ter­ested in AI gov­er­nance for longter­mist/​x-risk rea­sons?’

MichaelA🔸Aug 6, 2022, 4:49 PM
51 points
3 comments1 min readEA link

Baobao Zhang: How so­cial sci­ence re­search can in­form AI governance

EA GlobalJan 22, 2021, 3:10 PM
9 points
0 comments16 min readEA link
(www.youtube.com)

Ross Gruet­zemacher: Defin­ing and un­pack­ing trans­for­ma­tive AI

EA GlobalOct 18, 2019, 8:22 AM
9 points
0 comments1 min readEA link
(www.youtube.com)

AI gov­er­nance tal­ent pro­files I’d like to see ap­ply for OP funding

JulianHazellDec 19, 2023, 12:34 PM
118 points
4 comments3 min readEA link
(www.openphilanthropy.org)

Shar­ing the AI Wind­fall: A Strate­gic Ap­proach to In­ter­na­tional Benefit-Sharing

michelAug 16, 2024, 12:54 PM
67 points
0 comments13 min readEA link
(wrtaigovernance.substack.com)

Im­por­tant, ac­tion­able re­search ques­tions for the most im­por­tant century

Holden KarnofskyFeb 24, 2022, 4:34 PM
298 points
13 comments19 min readEA link

AI Gover­nance Read­ing Group Guide

Alex HTJun 25, 2020, 10:16 AM
26 points
2 comments3 min readEA link

Dona­tion offsets for ChatGPT Plus subscriptions

Jeffrey LadishMar 16, 2023, 11:11 PM
76 points
10 comments3 min readEA link

My thoughts on the so­cial re­sponse to AI risk

Matthew_BarnettNov 1, 2023, 9:27 PM
116 points
17 comments1 min readEA link

Pro­ject ideas: Epistemics

Lukas FinnvedenJan 4, 2024, 7:26 AM
43 points
1 comment17 min readEA link
(lukasfinnveden.substack.com)

Non-al­ign­ment pro­ject ideas for mak­ing trans­for­ma­tive AI go well

Lukas FinnvedenJan 4, 2024, 7:23 AM
66 points
1 comment3 min readEA link
(lukasfinnveden.substack.com)

GovAI We­bi­nars on the Gover­nance and Eco­nomics of AI

MarkusAnderljungMay 12, 2020, 3:00 PM
16 points
0 comments1 min readEA link

Ap­ply to fall policy in­tern­ships (we can help)

ESJul 2, 2023, 9:37 PM
57 points
4 comments1 min readEA link

Crises re­veal centralisation

Vasco Grilo🔸Mar 26, 2024, 6:00 PM
31 points
2 comments5 min readEA link
(stefanschubert.substack.com)

[Question] What type of Master’s is best for AI policy work?

Milan GriffesFeb 22, 2019, 8:04 PM
14 points
7 comments1 min readEA link

In­sights from an ex­pert sur­vey about in­ter­me­di­ate goals in AI governance

Sebastian SchwieckerMar 17, 2023, 2:59 PM
11 points
2 comments1 min readEA link

Notes on nukes, IR, and AI from “Arse­nals of Folly” (and other books)

tlevinSep 4, 2023, 7:02 PM
21 points
2 comments6 min readEA link

Cog­ni­tive as­sets and defen­sive acceleration

JulianHazellApr 3, 2024, 2:55 PM
13 points
3 comments4 min readEA link
(muddyclothes.substack.com)

In­stead of tech­ni­cal re­search, more peo­ple should fo­cus on buy­ing time

AkashNov 5, 2022, 8:43 PM
107 points
31 comments1 min readEA link

Effec­tive En­force­abil­ity of EU Com­pe­ti­tion Law Un­der Differ­ent AI Devel­op­ment Sce­nar­ios: A Frame­work for Le­gal Analysis

HaydnBelfieldAug 19, 2022, 5:20 PM
11 points
0 comments6 min readEA link
(verfassungsblog.de)

Shal­low eval­u­a­tions of longter­mist organizations

NunoSempereJun 24, 2021, 3:31 PM
192 points
34 comments34 min readEA link

AMA: Fu­ture of Life In­sti­tute’s EU Team

Risto UukJan 31, 2022, 5:14 PM
44 points
15 comments2 min readEA link

The new UK gov­ern­ment’s stance on AI safety

Elliot MckernonJul 31, 2024, 3:23 PM
19 points
0 comments1 min readEA link

Law-Fol­low­ing AI 4: Don’t Rely on Vi­car­i­ous Liability

Cullen 🔸Aug 2, 2022, 11:23 PM
13 points
0 comments3 min readEA link

Some cruxes on im­pact­ful al­ter­na­tives to AI policy work

richard_ngoNov 22, 2018, 1:43 PM
28 points
2 comments12 min readEA link

Re­lease of UN’s draft re­lated to the gov­er­nance of AI (a sum­mary of the Si­mon In­sti­tute’s re­sponse)

SebastianSchmidtApr 27, 2024, 6:27 PM
22 points
0 comments1 min readEA link

The­o­ries of Change for Track II Di­plo­macy [Founders Pledge]

christian.rJul 9, 2024, 1:31 PM
20 points
2 comments33 min readEA link

[Question] How to Im­prove China-Western Co­or­di­na­tion on EA Is­sues?

Michael KehoeNov 3, 2021, 7:28 AM
15 points
2 comments1 min readEA link

CSER and FHI ad­vice to UN High-level Panel on Digi­tal Co­op­er­a­tion

HaydnBelfieldMar 8, 2019, 8:39 PM
22 points
7 comments6 min readEA link
(www.cser.ac.uk)

Read­ing list on AI agents and as­so­ci­ated policy

Peter WildefordAug 9, 2024, 5:40 PM
79 points
2 comments1 min readEA link

Sup­ple­ment to “The Brus­sels Effect and AI: How EU AI reg­u­la­tion will im­pact the global AI mar­ket”

MarkusAnderljungAug 16, 2022, 8:55 PM
109 points
7 comments8 min readEA link

Con­crete ac­tion­able poli­cies rele­vant to AI safety (writ­ten 2019)

weeatquinceDec 16, 2022, 6:41 PM
48 points
0 comments22 min readEA link

Thoughts on yes­ter­day’s UN Se­cu­rity Coun­cil meet­ing on AI

Greg_Colbourn ⏸️ Jul 19, 2023, 4:46 PM
31 points
2 comments1 min readEA link

Yud­kowsky and Chris­ti­ano dis­cuss “Take­off Speeds”

EliezerYudkowskyNov 22, 2021, 7:42 PM
42 points
0 comments60 min readEA link

New vol­un­tary com­mit­ments (AI Seoul Sum­mit)

Zach Stein-PerlmanMay 21, 2024, 11:00 AM
12 points
1 comment1 min readEA link
(www.gov.uk)

US Congress in­tro­duces CREATE AI Act for es­tab­lish­ing Na­tional AI Re­search Resource

Daniel_EthJul 28, 2023, 11:27 PM
9 points
1 comment1 min readEA link
(eshoo.house.gov)

Fron­tier Model Forum

Zach Stein-PerlmanJul 26, 2023, 2:30 PM
40 points
7 comments1 min readEA link
(blog.google)

Law-Fol­low­ing AI 2: In­tent Align­ment + Su­per­in­tel­li­gence → Lawless AI (By De­fault)

Cullen 🔸Apr 27, 2022, 5:18 PM
19 points
0 comments6 min readEA link

AMA: The new Open Philan­thropy Tech­nol­ogy Policy Fellowship

lukeprogJul 26, 2021, 3:11 PM
38 points
14 comments1 min readEA link

I’m Cul­len O’Keefe, a Policy Re­searcher at OpenAI, AMA

Cullen 🔸Jan 11, 2020, 4:13 AM
45 points
68 comments1 min readEA link

Could Reg­u­la­tory Cost-Benefit Anal­y­sis Stop Fron­tier AI Reg­u­la­tions in the US?

LuiseJul 11, 2024, 3:25 PM
21 points
1 comment14 min readEA link

Dis­cus­sion with Eliezer Yud­kowsky on AGI interventions

RobBensingerNov 11, 2021, 3:21 AM
60 points
33 comments34 min readEA link

The U.S. and China Need an AI In­ci­dents Hotline

christian.rJun 3, 2024, 6:46 PM
25 points
0 comments1 min readEA link
(www.lawfaremedia.org)

An­nounc­ing Open Philan­thropy’s AI gov­er­nance and policy RFP

JulianHazellJul 17, 2024, 12:25 AM
73 points
2 comments1 min readEA link
(www.openphilanthropy.org)

The Ri­val AI De­ploy­ment Prob­lem: a Pre-de­ploy­ment Agree­ment as the least-bad response

HaydnBelfieldSep 23, 2022, 9:28 AM
44 points
1 comment12 min readEA link

Linkpost: 7 A.I. Com­pa­nies Agree to Safe­guards After Pres­sure From the White House

MHR🔸Jul 21, 2023, 1:23 PM
61 points
4 comments1 min readEA link
(www.nytimes.com)

Jaan Tal­linn: Fireside chat (2020)

EA GlobalNov 21, 2020, 8:12 AM
7 points
0 comments1 min readEA link
(www.youtube.com)

GovAI An­nual Re­port 2021

GovAIJan 5, 2022, 4:57 PM
52 points
2 comments9 min readEA link

[Job ad] Re­search im­por­tant longter­mist top­ics at Re­think Pri­ori­ties!

LinchOct 6, 2021, 7:09 PM
65 points
46 comments1 min readEA link

Seek­ing Mechanism De­signer for Re­search into In­ter­nal­iz­ing Catas­trophic Externalities

c.troutSep 11, 2024, 3:09 PM
11 points
0 comments1 min readEA link

Longter­mist rea­sons to work for in­no­va­tive governments

acOct 13, 2020, 4:32 PM
74 points
8 comments1 min readEA link

Three Im­pacts of Ma­chine Intelligence

Paul_ChristianoAug 23, 2013, 10:10 AM
33 points
5 comments8 min readEA link
(rationalaltruist.com)

Sym­bio­sis, not al­ign­ment, as the goal for liberal democ­ra­cies in the tran­si­tion to ar­tifi­cial gen­eral intelligence

simonfriederichMar 17, 2023, 1:04 PM
18 points
2 comments24 min readEA link
(rdcu.be)

Mauhn Re­leases AI Safety Documentation

Berg SeverensJul 2, 2021, 12:19 PM
4 points
2 comments1 min readEA link

Sur­vey: How Do Elite Chi­nese Stu­dents Feel About the Risks of AI?

Nick CorvinoSep 2, 2024, 9:14 AM
107 points
9 comments10 min readEA link

Me­tac­u­lus Launches Chi­nese AI Chips Tour­na­ment, Sup­port­ing In­sti­tute for AI Policy and Strat­egy Research

christianDec 6, 2023, 11:26 AM
27 points
0 comments1 min readEA link
(www.metaculus.com)

Hiring a CEO & EU Tech Policy Lead to launch an AI policy ca­reer org in Europe

Cillian_Dec 6, 2023, 1:52 PM
50 points
0 comments7 min readEA link

Re­port: Ar­tifi­cial In­tel­li­gence Risk Man­age­ment in Spain

JorgeTorresCJun 15, 2023, 4:08 PM
22 points
0 comments3 min readEA link
(riesgoscatastroficosglobales.com)

AI Safety Strat­egy—A new or­ga­ni­za­tion for bet­ter timelines

PrometheusJun 14, 2023, 8:41 PM
8 points
0 comments2 min readEA link

De-em­pha­sise al­ign­ment, em­pha­sise restraint

EuanMcLeanFeb 4, 2025, 5:43 PM
19 points
2 comments7 min readEA link

Prin­ci­ples for AI Welfare Research

jeffseboJun 19, 2023, 11:30 AM
138 points
16 comments13 min readEA link

Join the Vir­tual AI Safety Un­con­fer­ence (VAISU)!

NguyênJun 21, 2023, 4:46 AM
23 points
0 comments1 min readEA link
(vaisu.ai)

Me­tac­u­lus Pre­sents — View From the En­ter­prise Suite: How Ap­plied AI Gover­nance Works Today

christianJun 20, 2023, 10:24 PM
4 points
0 comments1 min readEA link

Trade Between Altru­ists With Differ­ent AI Timelines?

SpiarrowMar 18, 2025, 5:53 PM
3 points
3 comments1 min readEA link

Up­dates from Cam­paign for AI Safety

Jolyn KhooOct 31, 2023, 5:46 AM
14 points
1 comment2 min readEA link
(www.campaignforaisafety.org)

AI-Rele­vant Reg­u­la­tion: CPSC

SWKAug 13, 2023, 3:44 PM
3 points
0 comments6 min readEA link

(Re­port) Eval­u­at­ing Taiwan’s Tac­tics to Safe­guard its Semi­con­duc­tor As­sets Against a Chi­nese Invasion

YadavDec 7, 2023, 12:01 AM
16 points
0 comments22 min readEA link
(bristolaisafety.org)

Sce­nario plan­ning for AI x-risk

Corin KatzkeFeb 10, 2024, 12:07 AM
40 points
0 comments15 min readEA link
(www.convergenceanalysis.org)

[Question] How in­de­pen­dent is the re­search com­ing out of OpenAI’s pre­pared­ness team?

EarthlingFeb 10, 2024, 4:59 PM
18 points
0 comments1 min readEA link

The Con­ver­gent Path to the Stars—Similar Utility Across Civ­i­liza­tions Challenges Ex­tinc­tion Prioritization

Maxime Riché 🔸Mar 18, 2025, 5:09 PM
6 points
1 comment20 min readEA link

An EA used de­cep­tive mes­sag­ing to ad­vance her pro­ject; we need mechanisms to avoid de­on­tolog­i­cally du­bi­ous plans

MikhailSaminFeb 13, 2024, 11:11 PM
22 points
39 comments5 min readEA link

Recom­men­da­tion to Ap­ply ISIC and NAICS to AI In­ci­dent Database

Ben TurseJul 21, 2024, 7:25 AM
3 points
0 comments2 min readEA link

Re­sults from the AI x Democ­racy Re­search Sprint

Esben KranJun 14, 2024, 4:40 PM
19 points
1 comment1 min readEA link

In­tro­duc­ing StakeOut.AI

Harry LukFeb 17, 2024, 12:21 AM
52 points
6 comments9 min readEA link

AISN #31: A New AI Policy Bill in Cal­ifor­nia Plus, Prece­dents for AI Gover­nance and The EU AI Office

Center for AI SafetyFeb 21, 2024, 9:55 PM
27 points
0 comments6 min readEA link
(newsletter.safe.ai)

AI Policy In­sights from the AIMS Survey

Janet PauketatFeb 22, 2024, 7:17 PM
10 points
1 comment18 min readEA link
(www.sentienceinstitute.org)

Propos­ing the Con­di­tional AI Safety Treaty (linkpost TIME)

OttoNov 15, 2024, 1:56 PM
12 points
6 comments3 min readEA link
(time.com)

Cor­po­rate Gover­nance for Fron­tier AI Labs: A Re­search Agenda

Matthew WeardenFeb 28, 2024, 11:32 AM
17 points
3 comments16 min readEA link
(matthewwearden.co.uk)

‘Surveillance Cap­i­tal­ism’ & AI Gover­nance: Slip­pery Busi­ness Models, Se­cu­ri­ti­sa­tion, and Self-Regulation

Charlie HarrisonFeb 29, 2024, 3:47 PM
19 points
2 comments12 min readEA link

Is Text Water­mark­ing a lost cause?

Egor TimatkovOct 1, 2024, 1:07 PM
4 points
0 comments10 min readEA link

Re­duc­ing global AI com­pe­ti­tion through the Com­merce Con­trol List and Im­mi­gra­tion re­form: a dual-pronged approach

ben.smithSep 3, 2024, 5:28 AM
15 points
0 comments9 min readEA link

AI gov­er­nance tracker of each coun­try per re­gion

Alix RamillonJul 24, 2024, 5:39 PM
16 points
2 comments23 min readEA link

An­nounc­ing Con­ver­gence Anal­y­sis: An In­sti­tute for AI Sce­nario & Gover­nance Research

David_KristofferssonMar 7, 2024, 9:18 PM
46 points
0 comments4 min readEA link

AI gov­er­nance & China: Read­ing list

Zach Stein-PerlmanDec 18, 2023, 3:30 PM
14 points
0 comments1 min readEA link
(docs.google.com)

China x AI Refer­ence List

Saad SiddiquiMar 13, 2024, 6:57 PM
61 points
3 comments3 min readEA link
(docs.google.com)

More ev­i­dence X-risk am­plifies ac­tion against cur­rent AI harms

Daniel_FriedrichDec 22, 2023, 3:21 PM
27 points
2 comments2 min readEA link
(osf.io)

Me­tac­u­lus Launches Fu­ture of AI Series, Based on Re­search Ques­tions by Arb

christianMar 13, 2024, 9:14 PM
34 points
0 comments1 min readEA link
(www.metaculus.com)

Lab Col­lab­o­ra­tion on AI Safety Best Prac­tices

amtaMar 17, 2024, 12:20 PM
3 points
0 comments20 min readEA link

Mid­dle Pow­ers in AI Gover­nance: Po­ten­tial paths to im­pact and re­lated ques­tions.

EffectiveAdvocate🔸Mar 15, 2024, 8:11 PM
5 points
1 comment5 min readEA link

Trans­for­ma­tive trust­build­ing via ad­vance­ments in de­cen­tral­ized lie detection

trevor1Mar 16, 2024, 5:56 AM
4 points
1 comment1 min readEA link
(www.ncbi.nlm.nih.gov)

NAIRA—An ex­er­cise in reg­u­la­tory, com­pet­i­tive safety gov­er­nance [AI Gover­nance In­sti­tu­tional De­sign idea]

Heramb PodarMar 19, 2024, 2:55 PM
5 points
1 comment6 min readEA link

AI Safety Eval­u­a­tions: A Reg­u­la­tory Review

Elliot MckernonMar 19, 2024, 3:09 PM
12 points
2 comments11 min readEA link

Is Paus­ing AI Pos­si­ble?

Richard AnniloOct 9, 2024, 1:22 PM
89 points
4 comments18 min readEA link

AI safety ad­vo­cates should con­sider pro­vid­ing gen­tle push­back fol­low­ing the events at OpenAI

I_machinegun_KellyDec 22, 2023, 9:05 PM
86 points
5 comments3 min readEA link
(www.lesswrong.com)

AGI will be made of het­ero­ge­neous com­po­nents, Trans­former and Selec­tive SSM blocks will be among them

Roman LeventovDec 27, 2023, 2:51 PM
5 points
0 comments1 min readEA link

METR: Mea­sur­ing AI Abil­ity to Com­plete Long Tasks

Ben_West🔸Mar 19, 2025, 4:49 PM
106 points
17 comments1 min readEA link
(metr.org)

Promethean Gover­nance and Memetic Le­gi­t­i­macy: Les­sons from the Vene­tian Doge for AI Era Institutions

LutherSloanMar 19, 2025, 6:09 PM
1 point
0 comments3 min readEA link

2024 CFP for APSA, Largest An­nual Meet­ing of Poli­ti­cal Science

nemeryxuJan 3, 2024, 7:43 PM
2 points
0 comments1 min readEA link

Win­ning Non-Triv­ial Pro­ject: Set­ting a high stan­dard for fron­tier model security

XaviCFJan 8, 2024, 11:20 AM
31 points
0 comments18 min readEA link

AI Dis­clo­sures: A Reg­u­la­tory Review

Elliot MckernonMar 29, 2024, 11:46 AM
12 points
1 comment7 min readEA link

Have your say on the fu­ture of AI reg­u­la­tion: Dead­line ap­proach­ing for your feed­back on UN High-Level Ad­vi­sory Body on AI In­terim Re­port ‘Govern­ing AI for Hu­man­ity’

Deborah W.A. FoulkesMar 29, 2024, 6:37 AM
17 points
1 comment1 min readEA link

God Coin: A Modest Pro­posal

Mahdi ComplexApr 1, 2024, 12:02 PM
4 points
0 comments22 min readEA link

In­tro­duc­ing In­ter­na­tional AI Gover­nance Alli­ance (IAIGA)

James NorrisFeb 5, 2025, 3:59 PM
12 points
0 comments1 min readEA link

Con­scious AI con­cerns all of us. [Con­scious AI & Public Per­cep­tions]

ixexJul 3, 2024, 3:12 AM
25 points
1 comment12 min readEA link

Will we ever run out of new jobs?

Kevin KohlerAug 19, 2024, 3:03 PM
11 points
4 comments7 min readEA link
(machinocene.substack.com)

Re­port: Eval­u­at­ing an AI Chip Regis­tra­tion Policy

Deric ChengApr 12, 2024, 4:40 AM
15 points
0 comments5 min readEA link
(www.convergenceanalysis.org)

Con­scious AI & Public Per­cep­tion: Four futures

nicoleta-kJul 3, 2024, 11:06 PM
12 points
1 comment16 min readEA link

Con­scious AI: Will we know it when we see it? [Con­scious AI & Public Per­cep­tion]

ixexJul 4, 2024, 8:30 PM
13 points
1 comment12 min readEA link

How to re­duce risks re­lated to con­scious AI: A user guide [Con­scious AI & Public Per­cep­tion]

Jay LuongJul 5, 2024, 2:19 PM
9 points
1 comment15 min readEA link

The case for con­scious AI: Clear­ing the record [AI Con­scious­ness & Public Per­cep­tion]

Jay LuongJul 5, 2024, 8:29 PM
3 points
7 comments8 min readEA link

De­mon­strate and eval­u­ate risks from AI to so­ciety at the AI x Democ­racy re­search hackathon

Esben KranApr 19, 2024, 2:46 PM
24 points
0 comments6 min readEA link
(www.apartresearch.com)

Max Teg­mark — The AGI En­tente Delusion

Matrice JacobineOct 13, 2024, 5:42 PM
0 points
1 comment1 min readEA link
(www.lesswrong.com)

Ad­vice to ju­nior AI gov­er­nance researchers

AkashJul 8, 2024, 7:19 PM
38 points
3 comments1 min readEA link

Why I’m do­ing PauseAI

Joseph MillerApr 30, 2024, 4:21 PM
145 points
36 comments1 min readEA link

AI Safety Newslet­ter #42: New­som Ve­toes SB 1047 Plus, OpenAI’s o1, and AI Gover­nance Summary

Center for AI SafetyOct 1, 2024, 8:33 PM
10 points
0 comments6 min readEA link
(newsletter.safe.ai)

AI Model Registries: A Foun­da­tional Tool for AI Governance

Elliot MckernonOct 7, 2024, 1:59 PM
19 points
0 comments1 min readEA link
(www.convergenceanalysis.org)

Ret­ro­spec­tive Case Study of Com­mu­nity Build­ing Land­scape in China | Run­ning Arete Fel­low­ship in NYU Shanghai

arghyasJul 9, 2024, 6:35 PM
18 points
1 comment12 min readEA link

An­thropic rewrote its RSP

Zach Stein-PerlmanOct 15, 2024, 2:30 PM
32 points
1 comment1 min readEA link

ML4Good Brasil—Ap­pli­ca­tions Open

NiaMay 3, 2024, 10:39 AM
28 points
1 comment1 min readEA link

Promethean Gover­nance in Prac­tice: Craft­ing a Poly­cen­tric, Memetic Order for the Mul­tipo­lar AI Aeon

LutherSloanMar 20, 2025, 10:10 AM
1 point
0 comments4 min readEA link

Risk Align­ment in Agen­tic AI Systems

Hayley ClatterbuckOct 1, 2024, 10:51 PM
31 points
1 comment3 min readEA link
(static1.squarespace.com)

Re­view­ing the Struc­ture of Cur­rent AI Regulations

Deric ChengMay 7, 2024, 12:34 PM
32 points
1 comment13 min readEA link

AI and Chem­i­cal, Biolog­i­cal, Ra­diolog­i­cal, & Nu­clear Hazards: A Reg­u­la­tory Review

Elliot MckernonMay 10, 2024, 8:41 AM
8 points
1 comment1 min readEA link

In DC, a new wave of AI lob­by­ists gains the up­per hand

Chris LeongMay 13, 2024, 7:31 AM
97 points
7 comments1 min readEA link
(www.politico.com)

The two-tiered society

Roman LeventovMay 13, 2024, 7:53 AM
14 points
5 comments1 min readEA link

Com­par­i­son of LLM scal­a­bil­ity and perfor­mance be­tween the U.S. and China based on benchmark

Ivanna_alvaradoOct 12, 2024, 9:51 PM
8 points
0 comments34 min readEA link

I read ev­ery ma­jor AI lab’s safety plan so you don’t have to

sarahhwDec 16, 2024, 2:12 PM
67 points
2 comments11 min readEA link
(longerramblings.substack.com)

Ad­vice for Ac­tivists from the His­tory of Environmentalism

Jeffrey HeningerMay 16, 2024, 8:36 PM
48 points
2 comments1 min readEA link
(blog.aiimpacts.org)

The Failed Strat­egy of Ar­tifi­cial In­tel­li­gence Doomers

yhoisethFeb 5, 2025, 7:34 PM
12 points
2 comments1 min readEA link
(letter.palladiummag.com)

The Prob­lem With the Word ‘Align­ment’

Peli GrietzerMay 21, 2024, 9:37 PM
13 points
1 comment6 min readEA link

The ne­ces­sity of “Guardian AI” and two con­di­tions for its achievement

ProicaMay 28, 2024, 11:42 AM
1 point
1 comment15 min readEA link

2024 State of AI Reg­u­la­tory Landscape

Deric ChengMay 28, 2024, 12:00 PM
12 points
1 comment2 min readEA link
(www.convergenceanalysis.org)

AISN #36: Vol­un­tary Com­mit­ments are In­suffi­cient Plus, a Se­nate AI Policy Roadmap, and Chap­ter 1: An Overview of Catas­trophic Risks

Center for AI SafetyMay 30, 2024, 6:23 PM
6 points
0 comments5 min readEA link
(newsletter.safe.ai)

Ge­offrey Hin­ton on the Past, Pre­sent, and Fu­ture of AI

Stephen McAleeseOct 12, 2024, 4:41 PM
5 points
1 comment1 min readEA link

New OGL and ITAR changes are shift­ing AI Gover­nance and Policy be­low the sur­face: A sim­plified up­date

CAISIDMay 31, 2024, 7:54 AM
12 points
2 comments3 min readEA link

Thoughts on SB-1047

Ryan GreenblattMay 30, 2024, 12:19 AM
53 points
4 comments1 min readEA link

Soft Na­tion­al­iza­tion: How the US Govern­ment Will Con­trol AI Labs

Deric ChengAug 27, 2024, 3:10 PM
103 points
5 comments21 min readEA link
(www.convergenceanalysis.org)

AI Open Source De­bate Comes Down to Trust in In­sti­tu­tions, and AI Policy Mak­ers Should Con­sider How We Can Foster It

another-anon-do-gooderJan 20, 2024, 1:47 PM
6 points
2 comments1 min readEA link

Reg­u­la­tion of AI Use for Per­sonal Data Pro­tec­tion: Com­par­i­son of Global Strate­gies and Op­por­tu­ni­ties for Latin Amer­ica

Lisbeth Guzman Oct 14, 2024, 1:22 PM
10 points
1 comment21 min readEA link

Differ­en­tial knowl­edge interconnection

Roman LeventovOct 12, 2024, 12:52 PM
3 points
1 comment1 min readEA link

Shut­ting down all com­pet­ing AI pro­jects might not buy a lot of time due to In­ter­nal Time Pressure

ThomasCederborgOct 3, 2024, 12:05 AM
6 points
1 comment12 min readEA link

[Linkpost] A Nar­row Path—How to Se­cure our Future

MathiasKB🔸Oct 2, 2024, 10:50 PM
63 points
0 comments1 min readEA link
(www.narrowpath.co)

Adap­tive Com­pos­able Cog­ni­tive Core Unit (ACCCU)

Ihor IvlievMar 20, 2025, 9:48 PM
10 points
1 comment4 min readEA link

A short con­ver­sa­tion I had with Google Gem­ini on the dan­gers of un­reg­u­lated LLM API use, while mildly drunk in an air­port.

EvanMcCormickDec 17, 2024, 12:25 PM
1 point
0 comments8 min readEA link

A Five-Year Plan to En­sure AGI Benefits All Animals

Sam TuckerDec 17, 2024, 2:29 AM
30 points
2 comments15 min readEA link

2024: a year of con­soli­da­tion for ORCG

JorgeTorresCDec 18, 2024, 5:47 PM
33 points
0 comments7 min readEA link
(www.orcg.info)

Align­ment Fak­ing in Large Lan­guage Models

Ryan GreenblattDec 18, 2024, 5:19 PM
142 points
9 comments1 min readEA link

AISN #47: Rea­son­ing Models

Center for AI SafetyFeb 6, 2025, 6:44 PM
8 points
0 comments4 min readEA link
(newsletter.safe.ai)

Im­prov­ing ca­pa­bil­ity eval­u­a­tions for AI gov­er­nance: Open Philan­thropy’s new re­quest for proposals

cbFeb 7, 2025, 9:30 AM
37 points
3 comments3 min readEA link

Ex­ec­u­tive Direc­tor for AIS Brus­sels—Ex­pres­sion of interest

gergoDec 19, 2024, 9:15 AM
29 points
0 comments4 min readEA link

The am­bigu­ous effect of full au­toma­tion + new goods on GDP growth

trammellFeb 7, 2025, 2:53 AM
51 points
15 comments8 min readEA link

Med­i­cal Wind­fall Prizes

PeterMcCluskeyFeb 7, 2025, 12:13 AM
5 points
0 comments5 min readEA link
(bayesianinvestor.com)

AI data gaps could lead to on­go­ing An­i­mal Suffering

Darkness8i8Oct 17, 2024, 10:52 AM
13 points
3 comments5 min readEA link

What AI com­pa­nies should do: Some rough ideas

Zach Stein-PerlmanOct 21, 2024, 2:00 PM
14 points
1 comment1 min readEA link

The ELYSIUM Proposal

RokoOct 16, 2024, 2:14 AM
−10 points
0 comments1 min readEA link
(transhumanaxiology.substack.com)

Are we drop­ping the ball on Recom­men­da­tion AIs?

Raphaël SOct 23, 2024, 7:37 PM
5 points
0 comments1 min readEA link

Ex-OpenAI re­searcher says OpenAI mass-vi­o­lated copy­right law

RemmeltOct 24, 2024, 1:00 AM
11 points
0 comments1 min readEA link
(suchir.net)

Miles Brundage re­signed from OpenAI, and his AGI readi­ness team was disbanded

GarrisonOct 23, 2024, 11:42 PM
57 points
4 comments7 min readEA link
(garrisonlovely.substack.com)

AI, Greed, and the Death of Over­sight: When In­sti­tu­tions Ig­nore Their Own Limits

funnyfrancoMar 21, 2025, 1:13 PM
7 points
0 comments26 min readEA link

Re­quest for In­for­ma­tion for a new US AI Ac­tion Plan (OSTP RFI)

Agustín Covarrubias 🔸Feb 7, 2025, 8:22 PM
19 points
2 comments2 min readEA link
(www.federalregister.gov)

Con­sider this me drunk tex­ting the fo­rum: Is it use­ful to have data that can’t be touched by AI?

Jonas SøvikFeb 7, 2025, 9:52 PM
−8 points
0 comments1 min readEA link

How AI Takeover Might Hap­pen in Two Years

JoshcFeb 7, 2025, 11:51 PM
29 points
7 comments29 min readEA link
(x.com)

Finish­ing The SB-1047 Doc­u­men­tary In 6 Weeks

Michaël TrazziOct 28, 2024, 8:26 PM
67 points
0 comments4 min readEA link

Promethean Gover­nance Un­leashed: Pilot­ing Poly­cen­tric, Memetic Orders in the AI Frontier

LutherSloanMar 21, 2025, 4:35 PM
−10 points
1 comment3 min readEA link

Re­in­force­ment Learn­ing: A Non-Tech­ni­cal Primer on o1 and Deep­Seek-R1

AlexChalkFeb 9, 2025, 11:58 PM
4 points
0 comments9 min readEA link
(alexchalk.net)

World Ci­ti­zen Assem­bly about AI—Announcement

CamilleFeb 11, 2025, 10:51 AM
25 points
2 comments5 min readEA link

Ori­ent­ing to 3 year AGI timelines

NikolaDec 22, 2024, 11:07 PM
123 points
15 comments1 min readEA link

Skep­ti­cism to­wards claims about the views of pow­er­ful institutions

tlevinFeb 13, 2025, 7:40 AM
20 points
1 comment1 min readEA link

How do we solve the al­ign­ment prob­lem?

Joe_CarlsmithFeb 13, 2025, 6:27 PM
28 points
1 comment1 min readEA link
(joecarlsmith.substack.com)

What is it to solve the al­ign­ment prob­lem?

Joe_CarlsmithFeb 13, 2025, 6:42 PM
25 points
1 comment1 min readEA link
(joecarlsmith.substack.com)

Teach­ing AI to rea­son: this year’s most im­por­tant story

Benjamin_ToddFeb 13, 2025, 5:56 PM
140 points
18 comments8 min readEA link
(benjamintodd.substack.com)

Deepseek and Taiwan

YadavFeb 13, 2025, 5:19 PM
5 points
1 comment3 min readEA link
(45seconds.substack.com)

A bet­ter “State­ment on AI Risk?” [Cross­post]

Knight LeeDec 30, 2024, 7:36 AM
4 points
0 comments3 min readEA link

The cur­rent AI strate­gic land­scape: one bear’s perspective

Matrice JacobineFeb 15, 2025, 9:49 AM
6 points
0 comments2 min readEA link
(philosophybear.substack.com)

Emer­gency pod: Elon tries to crash OpenAI’s party (with Rose Chan Loui)

80000_HoursFeb 14, 2025, 4:29 PM
21 points
0 comments2 min readEA link

Co­op­er­a­tion for AI safety must tran­scend geopoli­ti­cal interference

Matrice JacobineFeb 16, 2025, 6:18 PM
9 points
0 comments1 min readEA link
(www.scmp.com)

By de­fault, cap­i­tal will mat­ter more than ever af­ter AGI

L Rudolf LDec 28, 2024, 5:52 PM
113 points
3 comments1 min readEA link
(nosetgauge.substack.com)

In­tro­duc­ing Tech Gover­nance Pro­ject

Zakariyau YusufOct 29, 2024, 9:20 AM
52 points
5 comments8 min readEA link

6 (Po­ten­tial) Mis­con­cep­tions about AI Intellectuals

Ozzie GooenFeb 14, 2025, 11:51 PM
30 points
2 comments12 min readEA link

What are some good books about AI safety?

Vishakha AgrawalFeb 17, 2025, 11:54 AM
7 points
0 comments3 min readEA link
(aisafety.info)

[Question] Will OpenAI’s o3 re­duce NVi­dia’s moat?

Ebenezer DukakisJan 3, 2025, 2:21 AM
9 points
6 comments1 min readEA link

AI Lab Re­tal­i­a­tion: A Sur­vival Guide

Jay ReadyJan 4, 2025, 11:05 PM
7 points
1 comment12 min readEA link
(morelightinai.substack.com)

Alt­man on the board, AGI, and superintelligence

OscarD🔸Jan 6, 2025, 2:37 PM
20 points
1 comment1 min readEA link
(blog.samaltman.com)

#212 – Why tech­nol­ogy is un­stop­pable & how to shape AI de­vel­op­ment any­way (Allan Dafoe on The 80,000 Hours Pod­cast)

80000_HoursFeb 17, 2025, 4:38 PM
16 points
0 comments19 min readEA link

AI Align­ment and the Fi­nan­cial War Against Nar­cis­sis­tic Manipulation

Julian NalenzFeb 19, 2025, 8:36 PM
2 points
0 comments3 min readEA link

[Question] Hyper-Abun­dant Systems

DavidofOmegaSFeb 19, 2025, 1:20 PM
1 point
0 comments4 min readEA link

The Case for Jour­nal­ism on AI

michelFeb 19, 2025, 7:45 PM
95 points
5 comments4 min readEA link

Deep­Seek Made it Even Harder for US AI Com­pa­nies to Ever Reach Profitability

GarrisonFeb 19, 2025, 9:02 PM
30 points
1 comment3 min readEA link
(garrisonlovely.substack.com)

Stable to­tal­i­tar­i­anism: an overview

80000_HoursOct 29, 2024, 4:07 PM
36 points
1 comment20 min readEA link
(80000hours.org)

ALTER Is­rael End-of-2024 Update

DavidmanheimJan 7, 2025, 3:07 PM
37 points
1 comment4 min readEA link

Tar­bell Fel­low­ship 2025 - Ap­pli­ca­tions Open (AI Jour­nal­ism)

Tarbell Center for AI JournalismJan 8, 2025, 3:25 PM
62 points
0 comments1 min readEA link

Wor­ri­some Trends for Digi­tal Mind Evaluations

Derek ShillerFeb 20, 2025, 3:35 PM
72 points
10 comments8 min readEA link

The moral ar­gu­ment for giv­ing AIs autonomy

Matthew_BarnettJan 8, 2025, 12:59 AM
33 points
7 comments11 min readEA link

US AI Safety In­sti­tute will be ‘gut­ted,’ Ax­ios reports

Matrice JacobineFeb 20, 2025, 2:40 PM
12 points
1 comment1 min readEA link
(www.zdnet.com)

[Question] Im­pact: Eng­ineer­ing VS Med­i­cal Scien­tist VS AI Safety VS Governance

AhmedWezJan 15, 2025, 3:47 PM
1 point
0 comments1 min readEA link

Im­pli­ca­tions of the in­fer­ence scal­ing paradigm for AI safety

Ryan KiddJan 15, 2025, 12:59 AM
46 points
5 comments1 min readEA link

The Com­pendium, A full ar­gu­ment about ex­tinc­tion risk from AGI

adamShimiOct 31, 2024, 12:02 PM
9 points
1 comment2 min readEA link
(www.thecompendium.ai)

Pub­lished re­port: Path­ways to short TAI timelines

Zershaaneh QureshiFeb 20, 2025, 10:10 PM
46 points
2 comments17 min readEA link
(www.convergenceanalysis.org)

AI Safety Protest, Melbourne, Aus­tralia

Mark BrownJan 17, 2025, 2:55 PM
2 points
0 comments1 min readEA link

AI for Re­solv­ing Fore­cast­ing Ques­tions: An Early Exploration

Ozzie GooenJan 16, 2025, 9:40 PM
21 points
0 comments9 min readEA link

New TIME mag­a­z­ine ar­ti­cle on the UK AI Safety In­sti­tute (AISI)

RasoolJan 16, 2025, 10:51 PM
9 points
0 comments1 min readEA link
(time.com)

[Question] How con­fi­dent are you that it’s prefer­able for Amer­ica to de­velop AGI be­fore China does?

ScienceMon🔸Feb 22, 2025, 1:37 PM
200 points
47 comments1 min readEA link

Scal­ing Wargam­ing for Global Catas­trophic Risks with AI

raiJan 18, 2025, 3:07 PM
73 points
1 comment4 min readEA link
(blog.sentinel-team.org)

Na­tion­wide Ac­tion Work­shop: Con­tact Congress about AI Safety!

Felix De SimoneFeb 24, 2025, 4:14 PM
5 points
0 comments1 min readEA link
(www.zeffy.com)

What Does an ASI Poli­ti­cal Ecol­ogy Mean for Hu­man Sur­vival?

Nathan SidneyFeb 23, 2025, 8:53 AM
7 points
3 comments1 min readEA link

New Re­port: Multi-Agent Risks from Ad­vanced AI

Lewis HammondFeb 23, 2025, 12:32 AM
39 points
3 comments2 min readEA link
(www.cooperativeai.com)

What We Can Do to Prevent Ex­tinc­tion by AI

Joe RogeroFeb 24, 2025, 5:15 PM
22 points
2 comments11 min readEA link

The Man­hat­tan Trap: Why a Race to Ar­tifi­cial Su­per­in­tel­li­gence is Self-Defeating

Corin KatzkeJan 21, 2025, 4:57 PM
98 points
1 comment2 min readEA link
(www.convergenceanalysis.org)

Stop call­ing them labs

sawyer🔸Feb 24, 2025, 10:58 PM
257 points
22 comments1 min readEA link

Con­fer­ence Re­port: Thresh­old 2030 - Model­ing AI Eco­nomic Futures

Deric ChengFeb 24, 2025, 6:57 PM
24 points
0 comments10 min readEA link
(www.convergenceanalysis.org)

Op­tion control

Joe_CarlsmithNov 4, 2024, 5:54 PM
11 points
0 comments1 min readEA link

[Question] Can we train AI so that fu­ture philan­thropy is more effec­tive?

Ricardo PimentelNov 3, 2024, 3:08 PM
3 points
0 comments1 min readEA link

The cur­rent state of RSPs

Zach Stein-PerlmanNov 4, 2024, 4:00 PM
19 points
1 comment1 min readEA link

Eth­i­cal Roots of Chi­nese AI

Vasiliy KondyrevNov 5, 2024, 2:07 PM
0 points
0 comments6 min readEA link

A brief his­tory of the au­to­mated corporation

Owen Cotton-BarrattNov 4, 2024, 2:37 PM
21 points
1 comment5 min readEA link
(strangecities.substack.com)

Patch­ing ~All Se­cu­rity-Rele­vant Open-Source Soft­ware?

niplavFeb 25, 2025, 9:35 PM
35 points
3 comments2 min readEA link

LLMs might not be the fu­ture of search: at least, not yet.

James-Hartree-LawJan 22, 2025, 9:40 PM
4 points
1 comment4 min readEA link

What are the differ­ences be­tween AGI, trans­for­ma­tive AI, and su­per­in­tel­li­gence?

Vishakha AgrawalJan 23, 2025, 10:11 AM
12 points
0 comments3 min readEA link
(aisafety.info)

AI com­pa­nies are un­likely to make high-as­surance safety cases if timelines are short

Ryan GreenblattJan 23, 2025, 6:41 PM
45 points
1 comment1 min readEA link

AISN #46: The Transition

Center for AI SafetyJan 23, 2025, 6:01 PM
10 points
0 comments5 min readEA link
(newsletter.safe.ai)

The GDM AGI Safety+Align­ment Team is Hiring for Ap­plied In­ter­pretabil­ity Research

Arthur ConmyFeb 25, 2025, 10:38 PM
3 points
0 comments7 min readEA link

AI Au­dit in Costa Rica

Priscilla CamposJan 27, 2025, 2:57 AM
10 points
4 comments9 min readEA link

Stan­ford sum­mer course: Eco­nomics of Trans­for­ma­tive AI

trammellJan 23, 2025, 11:07 PM
82 points
4 comments1 min readEA link

[Re­port] Bridg­ing the In­ter­na­tional AI Gover­nance Divide: Key Strate­gies for In­clud­ing the Global South

Heramb PodarJan 26, 2025, 11:55 PM
8 points
0 comments1 min readEA link
(encodeai.org)

Time to Think about ASI Con­sti­tu­tions?

ukc10014Jan 27, 2025, 9:28 AM
20 points
0 comments12 min readEA link

Pulse 2024: At­ti­tudes to­wards ar­tifi­cial intelligence

Jamie ENov 27, 2024, 11:33 AM
62 points
4 comments3 min readEA link

Cut­ting AI Safety down to size

Holly Elmore ⏸️ 🔸Nov 9, 2024, 11:40 PM
86 points
5 comments5 min readEA link

Don’t Let Other Global Catas­trophic Risks Fall Be­hind: Sup­port ORCG in 2024

JorgeTorresCNov 11, 2024, 6:27 PM
48 points
1 comment4 min readEA link

A se­lec­tion of les­sons from Se­bas­tian Lodemann

ClaireBNov 11, 2024, 9:33 PM
82 points
2 comments7 min readEA link

Six Re­search Pit­falls and How to Avoid Them: a Guide for Re­search Managers

Morgan SimpsonJan 28, 2025, 9:49 AM
13 points
0 comments10 min readEA link

The Game Board has been Flipped: Now is a good time to re­think what you’re doing

LintzAJan 28, 2025, 9:20 PM
379 points
69 comments13 min readEA link

The Elic­i­ta­tion Game: Eval­u­at­ing ca­pa­bil­ity elic­i­ta­tion techniques

Teun van der WeijFeb 27, 2025, 8:33 PM
3 points
0 comments1 min readEA link

AGI Can­not Be Pre­dicted From Real In­ter­est Rates

Nicholas DeckerJan 28, 2025, 5:45 PM
24 points
3 comments1 min readEA link
(nicholasdecker.substack.com)

Effec­tive AI Outreach | A Data Driven Approach

NoahCWilson🔸Feb 28, 2025, 12:44 AM
13 points
2 comments15 min readEA link

An Open Let­ter To EA and AI Safety On De­cel­er­at­ing AI Development

Kenneth_DiaoFeb 28, 2025, 5:15 PM
21 points
0 comments14 min readEA link
(graspingatwaves.substack.com)

The Miss­ing Piece: Why We Need a Grand Strat­egy for AI

ColemanFeb 28, 2025, 11:49 PM
4 points
0 comments9 min readEA link

Is Deep Learn­ing Ac­tu­ally Hit­ting a Wall? Eval­u­at­ing Ilya Sutskever’s Re­cent Claims

GarrisonNov 13, 2024, 5:00 PM
114 points
7 comments8 min readEA link
(garrisonlovely.substack.com)

Com­par­ing AI Labs and Phar­ma­ceu­ti­cal Companies

mxschonsNov 13, 2024, 2:51 PM
13 points
0 comments1 min readEA link
(mxschons.com)

In­cen­tive de­sign and ca­pa­bil­ity elicitation

Joe_CarlsmithNov 12, 2024, 8:56 PM
9 points
0 comments1 min readEA link

MIT Fu­tureTech are hiring ‍a Product and Data Vi­su­al­iza­tion De­signer

PeterSlatteryNov 13, 2024, 2:41 PM
9 points
0 comments4 min readEA link

Could this be an un­usu­ally good time to Earn To Give?

Tom GardinerMar 3, 2025, 11:00 PM
59 points
12 comments3 min readEA link

The MASK Bench­mark: Disen­tan­gling Hon­esty From Ac­cu­racy in AI Systems

Mantas MazeikaMar 4, 2025, 5:44 PM
22 points
0 comments2 min readEA link
(www.mask-benchmark.ai)

Top AI safety newslet­ters, books, pod­casts, etc – new AISafety.com resource

Bryce RobertsonMar 4, 2025, 5:01 PM
9 points
0 comments1 min readEA link

A Sketch of AI-Driven Epistemic Lock-In

Ozzie GooenMar 5, 2025, 10:40 PM
13 points
1 comment3 min readEA link

Frac­tal Gover­nance: A Tractable, Ne­glected Ap­proach to Ex­is­ten­tial Risk Reduction

WillPearsonMar 5, 2025, 7:57 PM
3 points
1 comment3 min readEA link

From Con­flict to Coex­is­tence: Rewrit­ing the Game Between Hu­mans and AGI

Michael BatellMar 4, 2025, 2:10 PM
12 points
2 comments19 min readEA link

Give Neo a Chance

ankMar 6, 2025, 2:35 PM
1 point
3 comments7 min readEA link

AISN #49: Su­per­in­tel­li­gence Strategy

Center for AI SafetyMar 6, 2025, 5:43 PM
8 points
0 comments5 min readEA link
(newsletter.safe.ai)

What the Head­lines Miss About the Lat­est De­ci­sion in the Musk vs. OpenAI Lawsuit

GarrisonMar 6, 2025, 7:49 PM
88 points
10 comments6 min readEA link
(garrisonlovely.substack.com)

[Question] Is it eth­i­cal to work in AI “con­tent eval­u­a­tion”?

anon_databoy555Jan 30, 2025, 1:27 PM
10 points
3 comments1 min readEA link

The Short Timelines Strat­egy for AI Safety Univer­sity Groups

Josh Thorsteinson 🔸Mar 7, 2025, 4:26 AM
48 points
6 comments5 min readEA link

Grad­ual Disem­pow­er­ment: Sys­temic Ex­is­ten­tial Risks from In­cre­men­tal AI Development

Jan_KulveitJan 30, 2025, 5:07 PM
38 points
4 comments1 min readEA link
(gradual-disempowerment.ai)

How Can Aver­age Peo­ple Con­tribute to AI Safety?

Stephen McAleeseMar 6, 2025, 10:50 PM
15 points
4 comments1 min readEA link

From Cri­sis to Con­trol: Estab­lish­ing a Re­silient In­ci­dent Re­sponse Frame­work for De­ployed AI Models

KevinNJan 31, 2025, 1:06 PM
10 points
1 comment6 min readEA link
(www.techpolicy.press)

Thoughts about Policy Ecosys­tems: The Miss­ing Links in AI Governance

Echo HuangJan 31, 2025, 1:23 PM
21 points
2 comments5 min readEA link

Emer­gency pod: Judge plants a le­gal time bomb un­der OpenAI (with Rose Chan Loui)

80000_HoursMar 7, 2025, 7:24 PM
62 points
18 comments2 min readEA link

[Cross­post] Some Very Im­por­tant Things (That I Won’t Be Work­ing On This Year)

Sarah ChengMar 10, 2025, 2:42 PM
28 points
1 comment4 min readEA link
(milesbrundage.substack.com)

Tether­ware #1: The case for hu­man­like AI with free will

Jáchym FibírJan 30, 2025, 11:57 AM
−1 points
2 comments10 min readEA link
(tetherware.substack.com)

Con­sider keep­ing your threat mod­els pri­vate.

Miles KodamaFeb 1, 2025, 12:29 AM
18 points
2 comments4 min readEA link

Na­tional Se­cu­rity Is Not In­ter­na­tional Se­cu­rity: A Cri­tique of AGI Realism

C.K.Feb 2, 2025, 5:04 PM
44 points
2 comments36 min readEA link
(conradkunadu.substack.com)

A differ­ent take on the Musk v OpenAI pre­limi­nary in­junc­tion order

TFDMar 11, 2025, 2:29 PM
6 points
1 comment20 min readEA link
(www.thefloatingdroid.com)

Where I Am Donat­ing in 2024

MichaelDickensNov 19, 2024, 12:09 AM
181 points
73 comments46 min readEA link

Linkpost: “Imag­in­ing and build­ing wise ma­chines: The cen­tral­ity of AI metacog­ni­tion” by John­son, Karimi, Ben­gio, et al.

Chris LeongNov 17, 2024, 3:00 PM
8 points
0 comments1 min readEA link
(arxiv.org)

AISN #44: The Trump Cir­cle on AI Safety Plus, Chi­nese re­searchers used Llama to cre­ate a mil­i­tary tool for the PLA, a Google AI sys­tem dis­cov­ered a zero-day cy­ber­se­cu­rity vuln­er­a­bil­ity, and Com­plex Sys­tems

Center for AI SafetyNov 19, 2024, 4:36 PM
11 points
0 comments5 min readEA link
(newsletter.safe.ai)

US gov­ern­ment com­mis­sion pushes Man­hat­tan Pro­ject-style AI initiative

LarksNov 19, 2024, 4:22 PM
83 points
15 comments1 min readEA link
(www.reuters.com)

The Choice Transition

Owen Cotton-BarrattNov 18, 2024, 12:32 PM
43 points
1 comment15 min readEA link
(strangecities.substack.com)

Which in­cen­tives should be used to en­courage com­pli­ance with UK AI leg­is­la­tion?

jcwNov 18, 2024, 6:13 PM
12 points
0 comments12 min readEA link

China Hawks are Man­u­fac­tur­ing an AI Arms Race

GarrisonNov 20, 2024, 6:17 PM
98 points
3 comments5 min readEA link
(garrisonlovely.substack.com)

Align­ing AI Safety Pro­jects with a Repub­li­can Administration

Deric ChengNov 21, 2024, 10:13 PM
13 points
1 comment8 min readEA link

Gw­ern on cre­at­ing your own AI race and China’s Fast Fol­lower strat­egy.

LarksNov 25, 2024, 3:01 AM
126 points
4 comments2 min readEA link
(www.lesswrong.com)

Agen­tic Align­ment: Nav­i­gat­ing be­tween Harm and Illegitimacy

LennardZNov 26, 2024, 9:27 PM
2 points
1 comment9 min readEA link

One, per­haps un­der­rated, AI risk.

Alex (Αλέξανδρος)Nov 28, 2024, 10:34 AM
7 points
1 comment3 min readEA link

CAIDP State­ment on Lethal Au­tonomous Weapons Sys­tems

Heramb PodarNov 30, 2024, 6:00 PM
7 points
0 comments1 min readEA link
(www.linkedin.com)

Liti­gate-for-Im­pact: Prepar­ing Le­gal Ac­tion against an AGI Fron­tier Lab Leader

Sonia M JosephDec 8, 2024, 2:28 PM
77 points
1 comment2 min readEA link

AI Risk in Africa

Claude FormanekOct 12, 2021, 2:28 AM
18 points
0 comments10 min readEA link

Sha­har Avin on How to Strate­gi­cally Reg­u­late Ad­vanced AI Systems

Michaël TrazziSep 23, 2022, 3:49 PM
48 points
2 comments4 min readEA link
(theinsideview.ai)

Idea: an AI gov­er­nance group colo­cated with ev­ery AI re­search group!

capybaraletDec 7, 2020, 11:41 PM
8 points
1 comment2 min readEA link

Nu­clear Es­pi­onage and AI Governance

GAAOct 4, 2021, 6:21 PM
32 points
3 comments24 min readEA link

The Wind­fall Clause has a reme­dies problem

John Bridge 🔸May 23, 2022, 10:31 AM
40 points
0 comments17 min readEA link

Ques­tions for fur­ther in­ves­ti­ga­tion of AI diffusion

Ben CottierDec 21, 2022, 1:50 PM
28 points
0 comments11 min readEA link

Google could build a con­scious AI in three months

Derek ShillerOct 1, 2022, 1:24 PM
16 points
22 comments7 min readEA link

On Ar­tifi­cial Gen­eral In­tel­li­gence: Ask­ing the Right Questions

Heather DouglasOct 2, 2022, 5:00 AM
−1 points
7 comments3 min readEA link

Prepar­ing for the In­tel­li­gence Explosion

finmMar 11, 2025, 3:38 PM
114 points
3 comments1 min readEA link
(www.forethought.org)

What if AI de­vel­op­ment goes well?

RoryGAug 3, 2022, 8:57 AM
25 points
7 comments12 min readEA link

Mas­sive Scal­ing Should be Frowned Upon

harsimonyNov 17, 2022, 5:44 PM
9 points
0 comments5 min readEA link

Safety with­out op­pres­sion: an AI gov­er­nance problem

Nathan_BarnardJul 28, 2022, 10:19 AM
3 points
0 comments8 min readEA link

An­nounc­ing the SPT Model Web App for AI Governance

Paolo BovaAug 4, 2022, 10:45 AM
42 points
0 comments5 min readEA link

Cryp­tocur­rency Ex­ploits Show the Im­por­tance of Proac­tive Poli­cies for AI X-Risk

eSpencerSep 16, 2022, 4:44 AM
14 points
1 comment4 min readEA link

[Question] Does China have AI al­ign­ment re­sources/​in­sti­tu­tions? How can we pri­ori­tize cre­at­ing more?

JakubKAug 4, 2022, 7:23 PM
18 points
9 comments1 min readEA link

AI Alter­na­tive Fu­tures: Ex­plo­ra­tory Sce­nario Map­ping for Ar­tifi­cial In­tel­li­gence Risk—Re­quest for Par­ti­ci­pa­tion [Linkpost]

KiliankMay 9, 2022, 7:53 PM
17 points
2 comments8 min readEA link

AGI al­ign­ment re­sults from a se­ries of al­igned ac­tions

hanadulsetDec 27, 2021, 7:33 PM
15 points
1 comment6 min readEA link

Forethought: A new AI macros­trat­egy group

Amrit Sidhu-Brar 🔸Mar 11, 2025, 3:36 PM
166 points
6 comments3 min readEA link

Fund­ing for hu­man­i­tar­ian non-prof­its to re­search re­spon­si­ble AI

Deborah W.A. FoulkesDec 10, 2024, 8:08 AM
4 points
0 comments2 min readEA link
(www.gov.uk)

Im­pli­ca­tions of large lan­guage model diffu­sion for AI governance

Ben CottierDec 21, 2022, 1:50 PM
14 points
0 comments38 min readEA link

What is Com­pute? - Trans­for­ma­tive AI and Com­pute [1/​4]

lennartSep 23, 2021, 1:54 PM
48 points
6 comments18 min readEA link

CNAS re­port: ‘Ar­tifi­cial In­tel­li­gence and Arms Con­trol’

MMMaasOct 13, 2022, 8:35 AM
16 points
0 comments1 min readEA link
(www.cnas.org)

[Question] What are the most press­ing is­sues in short-term AI policy?

Eevee🔹Jan 14, 2020, 10:05 PM
9 points
0 comments1 min readEA link

Who owns AI-gen­er­ated con­tent?

Johan S DanielDec 7, 2022, 3:03 AM
−2 points
0 comments2 min readEA link

Against GDP as a met­ric for timelines and take­off speeds

kokotajlodDec 29, 2020, 5:50 PM
47 points
6 comments14 min readEA link

“Nor­mal ac­ci­dents” and AI sys­tems

Eleni_AAug 8, 2022, 6:43 PM
5 points
1 comment1 min readEA link
(www.achan.ca)

Trans­for­ma­tive AI and Com­pute [Sum­mary]

lennartSep 23, 2021, 1:53 PM
65 points
5 comments9 min readEA link

[Question] What do we do if AI doesn’t take over the world, but still causes a sig­nifi­cant global prob­lem?

James_BanksAug 2, 2020, 3:35 AM
16 points
5 comments1 min readEA link

AI Safety Overview: CERI Sum­mer Re­search Fellowship

Jamie BMar 24, 2022, 3:12 PM
29 points
0 comments2 min readEA link

Sce­nario Map­ping Ad­vanced AI Risk: Re­quest for Par­ti­ci­pa­tion with Data Collection

KiliankMar 27, 2022, 11:44 AM
14 points
0 comments5 min readEA link

When is AI safety re­search harm­ful?

Nathan_BarnardMay 9, 2022, 10:36 AM
13 points
6 comments9 min readEA link

Credo AI is hiring for sev­eral roles

IanEisenbergApr 11, 2022, 3:58 PM
14 points
2 comments1 min readEA link

Where are the red lines for AI?

Karl von WendtAug 5, 2022, 9:41 AM
13 points
3 comments6 min readEA link

Deep­Mind’s gen­er­al­ist AI, Gato: A non-tech­ni­cal explainer

frances_lorenzMay 16, 2022, 9:19 PM
128 points
13 comments6 min readEA link

The case for long-term cor­po­rate gov­er­nance of AI

SethBaumNov 3, 2021, 10:50 AM
42 points
3 comments8 min readEA link

Google’s ethics is alarming

len.hoang.lnhFeb 25, 2021, 5:57 AM
6 points
5 comments1 min readEA link

Let’s think about slow­ing down AI

Katja_GraceDec 23, 2022, 7:56 PM
334 points
9 comments1 min readEA link

Paths and waysta­tions in AI safety

Joe_CarlsmithMar 11, 2025, 6:52 PM
22 points
2 comments1 min readEA link
(joecarlsmith.substack.com)

AI Benefits Post 2: How AI Benefits Differs from AI Align­ment & AI for Good

Cullen 🔸Jun 29, 2020, 4:59 PM
9 points
0 comments2 min readEA link

Long-term AI policy strat­egy re­search and implementation

Benjamin_ToddNov 9, 2021, 12:00 AM
1 point
0 comments7 min readEA link
(80000hours.org)

An­nounc­ing the GovAI Policy Team

MarkusAnderljungAug 1, 2022, 10:46 PM
107 points
11 comments2 min readEA link

Fore­cast­ing Com­pute—Trans­for­ma­tive AI and Com­pute [2/​4]

lennartOct 1, 2021, 8:25 AM
39 points
6 comments19 min readEA link

Data Publi­ca­tion for the 2021 Ar­tifi­cial In­tel­li­gence, Mo­ral­ity, and Sen­tience (AIMS) Sur­vey

Janet PauketatMar 24, 2022, 3:43 PM
21 points
0 comments3 min readEA link
(www.sentienceinstitute.org)

How to get tech­nolog­i­cal knowl­edge on AI/​ML (for non-tech peo­ple)

FangFangJun 30, 2021, 7:53 AM
62 points
7 comments5 min readEA link

What if we don’t need a “Hard Left Turn” to reach AGI?

EigengenderJul 15, 2022, 9:49 AM
39 points
7 comments4 min readEA link

England & Wales & Windfalls

John Bridge 🔸Jun 3, 2022, 10:26 AM
13 points
1 comment24 min readEA link

AI Benefits Post 5: Out­stand­ing Ques­tions on Govern­ing Benefits

Cullen 🔸Jul 21, 2020, 4:45 PM
5 points
0 comments4 min readEA link

Ap­ply now for the EU Tech Policy Fel­low­ship 2023

Jan-WillemNov 11, 2022, 6:16 AM
64 points
1 comment5 min readEA link

In­tro­duc­ing a New Course on the Eco­nomics of AI

akorinekDec 21, 2021, 4:55 AM
84 points
6 comments2 min readEA link

The repli­ca­tion and em­u­la­tion of GPT-3

Ben CottierDec 21, 2022, 1:49 PM
14 points
0 comments33 min readEA link

Toby Ord’s new re­port on les­sons from the de­vel­op­ment of the atomic bomb

Ishan MukherjeeNov 22, 2022, 10:37 AM
65 points
3 comments1 min readEA link
(www.governance.ai)

Train­ing for Good—Up­date & Plans for 2023

Cillian_Nov 15, 2022, 4:02 PM
80 points
1 comment10 min readEA link

Publi­ca­tion de­ci­sions for large lan­guage mod­els, and their impacts

Ben CottierDec 21, 2022, 1:50 PM
14 points
0 comments16 min readEA link

4 Years Later: Pres­i­dent Trump and Global Catas­trophic Risk

HaydnBelfieldOct 25, 2020, 4:28 PM
43 points
10 comments10 min readEA link

How long till Brus­sels?: A light in­ves­ti­ga­tion into the Brus­sels Gap

YadavDec 26, 2022, 7:49 AM
50 points
2 comments5 min readEA link

GPT-3-like mod­els are now much eas­ier to ac­cess and de­ploy than to develop

Ben CottierDec 21, 2022, 1:49 PM
22 points
3 comments19 min readEA link

Ap­pli­ca­tions Open: GovAI Sum­mer Fel­low­ship 2023

GovAIDec 21, 2022, 3:00 PM
28 points
0 comments2 min readEA link

Re­search + Real­ity Graph­ing to Sup­port AI Policy (and more): Sum­mary of a Frozen Project

Marcel DJul 2, 2022, 8:58 PM
34 points
2 comments8 min readEA link

A Brief Sum­mary Of The Most Im­por­tant Century

Maynk02Oct 25, 2022, 3:28 PM
3 points
0 comments5 min readEA link

The AIA and its Brus­sels Effect

Kathryn O'RourkeDec 27, 2022, 4:01 PM
16 points
0 comments5 min readEA link

13 Re­cent Publi­ca­tions on Ex­is­ten­tial Risk (Jan 2021 up­date)

HaydnBelfieldFeb 8, 2021, 12:42 PM
7 points
2 comments10 min readEA link

A Cal­ifor­nia Effect for Ar­tifi­cial Intelligence

henryjSep 9, 2022, 2:17 PM
73 points
1 comment4 min readEA link
(docs.google.com)

Back­ground for “Un­der­stand­ing the diffu­sion of large lan­guage mod­els”

Ben CottierDec 21, 2022, 1:49 PM
12 points
0 comments23 min readEA link

[Job]: AI Stan­dards Devel­op­ment Re­search Assistant

Tony BarrettOct 14, 2022, 8:18 PM
13 points
0 comments2 min readEA link

CSER is hiring for a se­nior re­search as­so­ci­ate on longterm AI risk and governance

Sam ClarkeJan 24, 2022, 1:24 PM
9 points
4 comments1 min readEA link

In­for­ma­tion in risky tech­nol­ogy races

nemeryxuAug 2, 2022, 11:35 PM
15 points
2 comments3 min readEA link

Com­pute Gover­nance and Con­clu­sions—Trans­for­ma­tive AI and Com­pute [3/​4]

lennartOct 14, 2021, 7:55 AM
20 points
3 comments5 min readEA link

Tips for con­duct­ing wor­ld­view investigations

lukeprogApr 12, 2022, 7:28 PM
88 points
4 comments2 min readEA link

The His­tory, Episte­mol­ogy and Strat­egy of Tech­nolog­i­cal Res­traint, and les­sons for AI (short es­say)

MMMaasAug 10, 2022, 11:00 AM
90 points
6 comments9 min readEA link
(verfassungsblog.de)

In­tent al­ign­ment should not be the goal for AGI x-risk reduction

johnjnayOct 26, 2022, 1:24 AM
7 points
1 comment1 min readEA link

Com­pute Re­search Ques­tions and Met­rics—Trans­for­ma­tive AI and Com­pute [4/​4]

lennartNov 28, 2021, 10:18 PM
18 points
2 comments1 min readEA link

A Primer on God, Liber­al­ism and the End of History

Mahdi ComplexMar 28, 2022, 5:26 AM
8 points
3 comments14 min readEA link

AGI Risk: How to in­ter­na­tion­ally reg­u­late in­dus­tries in non-democracies

Timothy_LiptrotMay 16, 2022, 10:45 PM
9 points
2 comments9 min readEA link

In­for­ma­tion se­cu­rity con­sid­er­a­tions for AI and the long term future

Jeffrey LadishMay 2, 2022, 8:53 PM
134 points
8 comments11 min readEA link

[Question] AI Eth­i­cal Committee

eaaicommitteeMar 1, 2022, 11:35 PM
8 points
0 comments1 min readEA link

Ar­tifi­cial In­tel­li­gence and Nu­clear Com­mand, Con­trol, & Com­mu­ni­ca­tions: The Risks of Integration

Peter RautenbachNov 18, 2022, 1:01 PM
60 points
3 comments50 min readEA link

New Work­ing Paper Series of the Le­gal Pri­ori­ties Project

Legal Priorities ProjectOct 18, 2021, 10:30 AM
60 points
0 comments9 min readEA link

Cen­tre for the Study of Ex­is­ten­tial Risk Four Month Re­port June—Septem­ber 2020

HaydnBelfieldDec 2, 2020, 6:33 PM
24 points
0 comments17 min readEA link

Sup­port­ing global co­or­di­na­tion in AI de­vel­op­ment: Why and how to con­tribute to in­ter­na­tional AI standards

pcihonApr 17, 2019, 10:17 PM
21 points
4 comments1 min readEA link

The Ter­minol­ogy of Ar­tifi­cial Sentience

Janet PauketatNov 28, 2021, 7:52 AM
29 points
0 comments1 min readEA link
(www.sentienceinstitute.org)

Pivotal out­comes and pivotal processes

Andrew CritchJun 17, 2022, 11:43 PM
49 points
1 comment4 min readEA link

Is Eric Sch­midt fund­ing AI ca­pa­bil­ities re­search by the US gov­ern­ment?

Pranay KDec 24, 2022, 8:32 AM
46 points
3 comments2 min readEA link
(www.politico.com)

Drivers of large lan­guage model diffu­sion: in­cre­men­tal re­search, pub­lic­ity, and cascades

Ben CottierDec 21, 2022, 1:50 PM
21 points
0 comments29 min readEA link

[Question] Slow­ing down AI progress?

Eleni_AJul 26, 2022, 8:46 AM
16 points
9 comments1 min readEA link

Ac­tion­able-guidance and roadmap recom­men­da­tions for the NIST AI Risk Man­age­ment Framework

Tony BarrettMay 17, 2022, 3:27 PM
11 points
0 comments3 min readEA link

Euro­pean Union AI Devel­op­ment and Gover­nance Part­ner­ships

EU AI GovernanceJan 19, 2022, 10:26 AM
22 points
1 comment4 min readEA link

Should AI fo­cus on prob­lem-solv­ing or strate­gic plan­ning? Why not both?

oliver_siegelNov 1, 2022, 9:53 AM
1 point
0 comments1 min readEA link

AI Safety Endgame Stories

IvanVendrovSep 28, 2022, 5:12 PM
31 points
1 comment1 min readEA link

Par­allels Between AI Safety by De­bate and Ev­i­dence Law

Cullen 🔸Jul 20, 2020, 10:52 PM
30 points
2 comments2 min readEA link
(cullenokeefe.com)

FYI: I’m work­ing on a book about the threat of AGI/​ASI for a gen­eral au­di­ence. I hope it will be of value to the cause and the community

Darren McKeeJun 17, 2022, 11:52 AM
32 points
1 comment2 min readEA link

Re­port on Semi-in­for­ma­tive Pri­ors for AI timelines (Open Philan­thropy)

Tom_DavidsonMar 26, 2021, 5:46 PM
62 points
6 comments2 min readEA link

AI Benefits Post 1: In­tro­duc­ing “AI Benefits”

Cullen 🔸Jun 22, 2020, 4:58 PM
10 points
2 comments3 min readEA link

Tony Blair In­sti­tute—Com­pute for AI In­dex ( Seek­ing a Sup­plier)

TomWestgarthOct 3, 2022, 10:25 AM
29 points
8 comments1 min readEA link

AI Benefits Post 3: Direct and Indi­rect Ap­proaches to AI Benefits

Cullen 🔸Jul 6, 2020, 6:46 PM
5 points
0 comments2 min readEA link

Ar­tifi­cial In­tel­li­gence, Mo­ral­ity, and Sen­tience (AIMS) Sur­vey: 2021

Janet PauketatJul 1, 2022, 7:47 AM
36 points
0 comments2 min readEA link
(www.sentienceinstitute.org)

AGI Timelines in Gover­nance: Differ­ent Strate­gies for Differ­ent Timeframes

simeon_cDec 19, 2022, 9:31 PM
110 points
19 comments1 min readEA link

How Rood­man’s GWP model trans­lates to TAI timelines

kokotajlodNov 16, 2020, 2:11 PM
22 points
0 comments2 min readEA link

Con­clu­sion and Bibliog­ra­phy for “Un­der­stand­ing the diffu­sion of large lan­guage mod­els”

Ben CottierDec 21, 2022, 1:50 PM
12 points
0 comments11 min readEA link

The flaws that make to­day’s AI ar­chi­tec­ture un­safe and a new ap­proach that could fix it

80000_HoursJun 22, 2020, 10:15 PM
3 points
0 comments86 min readEA link
(80000hours.org)

HIRING: In­form and shape a new pro­ject on AI safety at Part­ner­ship on AI

Madhulika SrikumarNov 24, 2021, 4:29 PM
11 points
2 comments1 min readEA link

Any fur­ther work on AI Safety Suc­cess Sto­ries?

KriegerOct 2, 2022, 11:59 AM
4 points
0 comments1 min readEA link

[Question] What “defense lay­ers” should gov­ern­ments, AI labs, and busi­nesses use to pre­vent catas­trophic AI failures?

LintzADec 3, 2021, 2:24 PM
37 points
3 comments1 min readEA link

In­ter­na­tional co­op­er­a­tion as a tool to re­duce two ex­is­ten­tial risks.

johl@umich.eduApr 19, 2021, 4:51 PM
28 points
4 comments23 min readEA link

Stu­art Rus­sell Hu­man Com­pat­i­ble AI Roundtable with Allan Dafoe, Rob Re­ich, & Ma­ri­etje Schaake

Mahendra PrasadFeb 11, 2021, 7:43 AM
16 points
0 comments1 min readEA link

Align­ing AI with Hu­mans by Lev­er­ag­ing Le­gal Informatics

johnjnaySep 18, 2022, 7:43 AM
20 points
11 comments3 min readEA link

Pos­si­ble di­rec­tions in AI ideal gov­er­nance research

RoryGAug 10, 2022, 8:36 AM
5 points
0 comments3 min readEA link

Con­tribute by fa­cil­i­tat­ing the AGI Safety Fun­da­men­tals Programme

Jamie BDec 6, 2021, 11:50 AM
27 points
0 comments2 min readEA link

A challenge for AGI or­ga­ni­za­tions, and a challenge for readers

RobBensingerDec 1, 2022, 11:11 PM
172 points
13 comments1 min readEA link

How Open Source Ma­chine Learn­ing Soft­ware Shapes AI

Max LSep 28, 2022, 5:49 PM
11 points
3 comments15 min readEA link
(maxlangenkamp.me)

Credo AI is hiring!

IanEisenbergMar 3, 2022, 6:02 PM
16 points
6 comments4 min readEA link

*New* Canada AI Safety & Gover­nance community

Wyatt Tessari L'AlliéAug 29, 2022, 3:58 PM
32 points
2 comments1 min readEA link

A col­lec­tion of AI Gover­nance-re­lated Pod­casts, Newslet­ters, Blogs, and more

LintzAOct 2, 2021, 12:46 AM
24 points
1 comment1 min readEA link

Nine Points of Col­lec­tive Insanity

RemmeltDec 27, 2022, 3:14 AM
1 point
0 comments1 min readEA link

A course for the gen­eral pub­lic on AI

LeandroDAug 31, 2020, 1:29 AM
1 point
0 comments1 min readEA link

Ap­pendix to Bridg­ing Demonstration

mako yassJun 1, 2022, 8:30 PM
18 points
2 comments28 min readEA link

Does gen­er­al­ity pay? GPT-3 can provide pre­limi­nary ev­i­dence.

Eevee🔹Jul 12, 2020, 6:53 PM
21 points
4 comments2 min readEA link

Main paths to im­pact in EU AI Policy

JOMG_MonnetDec 8, 2022, 4:17 PM
69 points
2 comments8 min readEA link

Les­sons from Three Mile Is­land for AI Warn­ing Shots

NickGabsSep 26, 2022, 2:47 AM
42 points
0 comments15 min readEA link

Un­der­stand­ing the diffu­sion of large lan­guage mod­els: summary

Ben CottierDec 21, 2022, 1:49 PM
127 points
18 comments22 min readEA link

Book re­view: Ar­chi­tects of In­tel­li­gence by Martin Ford (2018)

OferAug 11, 2020, 5:24 PM
11 points
1 comment2 min readEA link

[Link and com­men­tary] Beyond Near- and Long-Term: Towards a Clearer Ac­count of Re­search Pri­ori­ties in AI Ethics and Society

MichaelA🔸Mar 14, 2020, 9:04 AM
18 points
0 comments6 min readEA link

Anal­y­sis of Global AI Gover­nance Strategies

SammyDMartinDec 11, 2024, 11:08 AM
23 points
0 comments1 min readEA link
(www.lesswrong.com)

The ‘Old AI’: Les­sons for AI gov­er­nance from early elec­tric­ity regulation

Sam ClarkeDec 19, 2022, 2:46 AM
58 points
1 comment13 min readEA link

FLI is hiring a new Direc­tor of US Policy

aaguirreJul 27, 2022, 12:07 AM
14 points
0 comments1 min readEA link

Why we need a new agency to reg­u­late ad­vanced ar­tifi­cial intelligence

Michael HuangAug 4, 2022, 1:38 PM
25 points
0 comments1 min readEA link
(www.brookings.edu)

The Slip­pery Slope from DALLE-2 to Deep­fake Anarchy

stecasNov 5, 2022, 2:47 PM
55 points
11 comments17 min readEA link

[Pod­cast] Ajeya Co­tra on wor­ld­view di­ver­sifi­ca­tion and how big the fu­ture could be

Eevee🔹Jan 22, 2021, 11:57 PM
57 points
20 comments1 min readEA link
(80000hours.org)

Overview of Trans­for­ma­tive AI Mi­suse Risks

SammyDMartinDec 11, 2024, 11:04 AM
12 points
0 comments2 min readEA link
(longtermrisk.org)

Will the EU reg­u­la­tions on AI mat­ter to the rest of the world?

hanadulsetJan 1, 2022, 9:56 PM
33 points
5 comments5 min readEA link

In­sti­tu­tions Can­not Res­train Dark-Triad AI Exploitation

RemmeltDec 27, 2022, 10:34 AM
8 points
0 comments1 min readEA link

Sur­vey on AI ex­is­ten­tial risk scenarios

Sam ClarkeJun 8, 2021, 5:12 PM
154 points
11 comments6 min readEA link

How might we al­ign trans­for­ma­tive AI if it’s de­vel­oped very soon?

Holden KarnofskyAug 29, 2022, 3:48 PM
163 points
17 comments44 min readEA link

What does it mean to be­come an ex­pert in AI Hard­ware?

TophJan 9, 2021, 4:15 AM
87 points
10 comments11 min readEA link

Three new re­ports re­view­ing re­search and con­cepts in ad­vanced AI governance

MMMaasNov 28, 2023, 9:21 AM
32 points
0 comments2 min readEA link
(www.legalpriorities.org)

‘Ar­tifi­cial In­tel­li­gence Gover­nance un­der Change’ (PhD dis­ser­ta­tion)

MMMaasSep 15, 2022, 12:10 PM
54 points
1 comment2 min readEA link
(drive.google.com)

Birds, Brains, Planes, and AI: Against Ap­peals to the Com­plex­ity/​Mys­te­ri­ous­ness/​Effi­ciency of the Brain

kokotajlodJan 18, 2021, 12:39 PM
27 points
2 comments1 min readEA link

The Pug­wash Con­fer­ences and the Anti-Bal­lis­tic Mis­sile Treaty as a case study of Track II diplomacy

rani_martinSep 16, 2022, 10:42 AM
82 points
5 comments27 min readEA link

Quick Thoughts on A.I. Governance

Nicholas / Heather KrossApr 30, 2022, 2:49 PM
43 points
0 comments2 min readEA link
(www.thinkingmuchbetter.com)

[Linkpost] “Blueprint for an AI Bill of Rights”—Office of Science and Tech­nol­ogy Policy, USA (2022)

QubitSwarm99Oct 5, 2022, 4:48 PM
15 points
0 comments1 min readEA link

How Europe might mat­ter for AI governance

stefan.torgesJul 12, 2019, 11:42 PM
52 points
13 comments8 min readEA link

Rac­ing through a minefield: the AI de­ploy­ment problem

Holden KarnofskyDec 31, 2022, 9:44 PM
79 points
1 comment13 min readEA link
(www.cold-takes.com)

Large Lan­guage Models as Cor­po­rate Lob­by­ists, and Im­pli­ca­tions for So­cietal-AI Alignment

johnjnayJan 4, 2023, 10:22 PM
10 points
6 comments8 min readEA link

Meta: Fron­tier AI Framework

Zach Stein-PerlmanFeb 3, 2025, 10:00 PM
23 points
0 comments1 min readEA link
(ai.meta.com)

Went­worth and Larsen on buy­ing time

AkashJan 9, 2023, 9:31 PM
48 points
0 comments1 min readEA link

[Ru­mour] Microsoft to in­vest $10B in OpenAI, will re­ceive 75% of prof­its un­til they re­coup in­vest­ment: GPT would be in­te­grated with Office

𝕮𝖎𝖓𝖊𝖗𝖆Jan 10, 2023, 11:43 PM
25 points
2 comments1 min readEA link

Slay­ing the Hy­dra: to­ward a new game board for AI

PrometheusJun 23, 2023, 5:04 PM
3 points
2 comments1 min readEA link

Between Science Fic­tion and Emerg­ing Real­ity: Are We Ready for Digi­tal Per­sons?

Alex (Αλέξανδρος)Mar 13, 2025, 4:09 PM
3 points
1 comment5 min readEA link

[Question] Should AI writ­ers be pro­hibited in ed­u­ca­tion?

Eleni_AJan 16, 2023, 10:29 PM
3 points
2 comments1 min readEA link

Are New Ideas in AI Get­ting Harder to Find?

Charlie HarrisonDec 10, 2024, 12:52 PM
39 points
3 comments5 min readEA link

Le­gal tem­plate for con­di­tional gift deed as an al­ter­na­tive to wa­gers on AI doom

bruceMar 13, 2025, 2:57 PM
30 points
6 comments1 min readEA link

In­tel­sat as a Model for In­ter­na­tional AGI Governance

rosehadsharMar 13, 2025, 12:58 PM
40 points
1 comment1 min readEA link
(www.forethought.org)

AI safety mile­stones?

Zach Stein-PerlmanJan 23, 2023, 9:30 PM
6 points
0 comments1 min readEA link

AI Gover­nance Read­ing Group [Toronto+re­mote]

Liav.KorenJan 24, 2023, 10:05 PM
2 points
0 comments1 min readEA link

Ap­ply to HAIST/​MAIA’s AI Gover­nance Work­shop in DC (Feb 17-20)

PhosphorousJan 28, 2023, 12:45 AM
15 points
0 comments1 min readEA link
(www.lesswrong.com)

A Fron­tier AI Risk Man­age­ment Frame­work: Bridg­ing the Gap Between Cur­rent AI Prac­tices and Estab­lished Risk Management

simeon_cMar 13, 2025, 6:29 PM
6 points
0 comments1 min readEA link
(arxiv.org)

The Work of Chad Jones

Nicholas DeckerMar 13, 2025, 6:00 PM
11 points
0 comments1 min readEA link
(nicholasdecker.substack.com)

Assess­ing China’s im­por­tance as an AI superpower

JulianHazellFeb 3, 2023, 11:08 AM
89 points
7 comments1 min readEA link
(muddyclothes.substack.com)

Launch­ing The Col­lec­tive In­tel­li­gence Pro­ject: Whitepa­per and Pilots

jasmine_wangFeb 6, 2023, 5:00 PM
38 points
8 comments2 min readEA link
(cip.org)

Re­duc­ing LLM de­cep­tion at scale with self-other over­lap fine-tuning

Marc CarauleanuMar 13, 2025, 7:09 PM
8 points
0 comments1 min readEA link

High im­pact job op­por­tu­nity at ARIA (UK)

RasoolFeb 12, 2023, 10:35 AM
80 points
0 comments1 min readEA link

How to ‘troll for good’: Lev­er­ag­ing IP for AI governance

Michael HuangFeb 26, 2023, 6:34 AM
26 points
3 comments1 min readEA link
(www.science.org)

Very Briefly: The CHIPS Act

YadavFeb 26, 2023, 1:53 PM
40 points
3 comments1 min readEA link
(www.y1d2.com)

[Question] An eco­nomics of AI gov—best re­sources for

LivFeb 26, 2023, 11:11 AM
10 points
4 comments1 min readEA link

Call for Cruxes by Rhyme, a Longter­mist His­tory Con­sul­tancy

Lara_THMar 1, 2023, 10:20 AM
147 points
6 comments3 min readEA link

[Question] What are some sources re­lated to big-pic­ture AI strat­egy?

Jacob Watts🔸Mar 2, 2023, 5:04 AM
9 points
4 comments1 min readEA link

Distil­la­tion of The Offense-Defense Balance of Scien­tific Knowledge

Arjun YadavAug 12, 2022, 7:01 AM
17 points
0 comments2 min readEA link

A con­cern­ing ob­ser­va­tion from me­dia cov­er­age of AI in­dus­try dynamics

Justin OliveMar 2, 2023, 11:56 PM
48 points
5 comments3 min readEA link

Paper Sum­mary: The Effec­tive­ness of AI Ex­is­ten­tial Risk Com­mu­ni­ca­tion to the Amer­i­can and Dutch Public

OttoMar 9, 2023, 10:40 AM
97 points
11 comments4 min readEA link

[Question] What would need to be true for AI to trans­late a le­gal con­tract to a smart con­tract?

Patrick LiuMar 18, 2023, 4:42 PM
−1 points
0 comments1 min readEA link

Ques­tions about Con­je­cure’s CoEm proposal

AkashMar 9, 2023, 7:32 PM
19 points
0 comments1 min readEA link

[Linkpost] Scott Alexan­der re­acts to OpenAI’s lat­est post

AkashMar 11, 2023, 10:24 PM
105 points
4 comments1 min readEA link

[Question] Can we ever en­sure AI al­ign­ment if we can only test AI per­sonas?

Karl von WendtMar 16, 2025, 8:06 AM
8 points
0 comments1 min readEA link

Three Types of In­tel­li­gence Explosion

rosehadsharMar 17, 2025, 2:47 PM
44 points
1 comment3 min readEA link
(www.forethought.org)

Video and Tran­script of Pre­sen­ta­tion on Ex­is­ten­tial Risk from Power-Seek­ing AI

Joe_CarlsmithMay 8, 2022, 3:52 AM
97 points
7 comments30 min readEA link

[Question] Is AI like disk drives?

TanaeSep 2, 2023, 7:12 PM
8 points
1 comment1 min readEA link

Trans­for­ma­tive AI and Com­pute—Read­ing List

Frederik BergSep 4, 2023, 6:21 AM
24 points
0 comments1 min readEA link
(docs.google.com)

Five ne­glected work ar­eas that could re­duce AI risk

Aaron_ScherSep 24, 2023, 2:09 AM
22 points
0 comments9 min readEA link

Look­ing for Cana­dian sum­mer co-op po­si­tion in AI Governance

tcelferactJun 26, 2023, 5:27 PM
6 points
2 comments1 min readEA link

Let’s set new AI safety ac­tors up for success

michelJun 26, 2023, 9:17 PM
33 points
1 comment9 min readEA link

How to pur­sue a ca­reer in AI gov­er­nance and coordination

Cody_FenwickSep 25, 2023, 12:00 PM
32 points
1 comment29 min readEA link
(80000hours.org)

Biosafety Reg­u­la­tions (BMBL) and their rele­vance for AI

stepanlosJun 29, 2023, 7:20 PM
8 points
0 comments4 min readEA link

Open Agency model can solve the AI reg­u­la­tion dilemma

Roman LeventovNov 9, 2023, 3:22 PM
4 points
0 comments2 min readEA link

Public Opinion on AI Safety: AIMS 2023 and 2021 Summary

Janet PauketatSep 25, 2023, 6:09 PM
19 points
0 comments3 min readEA link
(www.sentienceinstitute.org)

Fun­da­men­tal Challenges in AI Governance

TharinOct 23, 2023, 1:30 AM
7 points
1 comment7 min readEA link

An­nounc­ing New Begin­ner-friendly Book on AI Safety and Risk

Darren McKeeNov 25, 2023, 3:57 PM
114 points
9 comments1 min readEA link

AI Safety is Drop­ping the Ball on Clown Attacks

trevor1Oct 21, 2023, 11:15 PM
−17 points
0 comments1 min readEA link

On ex­clud­ing dan­ger­ous in­for­ma­tion from training

ShayBenMosheNov 17, 2023, 8:09 PM
8 points
0 comments3 min readEA link
(www.lesswrong.com)

The Wizard of Oz Prob­lem: How in­cen­tives and nar­ra­tives can skew our per­cep­tion of AI developments

AkashMar 20, 2023, 10:36 PM
16 points
0 comments1 min readEA link

An­nounc­ing #AISum­mitTalks fea­tur­ing Pro­fes­sor Stu­art Rus­sell and many others

OttoOct 24, 2023, 10:16 AM
9 points
1 comment1 min readEA link

[Question] Am I tak­ing crazy pills? Why aren’t EAs ad­vo­cat­ing for a pause on AI ca­pa­bil­ities?

yanni kyriacosAug 15, 2023, 11:29 PM
18 points
21 comments1 min readEA link

Credo AI is hiring for AI Gov Re­searcher & more!

IanEisenbergAug 15, 2023, 9:10 PM
8 points
0 comments3 min readEA link

Cap­ping AGI profits

Luke FrymireMar 21, 2023, 1:29 PM
12 points
2 comments4 min readEA link

Go Mo­bi­lize? Les­sons from GM Protests for Paus­ing AI

Charlie HarrisonOct 24, 2023, 3:01 PM
48 points
11 comments31 min readEA link

What is ev­ery­one do­ing in AI governance

Igor IvanovJul 8, 2023, 3:19 PM
31 points
0 comments5 min readEA link

AI Risk and Sur­vivor­ship Bias—How An­dreessen and LeCun got it wrong

stepanlosJul 14, 2023, 5:10 PM
5 points
1 comment6 min readEA link

Scal­ing and Sus­tain­ing Stan­dards: A Case Study on the Basel Accords

C.K.Jul 16, 2023, 6:18 PM
18 points
0 comments7 min readEA link
(docs.google.com)

Aus­trali­ans call for AI safety to be taken seriously

Alexander SaeriJul 21, 2023, 1:16 AM
51 points
1 comment1 min readEA link

AI-Rele­vant Reg­u­la­tion: In­surance in Safety-Crit­i­cal Industries

SWKJul 22, 2023, 5:52 PM
5 points
0 comments6 min readEA link

Ap­ply to CEEALAR to do AGI mora­to­rium work

Greg_Colbourn ⏸️ Jul 26, 2023, 9:24 PM
62 points
0 comments1 min readEA link

Com­pli­ance Mon­i­tor­ing as an Im­pact­ful Mechanism of AI Safety Policy

CAISIDFeb 7, 2024, 4:10 PM
6 points
3 comments9 min readEA link

Join the AI gov­er­nance and in­ter­pretabil­ity hackathons!

Esben KranMar 23, 2023, 2:39 PM
33 points
1 comment5 min readEA link
(alignmentjam.com)

[Cross­post] An AI Pause Is Hu­man­ity’s Best Bet For Prevent­ing Ex­tinc­tion (TIME)

OttoJul 24, 2023, 10:18 AM
36 points
3 comments7 min readEA link
(time.com)

[Question] Should we na­tion­al­ize AI de­vel­op­ment?

Jadon SchmittJul 20, 2023, 5:31 AM
5 points
4 comments1 min readEA link

EU’s AI am­bi­tions at risk as US pushes to wa­ter down in­ter­na­tional treaty (linkpost)

micJul 31, 2023, 12:34 AM
9 points
0 comments1 min readEA link
(www.euractiv.com)

Towards ev­i­dence gap-maps for AI safety

dEAsignJul 25, 2023, 8:13 AM
6 points
1 comment2 min readEA link

Open ques­tions on a Chi­nese in­va­sion of Taiwan and its effects on the semi­con­duc­tor stock

YadavDec 7, 2023, 4:39 PM
21 points
0 comments2 min readEA link

What term to use for AI in differ­ent policy con­texts?

oegSep 6, 2023, 3:08 PM
18 points
3 comments9 min readEA link

Carl Shul­man on AI takeover mechanisms (& more): Part II of Dwarkesh Pa­tel in­ter­view for The Lu­nar Society

alejandroJul 25, 2023, 6:31 PM
28 points
0 comments5 min readEA link
(www.dwarkeshpatel.com)

How long will reach­ing a Risk Aware­ness Mo­ment and CHARTS agree­ment take?

YadavSep 6, 2023, 4:39 PM
12 points
0 comments14 min readEA link

What we can learn from stress test­ing for AI regulation

Nathan_BarnardJul 17, 2023, 7:56 PM
27 points
0 comments26 min readEA link

LawAI’s Sum­mer Re­search Fel­low­ship – ap­ply by Fe­bru­ary 16

LawAIFeb 7, 2024, 9:01 PM
51 points
2 comments2 min readEA link

As­ter­isk Magaz­ine Is­sue 03: AI

alejandroJul 24, 2023, 3:53 PM
34 points
3 comments1 min readEA link
(asteriskmag.com)

In­ter­na­tional AI In­sti­tu­tions: a liter­a­ture re­view of mod­els, ex­am­ples, and pro­pos­als

MMMaasSep 26, 2023, 3:26 PM
53 points
0 comments2 min readEA link

Thoughts on re­spon­si­ble scal­ing poli­cies and regulation

Paul_ChristianoOct 24, 2023, 10:25 PM
191 points
5 comments6 min readEA link

We are already in a per­sua­sion-trans­formed world and must take precautions

trevor1Nov 4, 2023, 3:53 PM
1 point
0 comments1 min readEA link

The 6D effect: When com­pa­nies take risks, one email can be very pow­er­ful.

stecasNov 4, 2023, 8:08 PM
40 points
1 comment1 min readEA link

(4 min read) An in­tu­itive ex­pla­na­tion of the AI in­fluence situation

trevor1Jan 13, 2024, 5:34 PM
1 point
1 comment1 min readEA link

Tran­script: NBC Nightly News: AI ‘race to reck­less­ness’ w/​ Tris­tan Har­ris, Aza Raskin

WilliamKielyMar 23, 2023, 3:45 AM
47 points
1 comment1 min readEA link

ChatGPT bug leaked users’ con­ver­sa­tion histories

Ian TurnerMar 27, 2023, 12:17 AM
15 points
2 comments1 min readEA link
(www.bbc.com)

Govern­ing High-Im­pact AI Sys­tems: Un­der­stand­ing Canada’s Pro­posed AI Bill. April 15, Car­leton Univer­sity, Ottawa

Liav.KorenMar 27, 2023, 11:11 PM
3 points
0 comments1 min readEA link
(www.eventbrite.com)

Paus­ing AI Devel­op­ments Isn’t Enough. We Need to Shut it All Down by Eliezer Yudkowsky

jacquesthibsMar 29, 2023, 11:30 PM
212 points
75 comments3 min readEA link
(time.com)

[Question] What are the ar­gu­ments that sup­port China build­ing AGI+ if Western com­pa­nies de­lay/​pause AI de­vel­op­ment?

DMMFMar 29, 2023, 6:53 PM
32 points
9 comments1 min readEA link

Want to win the AGI race? Solve al­ign­ment.

leopoldMar 29, 2023, 3:19 PM
56 points
6 comments5 min readEA link
(www.forourposterity.com)

Nu­clear brinks­man­ship is not a good AI x-risk strategy

titotalMar 30, 2023, 10:07 PM
19 points
8 comments5 min readEA link

The fun­da­men­tal hu­man value is power.

LinyphiaMar 30, 2023, 3:15 PM
−1 points
5 comments1 min readEA link

Gover­nance of AI, Break­fast Ce­real, Car Fac­to­ries, Etc.

Jeff MartinNov 6, 2023, 1:44 AM
2 points
0 comments3 min readEA link

Pes­simism about AI Safety

Max_He-HoApr 2, 2023, 7:57 AM
5 points
0 comments25 min readEA link
(www.lesswrong.com)

Re­duc­ing profit mo­ti­va­tions in AI development

Luke FrymireApr 3, 2023, 8:04 PM
20 points
1 comment6 min readEA link

If in­ter­pretabil­ity re­search goes well, it may get dangerous

So8resApr 3, 2023, 9:48 PM
33 points
0 comments1 min readEA link

What to sug­gest com­pa­nies & en­trepreneurs do to use AI safely?

AlfalfaBloomApr 5, 2023, 10:36 PM
11 points
1 comment1 min readEA link

[Question] How should tech­ni­cal AI re­searchers best tran­si­tion into AI gov­er­nance and policy?

GabeMSep 10, 2023, 5:29 AM
12 points
5 comments1 min readEA link

Paus­ing AI Devel­op­ments Isn’t Enough. We Need to Shut it All Down

EliezerYudkowskyApr 9, 2023, 3:53 PM
50 points
3 comments1 min readEA link

A New Model for Com­pute Cen­ter Verification

Damin Curtis🔹Oct 10, 2023, 7:23 PM
21 points
2 comments5 min readEA link

Re­spon­si­ble Scal­ing Poli­cies Are Risk Man­age­ment Done Wrong

simeon_cOct 25, 2023, 11:46 PM
42 points
1 comment1 min readEA link
(www.navigatingrisks.ai)

Scal­able And Trans­fer­able Black-Box Jailbreaks For Lan­guage Models Via Per­sona Modulation

soroushjpNov 7, 2023, 6:00 PM
10 points
0 comments2 min readEA link
(arxiv.org)

[linkpost] AI NOW In­sti­tute’s 2023 An­nual Re­port & Roadmap

Tristan WilliamsApr 12, 2023, 8:00 PM
9 points
0 comments2 min readEA link
(ainowinstitute.org)

[linkpost] “What Are Rea­son­able AI Fears?” by Robin Han­son, 2023-04-23

Arjun PanicksseryApr 14, 2023, 11:26 PM
41 points
3 comments4 min readEA link
(quillette.com)

Ge­offrey Miller on Cross-Cul­tural Un­der­stand­ing Between China and Western Coun­tries as a Ne­glected Con­sid­er­a­tion in AI Alignment

Evan_GaensbauerApr 17, 2023, 3:26 AM
25 points
2 comments4 min readEA link

Sum­mary: The Case for Halt­ing AI Devel­op­ment—Max Teg­mark on the Lex Frid­man Podcast

Madhav MalhotraApr 16, 2023, 10:28 PM
38 points
4 comments4 min readEA link
(youtu.be)

No, the EMH does not im­ply that mar­kets have long AGI timelines

JakobApr 24, 2023, 8:27 AM
83 points
21 comments8 min readEA link

Un-un­plug­ga­bil­ity—can’t we just un­plug it?

Oliver SourbutMay 15, 2023, 1:23 PM
15 points
0 comments1 min readEA link
(www.oliversourbut.net)

AI Im­pacts Quar­terly Newslet­ter, Jan-Mar 2023

HarlanApr 17, 2023, 11:07 PM
20 points
1 comment3 min readEA link
(blog.aiimpacts.org)

[Opz­ionale] Il panorama della gov­er­nance lun­goter­minista delle in­tel­li­genze artificiali

EA ItalyJan 17, 2023, 11:03 AM
1 point
0 comments10 min readEA link

OPEC for a slow AGI takeoff

vyraxApr 21, 2023, 10:53 AM
4 points
0 comments3 min readEA link

Deep­Mind and Google Brain are merg­ing [Linkpost]

AkashApr 20, 2023, 6:47 PM
32 points
1 comment1 min readEA link

Stu­dent com­pe­ti­tion for draft­ing a treaty on mora­to­rium of large-scale AI ca­pa­bil­ities R&D

NayanikaApr 24, 2023, 1:15 PM
36 points
4 comments2 min readEA link

Briefly how I’ve up­dated since ChatGPT

rimeApr 25, 2023, 7:39 PM
29 points
8 comments2 min readEA link
(www.lesswrong.com)

Refram­ing the bur­den of proof: Com­pa­nies should prove that mod­els are safe (rather than ex­pect­ing au­di­tors to prove that mod­els are dan­ger­ous)

AkashApr 25, 2023, 6:49 PM
35 points
1 comment1 min readEA link

Pro­pos­als for the AI Reg­u­la­tory Sand­box in Spain

Guillem BasApr 27, 2023, 10:33 AM
55 points
2 comments11 min readEA link
(riesgoscatastroficosglobales.com)

An ar­gu­ment for ac­cel­er­at­ing in­ter­na­tional AI gov­er­nance re­search (part 2)

MattThinksAug 22, 2023, 10:40 PM
3 points
0 comments10 min readEA link

In­tro­duc­ing the AI Ob­jec­tives In­sti­tute’s Re­search: Differ­en­tial Paths to­ward Safe and Benefi­cial AI

cmckMay 5, 2023, 8:26 PM
43 points
1 comment8 min readEA link

Im­pli­ca­tions of the White­house meet­ing with AI CEOs for AI su­per­in­tel­li­gence risk—a first-step to­wards evals?

Jamie BMay 7, 2023, 5:33 PM
78 points
3 comments7 min readEA link

Com­ment on Bar­nett (2025): Growth effects of AI could hit a bot­tle­neck even if lo­cal elas­tic­i­ties are high

Dan CareyMar 18, 2025, 11:52 AM
69 points
0 comments9 min readEA link

[Question] Ben Horow­itz and oth­ers are spread­ing a “reg­u­la­tion is bad” view. Would it be use­ful to have a pub­lic bet on “would Ben up­date his view if he had 1-1 with X-Risk re­searcher?”, and urge Ben to run such an ex­per­i­ment?

AntonOsikaAug 8, 2023, 6:36 AM
2 points
0 comments1 min readEA link

Open call: AI Act Stan­dard for Dev. Phase Risk Assess­ment

miller-maxDec 8, 2023, 7:57 PM
5 points
1 comment1 min readEA link

Tar­bell Fel­low­ship 2024 - Ap­pli­ca­tions Open (AI Jour­nal­ism)

Cillian_Sep 28, 2023, 10:38 AM
58 points
1 comment3 min readEA link

The In­ter­na­tional PauseAI Protest: Ac­tivism un­der uncertainty

Joseph MillerOct 12, 2023, 5:36 PM
129 points
3 comments4 min readEA link

Ap­pli­ca­tions for EU Tech Policy Fel­low­ship 2024 now open

Jan-WillemSep 13, 2023, 4:17 PM
22 points
2 comments1 min readEA link

[Cross­post] AI Reg­u­la­tion May Be More Im­por­tant Than AI Align­ment For Ex­is­ten­tial Safety

OttoAug 24, 2023, 4:01 PM
14 points
2 comments5 min readEA link

Effi­cacy of AI Ac­tivism: Have We Ever Said No?

Charlie HarrisonOct 27, 2023, 4:52 PM
78 points
25 comments20 min readEA link

Op­por­tu­ni­ties for Im­pact Beyond the EU AI Act

Cillian_Oct 12, 2023, 3:06 PM
27 points
2 comments4 min readEA link

Re­sources & op­por­tu­ni­ties for ca­reers in Euro­pean AI Policy

Cillian_Oct 12, 2023, 3:02 PM
13 points
1 comment2 min readEA link

Re­think Pri­ori­ties is look­ing for a (Co-)Founder for a New Pro­ject: Field Build­ing in Univer­si­ties for AI Policy Ca­reers in the US

KevinNAug 28, 2023, 4:01 PM
59 points
0 comments6 min readEA link
(careers.rethinkpriorities.org)

Re­boot­ing AI Gover­nance: An AI-Driven Ap­proach to AI Governance

UtilonMay 20, 2023, 7:06 PM
38 points
4 comments30 min readEA link

What AI could mean for al­ter­na­tive proteins

Max TaylorFeb 9, 2024, 10:13 AM
33 points
5 comments16 min readEA link

[Linkpost] “Gover­nance of su­per­in­tel­li­gence” by OpenAI

Daniel_EthMay 22, 2023, 8:15 PM
51 points
6 comments2 min readEA link
(openai.com)

Some gov­er­nance re­search ideas to pre­vent malev­olent con­trol over AGI and why this might mat­ter a hell of a lot

Jim BuhlerMay 23, 2023, 1:07 PM
63 points
5 comments16 min readEA link

AI Safety Newslet­ter #7: Dis­in­for­ma­tion, Gover­nance Recom­men­da­tions for AI labs, and Se­nate Hear­ings on AI

Center for AI SafetyMay 23, 2023, 9:42 PM
23 points
0 comments6 min readEA link
(newsletter.safe.ai)

Deep­Mind: Model eval­u­a­tion for ex­treme risks

Zach Stein-PerlmanMay 25, 2023, 3:00 AM
49 points
3 comments1 min readEA link

By failing to take se­ri­ous AI ac­tion, the US could be in vi­o­la­tion of its in­ter­na­tional law obligations

Cecil Abungu May 27, 2023, 4:25 AM
44 points
1 comment10 min readEA link

List of Masters Pro­grams in Tech Policy, Public Policy and Se­cu­rity (Europe)

sbergMay 29, 2023, 10:23 AM
47 points
0 comments3 min readEA link

A Tax­on­omy of Jobs Deeply Re­sis­tant to TAI Automation

Deric ChengMar 18, 2025, 4:26 PM
36 points
1 comment12 min readEA link
(www.convergenceanalysis.org)

An­nounc­ing Apollo Research

mariushobbhahnMay 30, 2023, 4:17 PM
158 points
5 comments1 min readEA link

Catas­trophic Risks from Un­safe AI: Nav­i­gat­ing a Tightrope Sce­nario (Ben Garfinkel, EAG Lon­don 2023)

Alexander SaeriJun 2, 2023, 9:59 AM
19 points
1 comment10 min readEA link

A sur­vey of con­crete risks de­rived from Ar­tifi­cial Intelligence

Guillem BasJun 8, 2023, 10:09 PM
36 points
2 comments6 min readEA link
(riesgoscatastroficosglobales.com)

The Risks of AI-Gen­er­ated Con­tent on the EA Forum

WobblyPanda2Jun 4, 2023, 5:33 AM
−1 points
0 comments1 min readEA link

From vol­un­tary to manda­tory, are the ESG dis­clo­sure frame­works still fer­tile ground for un­re­al­ised EA ca­reer path­ways? – A 2023 up­date on ESG po­ten­tial impact

Christopher ChanJun 4, 2023, 12:00 PM
21 points
5 comments11 min readEA link
No comments.