RSS

AI governance

TagLast edit: 22 Jul 2022 19:52 UTC by Pablo

AI governance (or the governance of artificial intelligence) is the study of norms, policies, and institutions that can help humanity navigate the transition to a world with advanced artificial intelligence. This includes a broad range of subjects, from global coordination around regulating AI development to providing incentives for corporations to be more cautious in their AI research.

AI governance as a career

Long-term AI policy strategy research and implementation is one of 80,000 Hours’ “priority paths”—the most promising career opportunities the organization has identified so far.[1][2]

Further reading

Brundage, Miles (2017) Guide to working in AI policy and strategy, 80,000 Hours, June 7.

Cussins, Jessica (2020) Summaries of AI policy resources, Future of Life Institute.

Dafoe, Allan (2020) AI governance: opportunity and theory of impact, Effective Altruism Forum, September 17.

Muehlhauser, Luke (2021) A personal take on longtermist AI governance, Effective Altruism Forum, July 21.

Related entries

AI alignment | AI forecasting | alignment tax | antitrust law | compute governance | economics of artificial intelligence | ethics of artificial intelligence | global governance | standards and regulation

  1. ^

    Todd, Benjamin (2018) The highest impact career paths our research has identified so far, 80,000 Hours, August 12.

  2. ^

    Todd, Benjamin (2021) Long-term AI policy strategy research and implementation, 80,000 Hours, October.

AI Gover­nance: Op­por­tu­nity and The­ory of Impact

Allan Dafoe17 Sep 2020 6:30 UTC
248 points
16 comments12 min readEA link

Some AI Gover­nance Re­search Ideas

MarkusAnderljung3 Jun 2021 10:51 UTC
92 points
5 comments2 min readEA link

A per­sonal take on longter­mist AI governance

lukeprog16 Jul 2021 22:08 UTC
172 points
5 comments7 min readEA link

A Map to Nav­i­gate AI Governance

hanadulset14 Feb 2022 22:41 UTC
66 points
11 comments24 min readEA link

Katja Grace: Let’s think about slow­ing down AI

peterhartree23 Dec 2022 0:57 UTC
81 points
7 comments2 min readEA link
(worldspiritsockpuppet.substack.com)

Sin­ga­pore AI Policy Ca­reer Guide

Yi-Yang21 Jan 2021 3:05 UTC
28 points
0 comments5 min readEA link

Com­po­nents of Strate­gic Clar­ity [Strate­gic Per­spec­tives on Long-term AI Gover­nance, #2]

MMMaas2 Jul 2022 11:22 UTC
63 points
0 comments5 min readEA link

The longter­mist AI gov­er­nance land­scape: a ba­sic overview

Sam Clarke18 Jan 2022 12:58 UTC
144 points
11 comments9 min readEA link

AI Gover­nance Ca­reer Paths for Europeans

careersthrowaway16 May 2020 6:40 UTC
80 points
1 comment12 min readEA link

FLI open let­ter: Pause gi­ant AI experiments

Zach Stein-Perlman29 Mar 2023 4:04 UTC
215 points
38 comments1 min readEA link

Slow­ing down AI progress is an un­der­ex­plored al­ign­ment strategy

Michael Huang13 Jul 2022 3:22 UTC
89 points
11 comments3 min readEA link
(www.lesswrong.com)

Case stud­ies of self-gov­er­nance to re­duce tech­nol­ogy risk

jia6 Apr 2021 8:49 UTC
50 points
6 comments7 min readEA link

AI Gover­nance Course—Cur­ricu­lum and Application

Mauricio29 Nov 2021 13:29 UTC
94 points
11 comments7 min readEA link

Strate­gic Per­spec­tives on Trans­for­ma­tive AI Gover­nance: Introduction

MMMaas2 Jul 2022 11:20 UTC
107 points
18 comments4 min readEA link

12 ten­ta­tive ideas for US AI policy (Luke Muehlhauser)

Lizka19 Apr 2023 21:05 UTC
114 points
12 comments4 min readEA link
(www.openphilanthropy.org)

GovAI: Towards best prac­tices in AGI safety and gov­er­nance: A sur­vey of ex­pert opinion

Zach Stein-Perlman15 May 2023 1:42 UTC
53 points
3 comments1 min readEA link

The Gover­nance Prob­lem and the “Pretty Good” X-Risk

Zach Stein-Perlman28 Aug 2021 20:00 UTC
23 points
4 comments11 min readEA link

Jade Le­ung: Why com­pa­nies should be lead­ing on AI governance

EA Global15 May 2019 23:37 UTC
29 points
7 comments18 min readEA link
(www.youtube.com)

“Aligned with who?” Re­sults of sur­vey­ing 1,000 US par­ti­ci­pants on AI values

Holly Morgan21 Mar 2023 22:07 UTC
40 points
0 comments2 min readEA link
(www.lesswrong.com)

[Question] Ex­am­ples of self-gov­er­nance to re­duce tech­nol­ogy risk?

jia25 Sep 2020 13:26 UTC
32 points
1 comment1 min readEA link

AGI safety ca­reer advice

richard_ngo2 May 2023 7:36 UTC
202 points
17 comments1 min readEA link

Open Philan­thropy’s AI gov­er­nance grant­mak­ing (so far)

Aaron Gertler17 Dec 2020 12:00 UTC
63 points
0 comments6 min readEA link
(www.openphilanthropy.org)

A new pro­posal for reg­u­lat­ing AI in the EU

EdoArad26 Apr 2021 17:25 UTC
37 points
3 comments1 min readEA link
(www.bbc.com)

FLI re­port: Poli­cy­mak­ing in the Pause

Zach Stein-Perlman15 Apr 2023 17:01 UTC
28 points
4 comments1 min readEA link

Cur­rent UK gov­ern­ment lev­ers on AI development

rosehadshar10 Apr 2023 13:16 UTC
67 points
3 comments4 min readEA link

CSER Ad­vice to EU High-Level Ex­pert Group on AI

HaydnBelfield8 Mar 2019 20:42 UTC
14 points
0 comments5 min readEA link
(www.cser.ac.uk)

Data Tax­a­tion: A Pro­posal for Slow­ing Down AGI Progress

Per Ivar Friborg11 Apr 2023 17:27 UTC
42 points
6 comments12 min readEA link

Re­quest to AGI or­ga­ni­za­tions: Share your views on paus­ing AI progress

Akash11 Apr 2023 17:30 UTC
84 points
1 comment1 min readEA link

“Pivotal Act” In­ten­tions: Nega­tive Con­se­quences and Fal­la­cious Arguments

Andrew Critch19 Apr 2022 20:24 UTC
80 points
10 comments7 min readEA link

AI policy ideas: Read­ing list

Zach Stein-Perlman17 Apr 2023 19:00 UTC
56 points
3 comments1 min readEA link

Markus An­der­ljung and Ben Garfinkel: Fireside chat on AI governance

EA Global24 Jul 2020 14:56 UTC
25 points
0 comments15 min readEA link
(www.youtube.com)

4 ways to think about de­moc­ra­tiz­ing AI [GovAI Linkpost]

Akash13 Feb 2023 18:06 UTC
34 points
0 comments1 min readEA link

A Viral Li­cense for AI Safety

IvanVendrov5 Jun 2021 2:00 UTC
29 points
6 comments5 min readEA link

Some Things I Heard about AI Gover­nance at EAG

utilistrutil28 Feb 2023 21:27 UTC
34 points
5 comments6 min readEA link

Slightly against al­ign­ing with neo-luddites

Matthew_Barnett26 Dec 2022 23:27 UTC
70 points
17 comments4 min readEA link

[Link post] Co­or­di­na­tion challenges for pre­vent­ing AI conflict

stefan.torges9 Mar 2021 9:39 UTC
52 points
0 comments1 min readEA link
(longtermrisk.org)

Large Lan­guage Models as Fi­du­cia­ries to Humans

johnjnay24 Jan 2023 19:53 UTC
25 points
0 comments34 min readEA link
(papers.ssrn.com)

AI Benefits Post 4: Out­stand­ing Ques­tions on Select­ing Benefits

Cullen14 Jul 2020 17:24 UTC
6 points
0 comments5 min readEA link

Align­ing the Align­ers: En­sur­ing Aligned AI acts for the com­mon good of all mankind

timunderwood16 Jan 2023 11:13 UTC
33 points
2 comments4 min readEA link

(Even) More Early-Ca­reer EAs Should Try AI Safety Tech­ni­cal Research

levin30 Jun 2022 21:14 UTC
86 points
38 comments11 min readEA link

[US] NTIA: AI Ac­countabil­ity Policy Re­quest for Comment

Kyle J. Lucchese13 Apr 2023 16:12 UTC
47 points
4 comments1 min readEA link
(ntia.gov)

“Risk Aware­ness Mo­ments” (Rams): A con­cept for think­ing about AI gov­er­nance interventions

oeg14 Apr 2023 17:40 UTC
52 points
0 comments9 min readEA link

Prospects for AI safety agree­ments be­tween countries

oeg14 Apr 2023 17:41 UTC
101 points
3 comments22 min readEA link

AI Risk Man­age­ment Frame­work | NIST

𝕮𝖎𝖓𝖊𝖗𝖆26 Jan 2023 15:27 UTC
50 points
0 comments1 min readEA link

FHI Re­port: The Wind­fall Clause: Distribut­ing the Benefits of AI for the Com­mon Good

Cullen5 Feb 2020 23:49 UTC
54 points
21 comments2 min readEA link

We are fight­ing a shared bat­tle (a call for a differ­ent ap­proach to AI Strat­egy)

Gideon Futerman16 Mar 2023 14:37 UTC
56 points
11 comments15 min readEA link

AGI mis­al­ign­ment x-risk may be lower due to an over­looked goal speci­fi­ca­tion technology

johnjnay21 Oct 2022 2:03 UTC
20 points
1 comment1 min readEA link

Sur­vey on in­ter­me­di­ate goals in AI governance

MichaelA17 Mar 2023 12:44 UTC
147 points
3 comments1 min readEA link

Merger of Deep­Mind and Google Brain

Greg_Colbourn20 Apr 2023 20:16 UTC
11 points
12 comments1 min readEA link
(blog.google)

The Cen­tre for the Gover­nance of AI is be­com­ing a nonprofit

MarkusAnderljung9 Jul 2021 10:05 UTC
78 points
7 comments1 min readEA link

AGI ris­ing: why we are in a new era of acute risk and in­creas­ing pub­lic aware­ness, and what to do now

Greg_Colbourn2 May 2023 10:17 UTC
61 points
33 comments13 min readEA link

New Se­quence—Towards a wor­ld­wide, wa­ter­tight Wind­fall Clause

John Bridge7 Apr 2022 15:02 UTC
25 points
4 comments8 min readEA link

AI policy & gov­er­nance in Aus­tralia: notes from an ini­tial discussion

AlexanderSaeri15 May 2023 0:00 UTC
28 points
1 comment3 min readEA link

An­titrust-Com­pli­ant AI In­dus­try Self-Regulation

Cullen7 Jul 2020 20:52 UTC
26 points
1 comment1 min readEA link
(cullenokeefe.com)

Eisen­hower’s Atoms for Peace Speech

Akash17 May 2023 16:10 UTC
17 points
1 comment1 min readEA link

[link] Cen­tre for the Gover­nance of AI 2020 An­nual Report

MarkusAnderljung14 Jan 2021 10:23 UTC
11 points
5 comments1 min readEA link

What would a com­pute mon­i­tor­ing plan look like? [Linkpost]

Akash26 Mar 2023 19:33 UTC
60 points
1 comment1 min readEA link

Should you work in the Euro­pean Union to do AGI gov­er­nance?

hanadulset31 Jan 2022 10:34 UTC
89 points
20 comments15 min readEA link

What suc­cess looks like

mariushobbhahn28 Jun 2022 14:30 UTC
107 points
20 comments19 min readEA link

Is Democ­racy a Fad?

bgarfinkel13 Mar 2021 12:40 UTC
147 points
36 comments7 min readEA link

New US Se­nate Bill on X-Risk Miti­ga­tion [Linkpost]

Evan R. Murphy4 Jul 2022 1:28 UTC
22 points
12 comments1 min readEA link
(www.hsgac.senate.gov)

Are you re­ally in a race? The Cau­tion­ary Tales of Szilárd and Ellsberg

HaydnBelfield19 May 2022 8:42 UTC
444 points
43 comments18 min readEA link

EU AI Act now has a sec­tion on gen­eral pur­pose AI systems

MathiasKB9 Dec 2021 12:40 UTC
64 points
10 comments1 min readEA link

[Question] Pre­dic­tions for fu­ture AI gov­er­nance?

jackchang1102 Apr 2023 16:43 UTC
4 points
1 comment1 min readEA link

FHI Re­port: Stable Agree­ments in Tur­bu­lent Times

Cullen21 Feb 2019 17:12 UTC
25 points
2 comments4 min readEA link
(www.fhi.ox.ac.uk)

Le­gal Pri­ori­ties Re­search: A Re­search Agenda

jonasschuett6 Jan 2021 21:47 UTC
58 points
4 comments1 min readEA link

A Wind­fall Clause for CEO could worsen AI race dynamics

Larks9 Mar 2023 18:02 UTC
69 points
11 comments7 min readEA link

[Question] Track­ing Com­pute Stocks and Flows: Case Stud­ies?

Cullen5 Oct 2022 17:54 UTC
34 points
1 comment1 min readEA link

Jade Le­ung and Seth Baum: The role of ex­ist­ing in­sti­tu­tions in AI strategy

EA Global8 Jun 2018 7:15 UTC
9 points
0 comments29 min readEA link
(www.youtube.com)

Dona­tion offsets for ChatGPT Plus subscriptions

Jeffrey Ladish16 Mar 2023 23:11 UTC
75 points
11 comments3 min readEA link

In­sights from an ex­pert sur­vey about in­ter­me­di­ate goals in AI governance

Sebastian Schwiecker17 Mar 2023 14:59 UTC
11 points
2 comments1 min readEA link

UK policy and poli­tics careers

weeatquince28 Sep 2019 16:18 UTC
28 points
10 comments7 min readEA link

What is the EU AI Act and why should you care about it?

MathiasKB10 Sep 2021 7:47 UTC
116 points
9 comments7 min readEA link

Longter­mist rea­sons to work for in­no­va­tive governments

ac13 Oct 2020 16:32 UTC
74 points
8 comments1 min readEA link

Sym­bio­sis, not al­ign­ment, as the goal for liberal democ­ra­cies in the tran­si­tion to ar­tifi­cial gen­eral intelligence

simonfriederich17 Mar 2023 13:04 UTC
18 points
2 comments24 min readEA link
(rdcu.be)

Jeffrey Ding: Bring­ing techno-global­ism back: a ro­man­ti­cally re­al­ist re­fram­ing of the US-China tech relationship

EA Global21 Nov 2020 8:12 UTC
9 points
0 comments1 min readEA link
(www.youtube.com)

AI policy ca­reers in the EU

Lauro Langosco11 Nov 2019 10:43 UTC
59 points
7 comments11 min readEA link

Allan Dafoe: Prepar­ing for AI — risks and opportunities

EA Global3 Nov 2017 7:43 UTC
7 points
0 comments1 min readEA link
(www.youtube.com)

Spicy takes about AI policy (Clark, 2022)

Will Aldred9 Aug 2022 13:49 UTC
43 points
0 comments3 min readEA link
(twitter.com)

[Question] Books and lec­ture se­ries rele­vant to AI gov­er­nance?

MichaelA18 Jul 2021 15:54 UTC
22 points
9 comments1 min readEA link

Some thoughts on risks from nar­row, non-agen­tic AI

richard_ngo19 Jan 2021 0:07 UTC
36 points
2 comments8 min readEA link

Hooray for step­ping out of the limelight

So8res1 Apr 2023 2:45 UTC
103 points
0 comments1 min readEA link

Pile of Law and Law-Fol­low­ing AI

Cullen13 Jul 2022 0:29 UTC
28 points
2 comments3 min readEA link

An ‘AGI Emer­gency Eject Cri­te­ria’ con­sen­sus could be re­ally use­ful.

tcelferact7 Apr 2023 16:21 UTC
27 points
3 comments1 min readEA link

FLI launches Wor­ld­build­ing Con­test with $100,000 in prizes

ggilgallon17 Jan 2022 13:54 UTC
87 points
55 comments6 min readEA link

Deep­Mind is hiring Long-term Strat­egy & Gover­nance researchers

vishal13 Sep 2021 18:44 UTC
54 points
1 comment1 min readEA link

Ross Gruet­zemacher: Defin­ing and un­pack­ing trans­for­ma­tive AI

EA Global18 Oct 2019 8:22 UTC
9 points
0 comments1 min readEA link
(www.youtube.com)

New sur­vey: 46% of Amer­i­cans are con­cerned about ex­tinc­tion from AI; 69% sup­port a six-month pause in AI development

Akash5 Apr 2023 1:26 UTC
138 points
34 comments1 min readEA link

Fore­sight for AGI Safety Strategy

jacquesthibs5 Dec 2022 16:09 UTC
6 points
1 comment1 min readEA link

Is it time for a pause?

Kelsey Piper6 Apr 2023 11:48 UTC
96 points
6 comments5 min readEA link

Col­lec­tion of work on ‘Should you should fo­cus on the EU if you’re in­ter­ested in AI gov­er­nance for longter­mist/​x-risk rea­sons?’

MichaelA6 Aug 2022 16:49 UTC
40 points
1 comment1 min readEA link

Nav­i­gat­ing the Open-Source AI Land­scape: Data, Fund­ing, and Safety

AndreFerretti12 Apr 2023 10:30 UTC
21 points
3 comments11 min readEA link

Nav­i­gat­ing AI Risks (NAIR) #1: Slow­ing Down AI

simeon_c14 Apr 2023 14:35 UTC
12 points
1 comment1 min readEA link

Baobao Zhang: How so­cial sci­ence re­search can in­form AI governance

EA Global22 Jan 2021 15:10 UTC
9 points
0 comments16 min readEA link
(www.youtube.com)

Im­por­tant, ac­tion­able re­search ques­tions for the most im­por­tant century

Holden Karnofsky24 Feb 2022 16:34 UTC
288 points
15 comments19 min readEA link

How to make the best of the most im­por­tant cen­tury?

Holden Karnofsky14 Sep 2021 21:05 UTC
49 points
5 comments12 min readEA link

GovAI We­bi­nars on the Gover­nance and Eco­nomics of AI

MarkusAnderljung12 May 2020 15:00 UTC
16 points
0 comments1 min readEA link

[Question] What type of Master’s is best for AI policy work?

Milan_Griffes22 Feb 2019 20:04 UTC
14 points
7 comments1 min readEA link

In­stead of tech­ni­cal re­search, more peo­ple should fo­cus on buy­ing time

Akash5 Nov 2022 20:43 UTC
107 points
32 comments1 min readEA link

Effec­tive En­force­abil­ity of EU Com­pe­ti­tion Law Un­der Differ­ent AI Devel­op­ment Sce­nar­ios: A Frame­work for Le­gal Analysis

HaydnBelfield19 Aug 2022 17:20 UTC
11 points
0 comments6 min readEA link
(verfassungsblog.de)

Shal­low eval­u­a­tions of longter­mist organizations

NunoSempere24 Jun 2021 15:31 UTC
191 points
34 comments34 min readEA link

AMA: Fu­ture of Life In­sti­tute’s EU Team

Risto Uuk31 Jan 2022 17:14 UTC
44 points
15 comments2 min readEA link

Brian Tse: Sino-Western co­op­er­a­tion in AI safety

EA Global30 Jan 2020 22:02 UTC
11 points
0 comments14 min readEA link
(www.youtube.com)

No­body’s on the ball on AGI alignment

leopold29 Mar 2023 14:26 UTC
309 points
62 comments9 min readEA link
(www.forourposterity.com)

How evals might (or might not) pre­vent catas­trophic risks from AI

Akash7 Feb 2023 20:16 UTC
28 points
0 comments1 min readEA link

AI Safety Newslet­ter #3: AI policy pro­pos­als and a new challenger approaches

Oliver Z25 Apr 2023 16:15 UTC
34 points
1 comment4 min readEA link
(newsletter.safe.ai)

Law-Fol­low­ing AI 4: Don’t Rely on Vi­car­i­ous Liability

Cullen2 Aug 2022 23:23 UTC
13 points
0 comments3 min readEA link

Some cruxes on im­pact­ful al­ter­na­tives to AI policy work

richard_ngo22 Nov 2018 13:43 UTC
28 points
2 comments12 min readEA link

P(doom|AGI) is high: why the de­fault out­come of AGI is doom

Greg_Colbourn2 May 2023 10:40 UTC
12 points
27 comments3 min readEA link

How CISA can Sup­port the Se­cu­rity of Large AI Models Against Theft [Grad School As­sign­ment]

Harrison Durland3 May 2023 15:36 UTC
6 points
0 comments13 min readEA link

[Link Post: New York Times] White House Un­veils Ini­ti­a­tives to Re­duce Risks of A.I.

Rockwell4 May 2023 14:04 UTC
49 points
1 comment2 min readEA link

[Question] How to Im­prove China-Western Co­or­di­na­tion on EA Is­sues?

Michael Kehoe3 Nov 2021 7:28 UTC
15 points
2 comments1 min readEA link

CSER and FHI ad­vice to UN High-level Panel on Digi­tal Co­op­er­a­tion

HaydnBelfield8 Mar 2019 20:39 UTC
22 points
7 comments6 min readEA link
(www.cser.ac.uk)

AI Safety Newslet­ter #5: Ge­offrey Hin­ton speaks out on AI risk, the White House meets with AI labs, and Tro­jan at­tacks on lan­guage models

Center for AI Safety9 May 2023 15:26 UTC
59 points
0 comments4 min readEA link
(newsletter.safe.ai)

Un­veiling the Amer­i­can Public Opinion on AI Mo­ra­to­rium and Govern­ment In­ter­ven­tion: The Im­pact of Me­dia Exposure

Otto8 May 2023 10:49 UTC
27 points
5 comments6 min readEA link

AI Risk & Policy Fore­casts from Me­tac­u­lus & FLI’s AI Path­ways Workshop

Will Aldred16 May 2023 8:53 UTC
40 points
0 comments8 min readEA link

Co­or­di­na­tion by com­mon knowl­edge to pre­vent un­con­trol­lable AI

Karl von Wendt14 May 2023 13:37 UTC
13 points
0 comments1 min readEA link

AI Gover­nance Read­ing Group Guide

Alex HT25 Jun 2020 10:16 UTC
25 points
2 comments3 min readEA link

[Question] AI strat­egy ca­reer pipeline

Zach Stein-Perlman22 May 2023 0:00 UTC
67 points
20 comments1 min readEA link

Con­crete ac­tion­able poli­cies rele­vant to AI safety (writ­ten 2019)

weeatquince16 Dec 2022 18:41 UTC
48 points
0 comments22 min readEA link

Law-Fol­low­ing AI 2: In­tent Align­ment + Su­per­in­tel­li­gence → Lawless AI (By De­fault)

Cullen27 Apr 2022 17:18 UTC
19 points
0 comments6 min readEA link

Yud­kowsky and Chris­ti­ano dis­cuss “Take­off Speeds”

EliezerYudkowsky22 Nov 2021 19:42 UTC
42 points
0 comments60 min readEA link

[Linkpost] OpenAI is award­ing ten 100k grants for build­ing pro­to­types of a demo­cratic pro­cess for steer­ing AI

pseudonym26 May 2023 12:49 UTC
33 points
2 comments1 min readEA link
(openai.com)

Jaan Tal­linn: Fireside chat (2020)

EA Global21 Nov 2020 8:12 UTC
7 points
0 comments1 min readEA link
(www.youtube.com)

AMA: The new Open Philan­thropy Tech­nol­ogy Policy Fellowship

lukeprog26 Jul 2021 15:11 UTC
38 points
14 comments1 min readEA link

The Case for AI Adap­ta­tion: The Per­ils of Liv­ing in a World with Aligned and Well-De­ployed Trans­for­ma­tive Ar­tifi­cial Intelligence

HTC30 May 2023 18:29 UTC
3 points
1 comment7 min readEA link

I’m Cul­len O’Keefe, a Policy Re­searcher at OpenAI, AMA

Cullen11 Jan 2020 4:13 UTC
45 points
68 comments1 min readEA link

The EU AI Act needs a defi­ni­tion of high-risk foun­da­tion mod­els to avoid reg­u­la­tory over­reach and backlash

matthias_samwald31 May 2023 15:34 UTC
16 points
0 comments4 min readEA link

Dis­cus­sion with Eliezer Yud­kowsky on AGI interventions

RobBensinger11 Nov 2021 3:21 UTC
60 points
35 comments35 min readEA link

The Ri­val AI De­ploy­ment Prob­lem: a Pre-de­ploy­ment Agree­ment as the least-bad response

HaydnBelfield23 Sep 2022 9:28 UTC
38 points
1 comment13 min readEA link

[Job ad] Re­search im­por­tant longter­mist top­ics at Re­think Pri­ori­ties!

Linch6 Oct 2021 19:09 UTC
65 points
46 comments1 min readEA link

GovAI An­nual Re­port 2021

GovAI5 Jan 2022 16:57 UTC
52 points
2 comments10 min readEA link

How tech­ni­cal safety stan­dards could pro­mote TAI safety

Cullen8 Aug 2022 16:57 UTC
127 points
15 comments7 min readEA link

Po­ten­tial Risks from Ad­vanced AI

EA Global13 Aug 2017 7:00 UTC
9 points
0 comments18 min readEA link

Three Im­pacts of Ma­chine Intelligence

Paul_Christiano23 Aug 2013 10:10 UTC
33 points
5 comments9 min readEA link
(rationalaltruist.com)

Mauhn Re­leases AI Safety Documentation

Berg Severens2 Jul 2021 12:19 UTC
4 points
2 comments1 min readEA link

FHI Re­port: How Will Na­tional Se­cu­rity Con­sid­er­a­tions Affect An­titrust De­ci­sions in AI? An Ex­am­i­na­tion of His­tor­i­cal Precedents

Cullen28 Jul 2020 18:33 UTC
13 points
0 comments1 min readEA link
(www.fhi.ox.ac.uk)

TAI Safety Biblio­graphic Database

Jess_Riedel22 Dec 2020 16:03 UTC
61 points
9 comments17 min readEA link

[Question] What kind of or­ga­ni­za­tion should be the first to de­velop AGI in a po­ten­tial arms race?

BrownHairedEevee17 Jul 2022 17:41 UTC
10 points
2 comments1 min readEA link

Ar­gu­ment Against Im­pact: EU Is Not an AI Su­per­power

EU AI Governance31 Jan 2022 9:48 UTC
35 points
9 comments3 min readEA link

EU’s im­por­tance for AI gov­er­nance is con­di­tional on AI tra­jec­to­ries—a case study

MathiasKB13 Jan 2022 14:58 UTC
31 points
4 comments3 min readEA link

Com­pute & An­titrust: Reg­u­la­tory im­pli­ca­tions of the AI hard­ware sup­ply chain, from chip de­sign to cloud APIs

HaydnBelfield19 Aug 2022 17:20 UTC
32 points
0 comments6 min readEA link
(verfassungsblog.de)

An overview of ar­gu­ments for con­cern about automation

alexlintz6 Aug 2019 7:56 UTC
34 points
3 comments13 min readEA link

Daniel Dewey: The Open Philan­thropy Pro­ject’s work on po­ten­tial risks from ad­vanced AI

EA Global11 Aug 2017 8:19 UTC
7 points
0 comments18 min readEA link
(www.youtube.com)

Con­crete ac­tions to im­prove AI gov­er­nance: the be­havi­our sci­ence approach

AlexanderSaeri1 Dec 2022 21:34 UTC
31 points
0 comments11 min readEA link

Fi­nal Re­port of the Na­tional Se­cu­rity Com­mis­sion on Ar­tifi­cial In­tel­li­gence (NSCAI, 2021)

MichaelA1 Jun 2021 8:19 UTC
51 points
3 comments4 min readEA link
(www.nscai.gov)

AI & Policy 1/​3: On know­ing the effect of to­day’s poli­cies on Trans­for­ma­tive AI risks, and the case for in­sti­tu­tional im­prove­ments.

weeatquince27 Aug 2019 11:04 UTC
27 points
3 comments10 min readEA link

UK AI Policy Re­port: Con­tent, Sum­mary, and its Im­pact on EA Cause Areas

Algo_Law21 Jul 2022 17:32 UTC
9 points
1 comment9 min readEA link

The AI rev­olu­tion and in­ter­na­tional poli­tics (Allan Dafoe)

EA Global2 Jun 2017 8:48 UTC
8 points
0 comments19 min readEA link
(www.youtube.com)

What does (and doesn’t) AI mean for effec­tive al­tru­ism?

EA Global12 Aug 2017 7:00 UTC
9 points
0 comments12 min readEA link

Here are the fi­nal­ists from FLI’s $100K Wor­ld­build­ing Contest

Jackson Wagner6 Jun 2022 18:42 UTC
42 points
5 comments2 min readEA link

Ngo and Yud­kowsky on AI ca­pa­bil­ity gains

richard_ngo19 Nov 2021 1:54 UTC
23 points
4 comments39 min readEA link

[Link] EAF Re­search agenda: “Co­op­er­a­tion, Con­flict, and Trans­for­ma­tive Ar­tifi­cial In­tel­li­gence”

stefan.torges17 Jan 2020 13:28 UTC
64 points
0 comments1 min readEA link

Good policy ideas that won’t hap­pen (yet)

Niel_Bowerman11 Sep 2014 12:29 UTC
28 points
8 comments14 min readEA link

Chris­ti­ano, Co­tra, and Yud­kowsky on AI progress

Ajeya25 Nov 2021 16:30 UTC
18 points
6 comments69 min readEA link

Law-Fol­low­ing AI 3: Lawless AI Agents Un­der­mine Sta­bi­liz­ing Agreements

Cullen27 Apr 2022 17:20 UTC
28 points
3 comments3 min readEA link

An­nounc­ing the EU Tech Policy Fellowship

Jan-Willem30 Mar 2022 8:15 UTC
53 points
4 comments5 min readEA link

Three pillars for avoid­ing AGI catas­tro­phe: Tech­ni­cal al­ign­ment, de­ploy­ment de­ci­sions, and co­or­di­na­tion

alexlintz3 Aug 2022 21:24 UTC
90 points
4 comments11 min readEA link

[Fic­tion] Im­proved Gover­nance on the Crit­i­cal Path to AI Align­ment by 2045.

Jackson Wagner18 May 2022 15:50 UTC
20 points
1 comment12 min readEA link

An in­ter­ven­tion to shape policy di­alogue, com­mu­ni­ca­tion, and AI re­search norms for AI safety

Lee_Sharkey1 Oct 2017 18:29 UTC
9 points
28 comments10 min readEA link

Jeffrey Ding: Re-de­ci­pher­ing China’s AI dream

EA Global18 Oct 2019 18:05 UTC
13 points
0 comments1 min readEA link
(www.youtube.com)

AMA: Markus An­der­ljung (PM at GovAI, FHI)

MarkusAnderljung21 Sep 2020 11:23 UTC
49 points
24 comments2 min readEA link

Some AI re­search ar­eas and their rele­vance to ex­is­ten­tial safety

Andrew Critch15 Dec 2020 12:15 UTC
12 points
1 comment56 min readEA link
(alignmentforum.org)

Truth­ful AI

Owen Cotton-Barratt20 Oct 2021 15:11 UTC
55 points
14 comments10 min readEA link

List #1: Why stop­ping the de­vel­op­ment of AGI is hard but doable

Remmelt24 Dec 2022 9:52 UTC
24 points
2 comments1 min readEA link

UK’s new 10-year “Na­tional AI Strat­egy,” re­leased today

jared_m22 Sep 2021 11:18 UTC
28 points
7 comments1 min readEA link

Sup­ple­ment to “The Brus­sels Effect and AI: How EU AI reg­u­la­tion will im­pact the global AI mar­ket”

MarkusAnderljung16 Aug 2022 20:55 UTC
107 points
7 comments8 min readEA link

Assess­ing the state of AI R&D in the US, China, and Europe – Part 1: Out­put indicators

stefan.torges1 Nov 2019 14:41 UTC
21 points
0 comments14 min readEA link

Ideal gov­er­nance (for com­pa­nies, coun­tries and more)

Holden Karnofsky7 Apr 2022 16:54 UTC
80 points
19 comments14 min readEA link

The Im­por­tance of Ar­tifi­cial Sentience

Jamie_Harris3 Mar 2021 17:17 UTC
64 points
10 comments12 min readEA link
(www.sentienceinstitute.org)

[Link] Cen­ter for the Gover­nance of AI (GovAI) An­nual Re­port 2018

MarkusAnderljung21 Dec 2018 16:17 UTC
24 points
0 comments1 min readEA link

Why don’t gov­ern­ments seem to mind that com­pa­nies are ex­plic­itly try­ing to make AGIs?

Ozzie Gooen23 Dec 2021 7:08 UTC
82 points
52 comments2 min readEA link

NIST AI Risk Man­age­ment Frame­work re­quest for in­for­ma­tion (RFI)

Aryeh Englander31 Aug 2021 22:24 UTC
7 points
0 comments2 min readEA link

[Question] What are the challenges and prob­lems with pro­gram­ming law-break­ing con­straints into AGI?

MichaelStJules2 Feb 2020 20:53 UTC
12 points
34 comments1 min readEA link

[Question] Will AGI cause mass tech­nolog­i­cal un­em­ploy­ment?

BrownHairedEevee22 Jun 2020 20:55 UTC
3 points
2 comments2 min readEA link

In­for­ma­tion se­cu­rity ca­reers for GCR reduction

ClaireZabel20 Jun 2019 23:56 UTC
186 points
34 comments8 min readEA link

Two con­trast­ing mod­els of “in­tel­li­gence” and fu­ture growth

Magnus Vinding24 Nov 2022 11:54 UTC
63 points
29 comments29 min readEA link

AI gov­er­nance stu­dent hackathon on Satur­day, April 23: reg­ister now!

mic12 Apr 2022 4:39 UTC
18 points
0 comments1 min readEA link

[Question] What would you do if you had a lot of money/​power/​in­fluence and you thought that AI timelines were very short?

Greg_Colbourn12 Nov 2021 21:59 UTC
29 points
11 comments1 min readEA link

Un­jour­nal: Eval­u­a­tions of “Ar­tifi­cial In­tel­li­gence and Eco­nomic Growth”, and new host­ing space

david_reinstein17 Mar 2023 20:20 UTC
46 points
0 comments2 min readEA link
(unjournal.pubpub.org)

Hu­man­i­ties Re­search Ideas for Longtermists

Lizka9 Jun 2021 4:39 UTC
146 points
13 comments13 min readEA link

Sha­har Avin: Near-term AI se­cu­rity risks, and what to do about them

EA Global3 Nov 2017 7:43 UTC
7 points
0 comments1 min readEA link
(www.youtube.com)

Race to the Top: Bench­marks for AI Safety

isaduan4 Dec 2022 22:50 UTC
51 points
8 comments1 min readEA link

[Question] What are the best jour­nals to pub­lish AI gov­er­nance pa­pers in?

CaroJ2 May 2022 10:07 UTC
25 points
4 comments1 min readEA link

Trends in the dol­lar train­ing cost of ma­chine learn­ing systems

Ben Cottier1 Feb 2023 14:48 UTC
63 points
3 comments1 min readEA link

How Could AI Gover­nance Go Wrong?

HaydnBelfield26 May 2022 21:29 UTC
40 points
7 comments18 min readEA link

Many AI gov­er­nance pro­pos­als have a trade­off be­tween use­ful­ness and feasibility

Akash3 Feb 2023 18:49 UTC
21 points
0 comments1 min readEA link

Google in­vests $300mn in ar­tifi­cial in­tel­li­gence start-up An­thropic | FT

𝕮𝖎𝖓𝖊𝖗𝖆3 Feb 2023 19:43 UTC
155 points
6 comments1 min readEA link
(www.ft.com)

Law-Fol­low­ing AI 1: Se­quence In­tro­duc­tion and Structure

Cullen27 Apr 2022 17:16 UTC
35 points
2 comments9 min readEA link

Dear An­thropic peo­ple, please don’t re­lease Claude

No drama8 Feb 2023 2:44 UTC
23 points
5 comments1 min readEA link

Cy­borg Pe­ri­ods: There will be mul­ti­ple AI transitions

Jan_Kulveit22 Feb 2023 16:09 UTC
61 points
1 comment1 min readEA link

[Question] Do­ing Global Pri­ori­ties or AI Policy re­search from re­mote lo­ca­tion?

With Love from Israel29 Oct 2019 9:34 UTC
30 points
4 comments1 min readEA link

Ap­ply to the new Open Philan­thropy Tech­nol­ogy Policy Fel­low­ship!

lukeprog20 Jul 2021 18:41 UTC
78 points
7 comments4 min readEA link

AGI Safety Fun­da­men­tals cur­ricu­lum and application

richard_ngo20 Oct 2021 21:45 UTC
123 points
20 comments8 min readEA link
(docs.google.com)

Owen Cot­ton-Bar­ratt: What does (and doesn’t) AI mean for effec­tive al­tru­ism?

EA Global11 Aug 2017 8:19 UTC
10 points
0 comments12 min readEA link
(www.youtube.com)

How ma­jor gov­ern­ments can help with the most im­por­tant century

Holden Karnofsky24 Feb 2023 19:37 UTC
55 points
4 comments4 min readEA link
(www.cold-takes.com)

[Question] Is there ev­i­dence that recom­mender sys­tems are chang­ing users’ prefer­ences?

zdgroff12 Apr 2021 19:11 UTC
60 points
15 comments1 min readEA link

AI Gover­nance Needs Tech­ni­cal Work

Mauricio5 Sep 2022 22:25 UTC
94 points
3 comments7 min readEA link

AI Gover­nance & Strat­egy: Pri­ori­ties, tal­ent gaps, & opportunities

Akash3 Mar 2023 18:09 UTC
19 points
0 comments1 min readEA link

The case for build­ing ex­per­tise to work on US AI policy, and how to do it

80000_Hours31 Jan 2019 22:44 UTC
37 points
2 comments2 min readEA link

Il panorama della gov­er­nance lun­goter­minista delle in­tel­li­genze artificiali

EA Italy17 Jan 2023 11:03 UTC
1 point
0 comments10 min readEA link

OPEC for a slow AGI takeoff

vyrax21 Apr 2023 10:53 UTC
4 points
0 comments3 min readEA link

Deep­Mind and Google Brain are merg­ing [Linkpost]

Akash20 Apr 2023 18:47 UTC
32 points
1 comment1 min readEA link

Stu­dent com­pe­ti­tion for draft­ing a treaty on mora­to­rium of large-scale AI ca­pa­bil­ities R&D

Nayanika24 Apr 2023 13:15 UTC
35 points
4 comments2 min readEA link

Briefly how I’ve up­dated since ChatGPT

rime25 Apr 2023 19:39 UTC
28 points
7 comments2 min readEA link
(www.lesswrong.com)

Refram­ing the bur­den of proof: Com­pa­nies should prove that mod­els are safe (rather than ex­pect­ing au­di­tors to prove that mod­els are dan­ger­ous)

Akash25 Apr 2023 18:49 UTC
34 points
1 comment1 min readEA link

Pro­pos­als for the AI Reg­u­la­tory Sand­box in Spain

Guillem Bas27 Apr 2023 10:33 UTC
54 points
2 comments11 min readEA link
(riesgoscatastroficosglobales.com)

In­tro­duc­ing the AI Ob­jec­tives In­sti­tute’s Re­search: Differ­en­tial Paths to­ward Safe and Benefi­cial AI

cmck5 May 2023 20:26 UTC
40 points
1 comment8 min readEA link

Im­pli­ca­tions of the White­house meet­ing with AI CEOs for AI su­per­in­tel­li­gence risk—a first-step to­wards evals?

Jamie Bernardi7 May 2023 17:33 UTC
76 points
3 comments7 min readEA link

Re­boot­ing AI Gover­nance: An AI-Driven Ap­proach to AI Governance

Max Reddel20 May 2023 19:06 UTC
35 points
4 comments30 min readEA link

[Linkpost] “Gover­nance of su­per­in­tel­li­gence” by OpenAI

Daniel_Eth22 May 2023 20:15 UTC
50 points
6 comments2 min readEA link
(openai.com)

Some gov­er­nance re­search ideas to pre­vent malev­olent con­trol over AGI and why this might mat­ter a hell of a lot

Jim Buhler23 May 2023 13:07 UTC
50 points
0 comments17 min readEA link

AI Safety Newslet­ter #7: Dis­in­for­ma­tion, Gover­nance Recom­men­da­tions for AI labs, and Se­nate Hear­ings on AI

Center for AI Safety23 May 2023 21:42 UTC
23 points
0 comments6 min readEA link
(newsletter.safe.ai)

Deep­Mind: Model eval­u­a­tion for ex­treme risks

Zach Stein-Perlman25 May 2023 3:00 UTC
44 points
0 comments1 min readEA link

By failing to take se­ri­ous AI ac­tion, the US could be in vi­o­la­tion of its in­ter­na­tional law obligations

Cecil Abungu 27 May 2023 4:25 UTC
45 points
1 comment10 min readEA link

List of Masters Pro­grams in Tech Policy, Public Policy and Se­cu­rity (Europe)

sarahfurstenberg29 May 2023 10:23 UTC
41 points
0 comments3 min readEA link

An­nounc­ing Apollo Research

mariushobbhahn30 May 2023 16:17 UTC
150 points
4 comments1 min readEA link

Catas­trophic Risks from Un­safe AI: Nav­i­gat­ing a Tightrope Sce­nario (Ben Garfinkel, EAG Lon­don 2023)

AlexanderSaeri2 Jun 2023 9:59 UTC
15 points
1 comment10 min readEA link

A sur­vey of con­crete risks de­rived from Ar­tifi­cial Intelligence

Guillem Bas2 Jun 2023 15:02 UTC
23 points
0 comments6 min readEA link

Ap­pli­ca­tions open for AI Safety Fun­da­men­tals: Gover­nance Course

Jamie Bernardi2 Jun 2023 16:08 UTC
73 points
0 comments2 min readEA link
(www.aisafetyfundamentals.com)

The Risks of AI-Gen­er­ated Con­tent on the EA Forum

WobblyPanda24 Jun 2023 5:33 UTC
−1 points
0 comments1 min readEA link

From vol­un­tary to manda­tory, are the ESG dis­clo­sure frame­works still fer­tile ground for un­re­al­ised EA ca­reer path­ways? – A 2023 up­date on ESG po­ten­tial impact

chanakin4 Jun 2023 12:00 UTC
17 points
4 comments11 min readEA link

US Policy Ca­reer Resources

US Policy Careers6 Jun 2023 20:52 UTC
25 points
0 comments7 min readEA link

AI Risk in Africa

Claude Formanek12 Oct 2021 2:28 UTC
18 points
0 comments10 min readEA link

Sha­har Avin on How to Strate­gi­cally Reg­u­late Ad­vanced AI Systems

Michaël Trazzi23 Sep 2022 15:49 UTC
48 points
2 comments5 min readEA link
(theinsideview.ai)

Idea: an AI gov­er­nance group colo­cated with ev­ery AI re­search group!

capybaralet7 Dec 2020 23:41 UTC
8 points
1 comment1 min readEA link

Nu­clear Es­pi­onage and AI Governance

GAA4 Oct 2021 18:21 UTC
32 points
3 comments24 min readEA link

The Wind­fall Clause has a reme­dies problem

John Bridge23 May 2022 10:31 UTC
40 points
0 comments20 min readEA link

Ques­tions for fur­ther in­ves­ti­ga­tion of AI diffusion

Ben Cottier21 Dec 2022 13:50 UTC
28 points
0 comments11 min readEA link

Google could build a con­scious AI in three months

Derek Shiller1 Oct 2022 13:24 UTC
14 points
17 comments7 min readEA link

On Ar­tifi­cial Gen­eral In­tel­li­gence: Ask­ing the Right Questions

Heather Douglas2 Oct 2022 5:00 UTC
−1 points
7 comments3 min readEA link

What if AI de­vel­op­ment goes well?

RoryG3 Aug 2022 8:57 UTC
25 points
7 comments12 min readEA link

Mas­sive Scal­ing Should be Frowned Upon

harsimony17 Nov 2022 17:44 UTC
9 points
0 comments5 min readEA link

Safety with­out op­pres­sion: an AI gov­er­nance problem

Nathan_Barnard28 Jul 2022 10:19 UTC
3 points
0 comments8 min readEA link

An­nounc­ing the SPT Model Web App for AI Governance

Paolo Bova4 Aug 2022 10:45 UTC
36 points
0 comments3 min readEA link

Cryp­tocur­rency Ex­ploits Show the Im­por­tance of Proac­tive Poli­cies for AI X-Risk

eSpencer16 Sep 2022 4:44 UTC
14 points
0 comments3 min readEA link

Pro­jec­tLawful.com gives you policy experience

trevor130 Aug 2022 23:07 UTC
−8 points
2 comments4 min readEA link

[Question] Does China have AI al­ign­ment re­sources/​in­sti­tu­tions? How can we pri­ori­tize cre­at­ing more?

Jakub Kraus4 Aug 2022 19:23 UTC
18 points
9 comments1 min readEA link

AI Alter­na­tive Fu­tures: Ex­plo­ra­tory Sce­nario Map­ping for Ar­tifi­cial In­tel­li­gence Risk—Re­quest for Par­ti­ci­pa­tion [Linkpost]

Kiliank9 May 2022 19:53 UTC
17 points
2 comments8 min readEA link

AGI al­ign­ment re­sults from a se­ries of al­igned ac­tions

hanadulset27 Dec 2021 19:33 UTC
15 points
1 comment6 min readEA link

Im­pli­ca­tions of large lan­guage model diffu­sion for AI governance

Ben Cottier21 Dec 2022 13:50 UTC
14 points
0 comments38 min readEA link

What is Com­pute? - Trans­for­ma­tive AI and Com­pute [1/​4]

lennart23 Sep 2021 13:54 UTC
45 points
6 comments18 min readEA link

CNAS re­port: ‘Ar­tifi­cial In­tel­li­gence and Arms Con­trol’

MMMaas13 Oct 2022 8:35 UTC
16 points
0 comments1 min readEA link
(www.cnas.org)

[Question] What are the most press­ing is­sues in short-term AI policy?

BrownHairedEevee14 Jan 2020 22:05 UTC
9 points
0 comments1 min readEA link

Who owns AI-gen­er­ated con­tent?

Johan S Daniel7 Dec 2022 3:03 UTC
−2 points
0 comments2 min readEA link

Against GDP as a met­ric for timelines and take­off speeds

kokotajlod29 Dec 2020 17:50 UTC
47 points
6 comments14 min readEA link

“Nor­mal ac­ci­dents” and AI sys­tems

Eleni_A8 Aug 2022 18:43 UTC
4 points
1 comment1 min readEA link
(www.achan.ca)

Trans­for­ma­tive AI and Com­pute [Sum­mary]

lennart23 Sep 2021 13:53 UTC
58 points
5 comments9 min readEA link

[Question] What do we do if AI doesn’t take over the world, but still causes a sig­nifi­cant global prob­lem?

James_Banks2 Aug 2020 3:35 UTC
16 points
5 comments1 min readEA link

AI Safety Overview: CERI Sum­mer Re­search Fellowship

Jamie Bernardi24 Mar 2022 15:12 UTC
29 points
0 comments2 min readEA link

Sce­nario Map­ping Ad­vanced AI Risk: Re­quest for Par­ti­ci­pa­tion with Data Collection

Kiliank27 Mar 2022 11:44 UTC
14 points
0 comments5 min readEA link

Work­ing in Congress (Part #1): Back­ground and some EA cause area analysis

US Policy Careers11 Apr 2021 18:24 UTC
98 points
3 comments28 min readEA link

When is AI safety re­search harm­ful?

Nathan_Barnard9 May 2022 10:36 UTC
13 points
6 comments9 min readEA link

Credo AI is hiring for sev­eral roles

IanEisenberg11 Apr 2022 15:58 UTC
14 points
2 comments1 min readEA link

Where are the red lines for AI?

Karl von Wendt5 Aug 2022 9:41 UTC
13 points
3 comments6 min readEA link

Deep­Mind’s gen­er­al­ist AI, Gato: A non-tech­ni­cal explainer

frances_lorenz16 May 2022 21:19 UTC
127 points
13 comments6 min readEA link

The case for long-term cor­po­rate gov­er­nance of AI

SethBaum3 Nov 2021 10:50 UTC
42 points
3 comments8 min readEA link

Google’s ethics is alarming

len.hoang.lnh25 Feb 2021 5:57 UTC
6 points
5 comments1 min readEA link

Let’s think about slow­ing down AI

Katja_Grace23 Dec 2022 19:56 UTC
320 points
7 comments1 min readEA link

AI Benefits Post 2: How AI Benefits Differs from AI Align­ment & AI for Good

Cullen29 Jun 2020 16:59 UTC
9 points
0 comments2 min readEA link

A primer & some re­flec­tions on re­cent CSER work (EAB talk)

MMMaas12 Apr 2022 12:56 UTC
69 points
4 comments10 min readEA link

Long-term AI policy strat­egy re­search and implementation

Benjamin_Todd9 Nov 2021 0:00 UTC
1 point
0 comments7 min readEA link
(80000hours.org)

An­nounc­ing the GovAI Policy Team

MarkusAnderljung1 Aug 2022 22:46 UTC
107 points
11 comments2 min readEA link

Fore­cast­ing Com­pute—Trans­for­ma­tive AI and Com­pute [2/​4]

lennart1 Oct 2021 8:25 UTC
38 points
6 comments19 min readEA link

Data Publi­ca­tion for the 2021 Ar­tifi­cial In­tel­li­gence, Mo­ral­ity, and Sen­tience (AIMS) Sur­vey

Janet Pauketat24 Mar 2022 15:43 UTC
21 points
0 comments3 min readEA link
(www.sentienceinstitute.org)

How to get tech­nolog­i­cal knowl­edge on AI/​ML (for non-tech peo­ple)

FangFang30 Jun 2021 7:53 UTC
61 points
7 comments5 min readEA link

What if we don’t need a “Hard Left Turn” to reach AGI?

Eigengender15 Jul 2022 9:49 UTC
39 points
7 comments4 min readEA link

England & Wales & Windfalls

John Bridge3 Jun 2022 10:26 UTC
13 points
1 comment26 min readEA link

AI Benefits Post 5: Out­stand­ing Ques­tions on Govern­ing Benefits

Cullen21 Jul 2020 16:45 UTC
5 points
0 comments4 min readEA link

Ap­ply now for the EU Tech Policy Fel­low­ship 2023

Jan-Willem11 Nov 2022 6:16 UTC
64 points
1 comment5 min readEA link

In­tro­duc­ing a New Course on the Eco­nomics of AI

akorinek21 Dec 2021 4:55 UTC
83 points
6 comments2 min readEA link

The repli­ca­tion and em­u­la­tion of GPT-3

Ben Cottier21 Dec 2022 13:49 UTC
14 points
0 comments33 min readEA link

Toby Ord’s new re­port on les­sons from the de­vel­op­ment of the atomic bomb

Ishan Mukherjee22 Nov 2022 10:37 UTC
65 points
3 comments1 min readEA link
(www.governance.ai)

Train­ing for Good—Up­date & Plans for 2023

Cillian Crosson15 Nov 2022 16:02 UTC
80 points
0 comments10 min readEA link

Publi­ca­tion de­ci­sions for large lan­guage mod­els, and their impacts

Ben Cottier21 Dec 2022 13:50 UTC
14 points
0 comments16 min readEA link

4 Years Later: Pres­i­dent Trump and Global Catas­trophic Risk

HaydnBelfield25 Oct 2020 16:28 UTC
23 points
9 comments10 min readEA link

How long till Brus­sels?: A light in­ves­ti­ga­tion into the Brus­sels Gap

Yadav26 Dec 2022 7:49 UTC
50 points
2 comments5 min readEA link

GPT-3-like mod­els are now much eas­ier to ac­cess and de­ploy than to develop

Ben Cottier21 Dec 2022 13:49 UTC
22 points
3 comments19 min readEA link

Ap­pli­ca­tions Open: GovAI Sum­mer Fel­low­ship 2023

GovAI21 Dec 2022 15:00 UTC
28 points
0 comments2 min readEA link

Re­search + Real­ity Graph­ing to Sup­port AI Policy (and more): Sum­mary of a Frozen Project

Harrison Durland2 Jul 2022 20:58 UTC
34 points
2 comments8 min readEA link

A Brief Sum­mary Of The Most Im­por­tant Century

Maynk0225 Oct 2022 15:28 UTC
3 points
0 comments5 min readEA link

The AIA and its Brus­sels Effect

Kathryn O'Rourke27 Dec 2022 16:01 UTC
14 points
0 comments5 min readEA link

13 Re­cent Publi­ca­tions on Ex­is­ten­tial Risk (Jan 2021 up­date)

HaydnBelfield8 Feb 2021 12:42 UTC
7 points
2 comments10 min readEA link

A Cal­ifor­nia Effect for Ar­tifi­cial Intelligence

henryj9 Sep 2022 14:17 UTC
73 points
2 comments4 min readEA link
(docs.google.com)

Back­ground for “Un­der­stand­ing the diffu­sion of large lan­guage mod­els”

Ben Cottier21 Dec 2022 13:49 UTC
12 points
0 comments23 min readEA link

[Job]: AI Stan­dards Devel­op­ment Re­search Assistant

Tony Barrett14 Oct 2022 20:18 UTC
13 points
0 comments2 min readEA link

CSER is hiring for a se­nior re­search as­so­ci­ate on longterm AI risk and governance

Sam Clarke24 Jan 2022 13:24 UTC
9 points
4 comments1 min readEA link

In­for­ma­tion in risky tech­nol­ogy races

nemeryxu2 Aug 2022 23:35 UTC
15 points
2 comments3 min readEA link

Com­pute Gover­nance and Con­clu­sions—Trans­for­ma­tive AI and Com­pute [3/​4]

lennart14 Oct 2021 7:55 UTC
18 points
3 comments5 min readEA link

Tips for con­duct­ing wor­ld­view investigations

lukeprog12 Apr 2022 19:28 UTC
80 points
4 comments2 min readEA link

The His­tory, Episte­mol­ogy and Strat­egy of Tech­nolog­i­cal Res­traint, and les­sons for AI (short es­say)

MMMaas10 Aug 2022 11:00 UTC
75 points
3 comments9 min readEA link
(verfassungsblog.de)

In­tent al­ign­ment should not be the goal for AGI x-risk reduction

johnjnay26 Oct 2022 1:24 UTC
7 points
1 comment1 min readEA link

Com­pute Re­search Ques­tions and Met­rics—Trans­for­ma­tive AI and Com­pute [4/​4]

lennart28 Nov 2021 22:18 UTC
18 points
2 comments15 min readEA link

A Primer on God, Liber­al­ism and the End of History

Mahdi Complex28 Mar 2022 5:26 UTC
7 points
3 comments14 min readEA link

AGI Risk: How to in­ter­na­tion­ally reg­u­late in­dus­tries in non-democracies

Timothy_Liptrot16 May 2022 22:45 UTC
9 points
2 comments9 min readEA link

In­for­ma­tion se­cu­rity con­sid­er­a­tions for AI and the long term future

Jeffrey Ladish2 May 2022 20:53 UTC
124 points
7 comments11 min readEA link

[Question] AI Eth­i­cal Committee

eaaicommittee1 Mar 2022 23:35 UTC
8 points
0 comments1 min readEA link

An­nounc­ing: What Fu­ture World? - Grow­ing the AI Gover­nance Community

DavidCorfield2 Nov 2022 0:31 UTC
4 points
0 comments1 min readEA link

Ar­tifi­cial In­tel­li­gence and Nu­clear Com­mand, Con­trol, & Com­mu­ni­ca­tions: The Risks of Integration

Peter Rautenbach18 Nov 2022 13:01 UTC
60 points
3 comments50 min readEA link

New Work­ing Paper Series of the Le­gal Pri­ori­ties Project

Legal Priorities Project18 Oct 2021 10:30 UTC
60 points
0 comments9 min readEA link

Cen­tre for the Study of Ex­is­ten­tial Risk Four Month Re­port June—Septem­ber 2020

HaydnBelfield2 Dec 2020 18:33 UTC
24 points
0 comments17 min readEA link

Sup­port­ing global co­or­di­na­tion in AI de­vel­op­ment: Why and how to con­tribute to in­ter­na­tional AI standards

pcihon17 Apr 2019 22:17 UTC
21 points
4 comments1 min readEA link

The Ter­minol­ogy of Ar­tifi­cial Sentience

Janet Pauketat28 Nov 2021 7:52 UTC
29 points
0 comments1 min readEA link
(www.sentienceinstitute.org)

Pivotal out­comes and pivotal processes

Andrew Critch17 Jun 2022 23:43 UTC
42 points
1 comment5 min readEA link

Is Eric Sch­midt fund­ing AI ca­pa­bil­ities re­search by the US gov­ern­ment?

Pranay K24 Dec 2022 8:32 UTC
46 points
3 comments2 min readEA link
(www.politico.com)

Drivers of large lan­guage model diffu­sion: in­cre­men­tal re­search, pub­lic­ity, and cascades

Ben Cottier21 Dec 2022 13:50 UTC
21 points
0 comments29 min readEA link

[Question] Slow­ing down AI progress?

Eleni_A26 Jul 2022 8:46 UTC
14 points
9 comments1 min readEA link

Ac­tion­able-guidance and roadmap recom­men­da­tions for the NIST AI Risk Man­age­ment Framework

Tony Barrett17 May 2022 15:27 UTC
11 points
0 comments3 min readEA link

Euro­pean Union AI Devel­op­ment and Gover­nance Part­ner­ships

EU AI Governance19 Jan 2022 10:26 UTC
22 points
1 comment4 min readEA link

Should AI fo­cus on prob­lem-solv­ing or strate­gic plan­ning? Why not both?

oliver_siegel1 Nov 2022 9:53 UTC
1 point
0 comments1 min readEA link

AI Safety Endgame Stories

IvanVendrov28 Sep 2022 17:12 UTC
31 points
1 comment1 min readEA link

Par­allels Between AI Safety by De­bate and Ev­i­dence Law

Cullen20 Jul 2020 22:52 UTC
30 points
2 comments2 min readEA link
(cullenokeefe.com)

FYI: I’m work­ing on a book about the threat of AGI/​ASI for a gen­eral au­di­ence. I hope it will be of value to the cause and the community

Darren McKee17 Jun 2022 11:52 UTC
32 points
1 comment2 min readEA link

Re­port on Semi-in­for­ma­tive Pri­ors for AI timelines (Open Philan­thropy)

Tom_Davidson26 Mar 2021 17:46 UTC
62 points
6 comments2 min readEA link

AI Benefits Post 1: In­tro­duc­ing “AI Benefits”

Cullen22 Jun 2020 16:58 UTC
10 points
2 comments3 min readEA link

Tony Blair In­sti­tute—Com­pute for AI In­dex ( Seek­ing a Sup­plier)

TomWestgarth3 Oct 2022 10:25 UTC
28 points
8 comments1 min readEA link

AI Benefits Post 3: Direct and Indi­rect Ap­proaches to AI Benefits

Cullen6 Jul 2020 18:46 UTC
5 points
0 comments2 min readEA link

Ar­tifi­cial In­tel­li­gence, Mo­ral­ity, and Sen­tience (AIMS) Sur­vey: 2021

Janet Pauketat1 Jul 2022 7:47 UTC
36 points
0 comments2 min readEA link
(www.sentienceinstitute.org)

AGI Timelines in Gover­nance: Differ­ent Strate­gies for Differ­ent Timeframes

simeon_c19 Dec 2022 21:31 UTC
110 points
19 comments1 min readEA link

How Rood­man’s GWP model trans­lates to TAI timelines

kokotajlod16 Nov 2020 14:11 UTC
22 points
0 comments3 min readEA link

Con­clu­sion and Bibliog­ra­phy for “Un­der­stand­ing the diffu­sion of large lan­guage mod­els”

Ben Cottier21 Dec 2022 13:50 UTC
12 points
0 comments11 min readEA link

The flaws that make to­day’s AI ar­chi­tec­ture un­safe and a new ap­proach that could fix it

80000_Hours22 Jun 2020 22:15 UTC
3 points
0 comments87 min readEA link
(80000hours.org)

HIRING: In­form and shape a new pro­ject on AI safety at Part­ner­ship on AI

Madhulika Srikumar24 Nov 2021 16:29 UTC
11 points
2 comments2 min readEA link

Any fur­ther work on AI Safety Suc­cess Sto­ries?

Krieger2 Oct 2022 11:59 UTC
2 points
0 comments1 min readEA link

[Question] What “defense lay­ers” should gov­ern­ments, AI labs, and busi­nesses use to pre­vent catas­trophic AI failures?

alexlintz3 Dec 2021 14:24 UTC
37 points
3 comments1 min readEA link

In­ter­na­tional co­op­er­a­tion as a tool to re­duce two ex­is­ten­tial risks.

johl@umich.edu19 Apr 2021 16:51 UTC
28 points
4 comments23 min readEA link

Stu­art Rus­sell Hu­man Com­pat­i­ble AI Roundtable with Allan Dafoe, Rob Re­ich, & Ma­ri­etje Schaake

Mahendra Prasad11 Feb 2021 7:43 UTC
16 points
0 comments1 min readEA link

Align­ing AI with Hu­mans by Lev­er­ag­ing Le­gal Informatics

johnjnay18 Sep 2022 7:43 UTC
20 points
11 comments3 min readEA link

Pos­si­ble di­rec­tions in AI ideal gov­er­nance research

RoryG10 Aug 2022 8:36 UTC
5 points
0 comments3 min readEA link

Con­tribute by fa­cil­i­tat­ing the AGI Safety Fun­da­men­tals Programme

Jamie Bernardi6 Dec 2021 11:50 UTC
27 points
0 comments2 min readEA link

A challenge for AGI or­ga­ni­za­tions, and a challenge for readers

RobBensinger1 Dec 2022 23:11 UTC
168 points
13 comments1 min readEA link

How Open Source Ma­chine Learn­ing Soft­ware Shapes AI

Max Langenkamp28 Sep 2022 17:49 UTC
11 points
3 comments14 min readEA link
(maxlangenkamp.me)

Credo AI is hiring!

IanEisenberg3 Mar 2022 18:02 UTC
16 points
6 comments4 min readEA link

*New* Canada AI Safety & Gover­nance community

Wyatt Tessari L'Allié29 Aug 2022 15:58 UTC
31 points
2 comments1 min readEA link

A col­lec­tion of AI Gover­nance-re­lated Pod­casts, Newslet­ters, Blogs, and more

alexlintz2 Oct 2021 0:46 UTC
24 points
1 comment1 min readEA link

Nine Points of Col­lec­tive Insanity

Remmelt27 Dec 2022 3:14 UTC
1 point
0 comments1 min readEA link

A course for the gen­eral pub­lic on AI

LeandroD31 Aug 2020 1:29 UTC
1 point
0 comments1 min readEA link

Ap­pendix to Bridg­ing Demonstration

mako yass1 Jun 2022 20:30 UTC
17 points
0 comments28 min readEA link

Does gen­er­al­ity pay? GPT-3 can provide pre­limi­nary ev­i­dence.

BrownHairedEevee12 Jul 2020 18:53 UTC
21 points
4 comments2 min readEA link

Main paths to im­pact in EU AI Policy

JOMG_Monnet8 Dec 2022 16:17 UTC
69 points
2 comments8 min readEA link

Les­sons from Three Mile Is­land for AI Warn­ing Shots

NickGabs26 Sep 2022 2:47 UTC
42 points
0 comments12 min readEA link

Un­der­stand­ing the diffu­sion of large lan­guage mod­els: summary

Ben Cottier21 Dec 2022 13:49 UTC
124 points
18 comments22 min readEA link

Book re­view: Ar­chi­tects of In­tel­li­gence by Martin Ford (2018)

Ofer11 Aug 2020 17:24 UTC
11 points
1 comment2 min readEA link

[Link and com­men­tary] Beyond Near- and Long-Term: Towards a Clearer Ac­count of Re­search Pri­ori­ties in AI Ethics and Society

MichaelA14 Mar 2020 9:04 UTC
18 points
0 comments7 min readEA link

The ‘Old AI’: Les­sons for AI gov­er­nance from early elec­tric­ity regulation

Sam Clarke19 Dec 2022 2:46 UTC
58 points
1 comment13 min readEA link

FLI is hiring a new Direc­tor of US Policy

aaguirre27 Jul 2022 0:07 UTC
14 points
0 comments1 min readEA link

Why we need a new agency to reg­u­late ad­vanced ar­tifi­cial intelligence

Michael Huang4 Aug 2022 13:38 UTC
25 points
0 comments1 min readEA link
(www.brookings.edu)

The Slip­pery Slope from DALLE-2 to Deep­fake Anarchy

stecas5 Nov 2022 14:47 UTC
55 points
11 comments17 min readEA link

[Pod­cast] Ajeya Co­tra on wor­ld­view di­ver­sifi­ca­tion and how big the fu­ture could be

BrownHairedEevee22 Jan 2021 23:57 UTC
57 points
20 comments1 min readEA link
(80000hours.org)

Will the EU reg­u­la­tions on AI mat­ter to the rest of the world?

hanadulset1 Jan 2022 21:56 UTC
33 points
5 comments5 min readEA link

In­sti­tu­tions Can­not Res­train Dark-Triad AI Exploitation

Remmelt27 Dec 2022 10:34 UTC
8 points
0 comments1 min readEA link

Sur­vey on AI ex­is­ten­tial risk scenarios

Sam Clarke8 Jun 2021 17:12 UTC
154 points
11 comments6 min readEA link

How might we al­ign trans­for­ma­tive AI if it’s de­vel­oped very soon?

Holden Karnofsky29 Aug 2022 15:48 UTC
156 points
17 comments44 min readEA link

What does it mean to be­come an ex­pert in AI Hard­ware?

Toph9 Jan 2021 4:15 UTC
87 points
10 comments11 min readEA link

‘Ar­tifi­cial In­tel­li­gence Gover­nance un­der Change’ (PhD dis­ser­ta­tion)

MMMaas15 Sep 2022 12:10 UTC
53 points
1 comment2 min readEA link
(drive.google.com)

Birds, Brains, Planes, and AI: Against Ap­peals to the Com­plex­ity/​Mys­te­ri­ous­ness/​Effi­ciency of the Brain

kokotajlod18 Jan 2021 12:39 UTC
27 points
2 comments1 min readEA link

The Pug­wash Con­fer­ences and the Anti-Bal­lis­tic Mis­sile Treaty as a case study of Track II diplomacy

rani_martin16 Sep 2022 10:42 UTC
82 points
5 comments27 min readEA link

Quick Thoughts on A.I. Governance

NicholasKross30 Apr 2022 14:49 UTC
43 points
0 comments2 min readEA link
(www.thinkingmuchbetter.com)

[Linkpost] “Blueprint for an AI Bill of Rights”—Office of Science and Tech­nol­ogy Policy, USA (2022)

rodeo_flagellum5 Oct 2022 16:48 UTC
15 points
0 comments1 min readEA link

WFW?: Op­por­tu­nity and The­ory of Impact

DavidCorfield2 Nov 2022 0:45 UTC
2 points
5 comments14 min readEA link
(www.whatfuture.world)

How Europe might mat­ter for AI governance

stefan.torges12 Jul 2019 23:42 UTC
52 points
13 comments8 min readEA link

Rac­ing through a minefield: the AI de­ploy­ment problem

Holden Karnofsky31 Dec 2022 21:44 UTC
74 points
1 comment13 min readEA link
(www.cold-takes.com)

Large Lan­guage Models as Cor­po­rate Lob­by­ists, and Im­pli­ca­tions for So­cietal-AI Alignment

johnjnay4 Jan 2023 22:22 UTC
10 points
6 comments8 min readEA link

Went­worth and Larsen on buy­ing time

Akash9 Jan 2023 21:31 UTC
48 points
0 comments1 min readEA link

[Ru­mour] Microsoft to in­vest $10B in OpenAI, will re­ceive 75% of prof­its un­til they re­coup in­vest­ment: GPT would be in­te­grated with Office

𝕮𝖎𝖓𝖊𝖗𝖆10 Jan 2023 23:43 UTC
25 points
2 comments1 min readEA link

[Question] Should AI writ­ers be pro­hibited in ed­u­ca­tion?

Eleni_A16 Jan 2023 22:29 UTC
3 points
2 comments1 min readEA link

AI safety mile­stones?

Zach Stein-Perlman23 Jan 2023 21:30 UTC
6 points
0 comments1 min readEA link

AI Gover­nance Read­ing Group [Toronto+re­mote]

Liav.Koren24 Jan 2023 22:05 UTC
2 points
0 comments1 min readEA link

Ap­ply to HAIST/​MAIA’s AI Gover­nance Work­shop in DC (Feb 17-20)

Phosphorous28 Jan 2023 0:45 UTC
15 points
0 comments1 min readEA link
(www.lesswrong.com)

Assess­ing China’s im­por­tance as an AI superpower

JulianHazell3 Feb 2023 11:08 UTC
89 points
7 comments1 min readEA link
(muddyclothes.substack.com)

Launch­ing The Col­lec­tive In­tel­li­gence Pro­ject: Whitepa­per and Pilots

jasmine_wang6 Feb 2023 17:00 UTC
37 points
8 comments2 min readEA link
(cip.org)

High im­pact job op­por­tu­nity at ARIA (UK)

Rasool12 Feb 2023 10:35 UTC
80 points
0 comments1 min readEA link

How to ‘troll for good’: Lev­er­ag­ing IP for AI governance

Michael Huang26 Feb 2023 6:34 UTC
26 points
3 comments1 min readEA link
(www.science.org)

Very Briefly: The CHIPS Act

Yadav26 Feb 2023 13:53 UTC
35 points
3 comments1 min readEA link
(www.y1d2.com)

[Question] An eco­nomics of AI gov—best re­sources for

Liv26 Feb 2023 11:11 UTC
10 points
4 comments1 min readEA link

Call for Cruxes by Rhyme, a Longter­mist His­tory Con­sul­tancy

Lara_TH1 Mar 2023 10:20 UTC
146 points
7 comments3 min readEA link

[Question] What are some sources re­lated to big-pic­ture AI strat­egy?

Jacob_Watts2 Mar 2023 5:04 UTC
9 points
4 comments1 min readEA link

Distil­la­tion of The Offense-Defense Balance of Scien­tific Knowledge

Arjun Yadav12 Aug 2022 7:01 UTC
17 points
0 comments3 min readEA link

A con­cern­ing ob­ser­va­tion from me­dia cov­er­age of AI in­dus­try dynamics

Justin Olive2 Mar 2023 23:56 UTC
47 points
5 comments3 min readEA link

Paper Sum­mary: The Effec­tive­ness of AI Ex­is­ten­tial Risk Com­mu­ni­ca­tion to the Amer­i­can and Dutch Public

Otto9 Mar 2023 10:40 UTC
96 points
11 comments4 min readEA link

[Question] What would need to be true for AI to trans­late a le­gal con­tract to a smart con­tract?

Patrick Liu18 Mar 2023 16:42 UTC
−1 points
0 comments1 min readEA link

Ques­tions about Con­je­cure’s CoEm proposal

Akash9 Mar 2023 19:32 UTC
19 points
0 comments1 min readEA link

[Linkpost] Scott Alexan­der re­acts to OpenAI’s lat­est post

Akash11 Mar 2023 22:24 UTC
105 points
4 comments1 min readEA link

The Wizard of Oz Prob­lem: How in­cen­tives and nar­ra­tives can skew our per­cep­tion of AI developments

Akash20 Mar 2023 22:36 UTC
16 points
0 comments1 min readEA link

Cap­ping AGI profits

Luke Frymire21 Mar 2023 13:29 UTC
12 points
2 comments4 min readEA link

Join the AI gov­er­nance and in­ter­pretabil­ity hackathons!

Esben Kran23 Mar 2023 14:39 UTC
33 points
1 comment5 min readEA link
(alignmentjam.com)

Tran­script: NBC Nightly News: AI ‘race to reck­less­ness’ w/​ Tris­tan Har­ris, Aza Raskin

WilliamKiely23 Mar 2023 3:45 UTC
47 points
1 comment1 min readEA link

ChatGPT bug leaked users’ con­ver­sa­tion histories

Ian Turner27 Mar 2023 0:17 UTC
15 points
2 comments1 min readEA link
(www.bbc.com)

Govern­ing High-Im­pact AI Sys­tems: Un­der­stand­ing Canada’s Pro­posed AI Bill. April 15, Car­leton Univer­sity, Ottawa

Liav.Koren27 Mar 2023 23:11 UTC
3 points
0 comments1 min readEA link
(www.eventbrite.com)

Paus­ing AI Devel­op­ments Isn’t Enough. We Need to Shut it All Down by Eliezer Yudkowsky

jacquesthibs29 Mar 2023 23:30 UTC
214 points
77 comments3 min readEA link
(time.com)

[Question] What are the ar­gu­ments that sup­port China build­ing AGI+ if Western com­pa­nies de­lay/​pause AI de­vel­op­ment?

DMMF29 Mar 2023 18:53 UTC
32 points
9 comments1 min readEA link

Want to win the AGI race? Solve al­ign­ment.

leopold29 Mar 2023 15:19 UTC
61 points
5 comments5 min readEA link
(www.forourposterity.com)

Nu­clear brinks­man­ship is not a good AI x-risk strategy

titotal30 Mar 2023 22:07 UTC
11 points
8 comments5 min readEA link

The fun­da­men­tal hu­man value is power.

Linyphia30 Mar 2023 15:15 UTC
−1 points
5 comments1 min readEA link

Pes­simism about AI Safety

Max_He-Ho2 Apr 2023 7:57 UTC
5 points
0 comments25 min readEA link
(www.lesswrong.com)

Re­duc­ing profit mo­ti­va­tions in AI development

Luke Frymire3 Apr 2023 20:04 UTC
18 points
1 comment6 min readEA link

If in­ter­pretabil­ity re­search goes well, it may get dangerous

So8res3 Apr 2023 21:48 UTC
33 points
0 comments1 min readEA link

Risks from GPT-4 Byproduct of Re­cur­sively Op­ti­miz­ing AIs

ben hayum6 Apr 2023 5:52 UTC
84 points
4 comments10 min readEA link
(www.lesswrong.com)

What to sug­gest com­pa­nies & en­trepreneurs do to use AI safely?

AlfalfaBloom5 Apr 2023 22:36 UTC
11 points
1 comment1 min readEA link

Paus­ing AI Devel­op­ments Isn’t Enough. We Need to Shut it All Down

EliezerYudkowsky9 Apr 2023 15:53 UTC
45 points
3 comments1 min readEA link

[linkpost] AI NOW In­sti­tute’s 2023 An­nual Re­port & Roadmap

Tristan Williams12 Apr 2023 20:00 UTC
6 points
0 comments2 min readEA link
(ainowinstitute.org)

[linkpost] “What Are Rea­son­able AI Fears?” by Robin Han­son, 2023-04-23

Arjun Panickssery14 Apr 2023 23:26 UTC
40 points
3 comments4 min readEA link
(quillette.com)

Ge­offrey Miller on Cross-Cul­tural Un­der­stand­ing Between China and Western Coun­tries as a Ne­glected Con­sid­er­a­tion in AI Alignment

Evan_Gaensbauer17 Apr 2023 3:26 UTC
24 points
2 comments4 min readEA link

Sum­mary: The Case for Halt­ing AI Devel­op­ment—Max Teg­mark on the Lex Frid­man Podcast

Madhav Malhotra16 Apr 2023 22:28 UTC
37 points
4 comments4 min readEA link
(youtu.be)

No, the EMH does not im­ply that mar­kets have long AGI timelines

Jakob24 Apr 2023 8:27 UTC
86 points
16 comments8 min readEA link

Un-un­plug­ga­bil­ity—can’t we just un­plug it?

Oliver Sourbut15 May 2023 13:23 UTC
14 points
0 comments1 min readEA link

AI Im­pacts Quar­terly Newslet­ter, Jan-Mar 2023

Harlan17 Apr 2023 23:07 UTC
20 points
1 comment3 min readEA link
(blog.aiimpacts.org)
No comments.