Building the field of AI safety

TagLast edit: 28 Oct 2022 15:56 UTC by Lizka

Building the field of AI safety refers to the family of interventions aimed at growing, shaping or otherwise improving AI safety as an intellectual community.

Cost-effectiveness of student programs for AI safety research

Center for AI Safety10 Jul 2023 17:23 UTC

53 points

7 comments15 min readEA link

Announcing the Cambridge Boston Alignment Initiative [Hiring!]

kuhanj2 Dec 2022 1:07 UTC

83 points

0 comments1 min readEA link

There should be a public adversarial collaboration on AI x-risk

pradyuprasad23 Jan 2023 4:09 UTC

56 points

5 comments2 min readEA link

AI safety needs to scale, and here’s how you can do it

Esben Kran2 Feb 2024 7:17 UTC

32 points

2 comments5 min readEA link

(apartresearch.com)

Spreading messages to help with the most important century

Holden Karnofsky25 Jan 2023 20:35 UTC

128 points

21 comments18 min readEA link

(www.cold-takes.com)

Announcing the AI Safety Field Building Hub, a new effort to provide AISFB projects, mentorship, and funding

Vael Gates28 Jul 2022 21:29 UTC

126 points

6 comments6 min readEA link

Announcing the Harvard AI Safety Team

Xander12330 Jun 2022 18:34 UTC

128 points

4 comments5 min readEA link

Modeling the impact of AI safety field-building programs

Center for AI Safety10 Jul 2023 17:22 UTC

83 points

0 comments7 min readEA link

Announcing AI Safety Bulgaria

Aleksandar N. Angelov3 Mar 2024 17:53 UTC

15 points

0 comments1 min readEA link

Cost-effectiveness of professional field-building programs for AI safety research

Center for AI Safety10 Jul 2023 17:26 UTC

38 points

2 comments18 min readEA link

Chilean AIS Hackathon Retrospective

Agustín Covarrubias 🔸9 May 2023 1:34 UTC

67 points

0 comments5 min readEA link

Vael Gates: Risks from Highly-Capable AI (March 2023)

Vael Gates1 Apr 2023 20:54 UTC

31 points

4 comments1 min readEA link

(docs.google.com)

Announcement: there are now monthly coordination calls for AIS fieldbuilders in Europe

gergo22 Nov 2024 10:30 UTC

27 points

0 comments1 min readEA link

[Question] AI strategy career pipeline

Zach Stein-Perlman22 May 2023 0:00 UTC

72 points

23 comments1 min readEA link

[SEE NEW EDITS] No, You Need to Write Clearer

Nicholas / Heather Kross29 Apr 2023 5:04 UTC

71 points

8 comments1 min readEA link

(www.thinkingmuchbetter.com)

AISafety.info “How can I help?” FAQ

StevenKaas5 Jun 2023 22:09 UTC

48 points

1 comment1 min readEA link

Talk: AI safety fieldbuilding at MATS

Ryan Kidd23 Jun 2024 23:06 UTC

14 points

1 comment1 min readEA link

AI Safety Arguments: An Interactive Guide

Lukas Trötzmüller🔸1 Feb 2023 19:21 UTC

32 points

5 comments3 min readEA link

Help us seed AI Safety Brussels

gergo7 Aug 2024 6:17 UTC

50 points

2 comments3 min readEA link

Cambridge AI Safety Hub is looking for full- or part-time organisers

hannah15 Jul 2023 14:31 UTC

12 points

0 comments1 min readEA link

AGI Safety Fundamentals programme is contracting a low-code engineer

Jamie B26 Aug 2022 15:43 UTC

39 points

4 comments5 min readEA link

Thoughts about AI safety field-building in LMIC

Renan Araujo23 Jun 2023 23:22 UTC

56 points

4 comments12 min readEA link

My Proven AI Safety Explanation (as a computing student)

Mica White6 Feb 2024 3:58 UTC

8 points

4 comments6 min readEA link

Decomposing alignment to take advantage of paradigms

Christopher King4 Jun 2023 14:26 UTC

2 points

0 comments4 min readEA link

MATS Winter 2023-24 Retrospective

utilistrutil11 May 2024 0:09 UTC

62 points

2 comments1 min readEA link

Onboarding students to EA/AIS in 4 days with an intensive fellowship

gergo5 Dec 2023 10:07 UTC

17 points

0 comments4 min readEA link

Launching applications for AI Safety Careers Course India 2024

varun_agr1 May 2024 5:30 UTC

23 points

1 comment1 min readEA link

The Bar for Contributing to AI Safety is Lower than You Think

Chris Leong17 Aug 2024 10:52 UTC

14 points

5 comments2 min readEA link

An economist’s perspective on AI safety

David Stinson7 Jun 2024 7:55 UTC

7 points

1 comment9 min readEA link

Impact Assessment of AI Safety Camp (Arb Research)

Sam Holton23 Jan 2024 16:32 UTC

87 points

23 comments11 min readEA link

Retrospective on the AI Safety Field Building Hub

Vael Gates2 Feb 2023 2:06 UTC

64 points

2 comments9 min readEA link

Results for a survey of tool use and workflows in alignment research

jacquesthibs19 Dec 2022 15:19 UTC

30 points

0 comments1 min readEA link

Establishing Oxford’s AI Safety Student Group: Lessons Learnt and Our Model

Wilkin123421 Sep 2022 7:57 UTC

72 points

3 comments1 min readEA link

Resources that (I think) new alignment researchers should know about

Akash28 Oct 2022 22:13 UTC

20 points

2 comments1 min readEA link

AI Safety Seems Hard to Measure

Holden Karnofsky11 Dec 2022 1:31 UTC

90 points

4 comments14 min readEA link

(www.cold-takes.com)

Are alignment researchers devoting enough time to improving their research capacity?

Carson Jones4 Nov 2022 0:58 UTC

11 points

1 comment1 min readEA link

The Tree of Life: Stanford AI Alignment Theory of Change

GabeM2 Jul 2022 18:32 UTC

69 points

5 comments14 min readEA link

AI safety university groups: a promising opportunity to reduce existential risk

mic30 Jun 2022 18:37 UTC

53 points

1 comment11 min readEA link

Good job opportunities for helping with the most important century

Holden Karnofsky18 Jan 2024 19:21 UTC

46 points

1 comment4 min readEA link

(www.cold-takes.com)

Concrete Steps to Get Started in Transformer Mechanistic Interpretability

Neel Nanda26 Dec 2022 13:00 UTC

18 points

0 comments12 min readEA link

What are some low-cost outside-the-box ways to do/fund alignment research?

trevor111 Nov 2022 5:57 UTC

2 points

3 comments1 min readEA link

Podcast: Shoshannah Tekofsky on skilling up in AI safety, visiting Berkeley, and developing novel research ideas

Akash25 Nov 2022 20:47 UTC

14 points

0 comments1 min readEA link

Update on Harvard AI Safety Team and MIT AI Alignment

Xander1232 Dec 2022 6:09 UTC

71 points

3 comments1 min readEA link

[Question] I have thousands of copies of HPMOR in Russian. How to use them with the most impact?

MikhailSamin27 Dec 2022 11:07 UTC

39 points

10 comments1 min readEA link

Announcing aisafety.training

JJ Hepburn17 Jan 2023 1:55 UTC

110 points

4 comments1 min readEA link

How many people are working (directly) on reducing existential risk from AI?

Benjamin Hilton17 Jan 2023 14:03 UTC

117 points

3 comments4 min readEA link

(80000hours.org)

Recursive Middle Manager Hell

Raemon17 Jan 2023 19:02 UTC

73 points

3 comments1 min readEA link

AGI safety field building projects I’d like to see

Severin24 Jan 2023 23:30 UTC

25 points

2 comments1 min readEA link

The Benefits of Distillation in Research

Jonas Hallgren4 Mar 2023 19:19 UTC

45 points

2 comments5 min readEA link

Let’s set new AI safety actors up for success

michel26 Jun 2023 21:17 UTC

33 points

1 comment9 min readEA link

AI Safety Field Building vs. EA CB

kuhanj26 Jun 2023 23:21 UTC

80 points

16 comments6 min readEA link

Announcing Athena—Women in AI Alignment Research

Claire Short7 Nov 2023 22:02 UTC

180 points

28 comments3 min readEA link

Washington Post article about EA university groups

Lizka5 Jul 2023 12:58 UTC

35 points

5 comments1 min readEA link

An Overview of the AI Safety Funding Situation

Stephen McAleese12 Jul 2023 14:54 UTC

132 points

14 comments15 min readEA link

Supervised Program for Alignment Research (SPAR) at UC Berkeley: Spring 2023 summary

mic19 Aug 2023 2:32 UTC

18 points

1 comment6 min readEA link

(www.lesswrong.com)

Shallow review of live agendas in alignment & safety

Gavin27 Nov 2023 11:33 UTC

76 points

8 comments29 min readEA link

Ideas for improving epistemics in AI safety outreach

mic21 Aug 2023 19:56 UTC

31 points

0 comments3 min readEA link

(www.lesswrong.com)

Alignment Grantmaking is Funding-Limited Right Now [crosspost]

johnswentworth2 Aug 2023 20:37 UTC

82 points

13 comments1 min readEA link

(www.lesswrong.com)

Transcripts of interviews with AI researchers

Vael Gates9 May 2022 6:03 UTC

140 points

14 comments2 min readEA link

AISafety.world is a map of the AIS ecosystem

Hamish McDoodles6 Apr 2023 11:47 UTC

190 points

8 comments1 min readEA link

Keep Chasing AI Safety Press Coverage

Gil4 Apr 2023 20:40 UTC

106 points

16 comments5 min readEA link

Survey on the acceleration risks of our new RFPs to study LLM capabilities

Ajeya10 Nov 2023 23:59 UTC

38 points

1 comment8 min readEA link

Nobody’s on the ball on AGI alignment

leopold29 Mar 2023 14:26 UTC

327 points

65 comments9 min readEA link

(www.forourposterity.com)

Jobs that can help with the most important century

Holden Karnofsky12 Feb 2023 18:19 UTC

57 points

2 comments32 min readEA link

(www.cold-takes.com)

Announcing “Key Phenomena in AI Risk” (facilitated reading group)

nora9 May 2023 16:52 UTC

28 points

0 comments2 min readEA link

How MATS addresses “mass movement building” concerns

Ryan Kidd4 May 2023 0:55 UTC

79 points

4 comments1 min readEA link

Projects I would like to see (possibly at AI Safety Camp)

Linda Linsefors27 Sep 2023 21:27 UTC

9 points

0 comments1 min readEA link

Apply to lead a project during the next virtual AI Safety Camp

Linda Linsefors13 Sep 2023 13:29 UTC

16 points

0 comments1 min readEA link

(aisafety.camp)

Relationship between EA Community and AI safety

Tom Barnes18 Sep 2023 13:49 UTC

157 points

15 comments1 min readEA link

AI safety field-building survey: Talent needs, infrastructure needs, and relationship to EA

michel27 Oct 2023 21:08 UTC

67 points

3 comments9 min readEA link

Thread: Reflections on the AGI Safety Fundamentals course?

Clifford18 May 2023 13:11 UTC

27 points

7 comments1 min readEA link

Update on cause area focus working group

Bastian_Stern10 Aug 2023 1:21 UTC

140 points

18 comments5 min readEA link

Observations on the funding landscape of EA and AI safety

Vilhelm Skoglund2 Oct 2023 9:45 UTC

136 points

12 comments15 min readEA link

Why EA Community building

Rob Gledhill14 Jun 2023 20:48 UTC

73 points

7 comments5 min readEA link

Offering AI safety support calls for ML professionals

Vael Gates15 Feb 2024 23:48 UTC

52 points

1 comment1 min readEA link

AI Safety Memes Wiki

plex24 Jul 2024 18:53 UTC

6 points

0 comments1 min readEA link

(aisafety.info)

How the AI safety technical landscape has changed in the last year, according to some practitioners

tlevin26 Jul 2024 19:06 UTC

83 points

1 comment1 min readEA link

ML Summer Bootcamp Reflection: Aalto EA Finland

Aayush Kucheria12 Jan 2023 8:24 UTC

15 points

2 comments9 min readEA link

CEA seeks co-founder for AI safety group support spin-off

Agustín Covarrubias 🔸8 Apr 2024 15:42 UTC

62 points

0 comments4 min readEA link

Results of an informal survey on AI grantmaking

Scott Alexander21 Aug 2024 13:19 UTC

121 points

28 comments1 min readEA link

We need non-cybersecurity people [too]

Jarrah5 May 2024 0:11 UTC

32 points

0 comments2 min readEA link

Branding AI Safety Groups: A Field Guide

Agustín Covarrubias 🔸13 May 2024 17:17 UTC

44 points

6 comments1 min readEA link

AI Safety University Organizing: Early Takeaways from Thirteen Groups

Agustín Covarrubias 🔸2 Oct 2024 14:39 UTC

45 points

2 comments9 min readEA link

List of AI safety newsletters and other resources

Lizka1 May 2023 17:24 UTC

49 points

5 comments4 min readEA link

The longtermist AI governance landscape: a basic overview

Sam Clarke18 Jan 2022 12:58 UTC

166 points

13 comments9 min readEA link

Introducing Kairos: a new AI safety fieldbuilding organization (the new home for SPAR and FSP)

Agustín Covarrubias 🔸25 Oct 2024 21:59 UTC

71 points

2 comments2 min readEA link

Personal thoughts on careers in AI policy and strategy

carrickflynn27 Sep 2017 16:52 UTC

56 points

28 comments18 min readEA link

College technical AI safety hackathon retrospective—Georgia Tech

yixiong14 Nov 2024 13:34 UTC

18 points

0 comments5 min readEA link

(yixiong.substack.com)

Join AISafety.info’s Writing & Editing Hackathon (Aug 25-28) (Prizes to be won!)

leillustrations🔸5 Aug 2023 14:06 UTC

15 points

0 comments1 min readEA link

On running a city-wide university group

gergo6 Nov 2023 9:43 UTC

26 points

3 comments9 min readEA link

20+ tips, tricks, lessons and thoughts on hosting hackathons

gergo6 Nov 2023 10:59 UTC

14 points

0 comments11 min readEA link

MATS AI Safety Strategy Curriculum v2

DanielFilan7 Oct 2024 23:01 UTC

29 points

1 comment1 min readEA link

Apply for ARBOx: an ML safety intensive [deadline 13 Dec ’24]

Nick Marsh1 Dec 2024 18:13 UTC

20 points

1 comment1 min readEA link

AI Safety Microgrant Round

Chris Leong14 Nov 2022 4:25 UTC

81 points

3 comments3 min readEA link

Announcing an Empirical AI Safety Program

Joshc13 Sep 2022 21:39 UTC

64 points

7 comments2 min readEA link

Talent Needs of Technical AI Safety Teams

Ryan Kidd24 May 2024 0:46 UTC

51 points

11 comments14 min readEA link

ENAIS has launched a newsletter for AIS fieldbuilders

gergo22 Nov 2024 10:45 UTC

18 points

0 comments1 min readEA link

MATS Alumni Impact Analysis

utilistrutil2 Oct 2024 23:44 UTC

16 points

1 comment1 min readEA link

Air-gapping evaluation and support

Ryan Kidd26 Dec 2022 22:52 UTC

22 points

12 comments1 min readEA link

Cost-effectiveness analysis of ~1260 USD worth of social media ads for fellowship marketing

gergo25 Jan 2024 15:18 UTC

61 points

5 comments2 min readEA link

Why I think that teaching philosophy is high impact

Eleni_A19 Dec 2022 23:00 UTC

17 points

2 comments2 min readEA link

Vael Gates: Risks from Advanced AI (June 2022)

Vael Gates14 Jun 2022 0:49 UTC

45 points

5 comments30 min readEA link

What AI Safety Materials Do ML Researchers Find Compelling?

Vael Gates28 Dec 2022 2:03 UTC

130 points

12 comments1 min readEA link

Rethink Priorities is looking for a (Co-)Founder for a New Project: Field Building in Universities for AI Policy Careers in the US

KevinN28 Aug 2023 16:01 UTC

59 points

0 comments6 min readEA link

(careers.rethinkpriorities.org)

Analysis of AI Safety surveys for field-building insights

Ash Jafari5 Dec 2022 17:37 UTC

30 points

7 comments5 min readEA link

Dutch AI Safety Coordination Forum: An Experiment

HenningB21 Nov 2023 16:18 UTC

21 points

0 comments4 min readEA link

Announcing AISafety.info’s Write-a-thon (June 16-18) and Second Distillation Fellowship (July 3-October 2)

StevenKaas3 Jun 2023 2:03 UTC

12 points

1 comment1 min readEA link

Advice for Entering AI Safety Research

stecas2 Jun 2023 20:46 UTC

14 points

1 comment1 min readEA link

[Question] Does China have AI alignment resources/institutions? How can we prioritize creating more?

JakubK4 Aug 2022 19:23 UTC

18 points

9 comments1 min readEA link

AI Safety Fundamentals: An Informal Cohort Starting Soon! (cross-posted to lesswrong.com)

Tiago4 Jun 2023 18:21 UTC

6 points

0 comments1 min readEA link

(www.lesswrong.com)

We all teach: here’s how to do it better

Michael Noetel 🔸30 Sep 2022 2:06 UTC

172 points

12 comments24 min readEA link

[Question] Workshop (hackathon, residence program, etc.) about for-profit AI Safety projects?

Roman Leventov26 Jan 2024 9:49 UTC

13 points

1 comment1 min readEA link

Amplify is hiring! Work with us to support field-building initiatives through digital marketing

gergo28 Aug 2024 14:12 UTC

28 points

1 comment4 min readEA link

Printable resources for AI Safety tabling

gergo28 Aug 2024 9:39 UTC

29 points

0 comments1 min readEA link

You can run more than one fellowship per semester if you want to

gergo12 Dec 2023 8:49 UTC

6 points

1 comment3 min readEA link

Set up an AIS newsletter for your group in 10 minutes per month (June edition)

gergo18 Jun 2024 6:31 UTC

34 points

0 comments1 min readEA link

[Question] Best introductory overviews of AGI safety?

JakubK13 Dec 2022 19:04 UTC

21 points

8 comments2 min readEA link

(www.lesswrong.com)

We are sharing a new website template for AI Safety groups!

AIS Hungary13 Mar 2024 16:40 UTC

10 points

2 comments1 min readEA link

Launching Amplify: Recieve marketing support for your local groups and other field-building initiatives

gergo28 Aug 2024 14:12 UTC

24 points

0 comments2 min readEA link

ML4Good UK—Applications Open

Nia2 Jan 2024 18:20 UTC

21 points

0 comments1 min readEA link

The Hasty Start of Budapest AI Safety, 6-month update from a non-STEM founder

gergo3 Jan 2024 12:56 UTC

9 points

1 comment7 min readEA link

AIS Hungary is hiring a part-time Technical Lead! (Deadline: Dec 31st)

gergo17 Dec 2024 14:08 UTC

9 points

0 comments2 min readEA link

Learning Math in Time for Alignment

Nicholas / Heather Kross9 Jan 2024 1:02 UTC

10 points

0 comments1 min readEA link

[Job ad] MATS is hiring!

Ryan Kidd9 Oct 2024 20:23 UTC

18 points

0 comments5 min readEA link

Where on the continuum of pure EA to pure AIS should you be? (Uni Group Organizers Focus)

jessica_mccurdy🔸26 Jun 2023 23:46 UTC

43 points

0 comments5 min readEA link

Problems of people new to AI safety and my project ideas to mitigate them

Igor Ivanov3 Mar 2023 17:35 UTC

19 points

0 comments7 min readEA link

Talk to me about your summer/career plans

Akash31 Jan 2023 18:29 UTC

31 points

0 comments1 min readEA link

A Brief Overview of AI Safety/Alignment Orgs, Fields, Researchers, and Resources for ML Researchers

Austin Witte2 Feb 2023 6:19 UTC

18 points

5 comments2 min readEA link

Interviews with 97 AI Researchers: Quantitative Analysis

Maheen Shermohammed2 Feb 2023 4:50 UTC

76 points

4 comments7 min readEA link

Predicting researcher interest in AI alignment

Vael Gates2 Feb 2023 0:58 UTC

30 points

0 comments21 min readEA link

(docs.google.com)

Apply for MATS Winter 2023-24!

utilistrutil21 Oct 2023 2:34 UTC

34 points

2 comments5 min readEA link

(www.lesswrong.com)

I designed an AI safety course (for a philosophy department)

Eleni_A23 Sep 2023 21:56 UTC

27 points

3 comments2 min readEA link

What we learned from running an Australian AI Safety Unconference

Alexander Saeri26 Oct 2023 0:46 UTC

34 points

0 comments5 min readEA link

Stress Externalities More in AI Safety Pitches

NickGabs26 Sep 2022 20:31 UTC

31 points

9 comments2 min readEA link

Executive Director for AIS Brussels—Expression of interest

gergo19 Dec 2024 9:15 UTC

10 points

0 comments4 min readEA link

Alignment Megaprojects: You’re Not Even Trying to Have Ideas

Nicholas / Heather Kross12 Jul 2023 23:39 UTC

7 points

1 comment1 min readEA link

Arkose: Organizational Updates & Ways to Get Involved

Arkose1 Aug 2024 13:03 UTC

28 points

1 comment1 min readEA link

“AI Risk Discussions” website: Exploring interviews from 97 AI Researchers

Vael Gates2 Feb 2023 1:00 UTC

46 points

1 comment1 min readEA link

AI Safety Unconference NeurIPS 2022

Orpheus_Lummis7 Nov 2022 15:39 UTC

13 points

5 comments1 min readEA link

(aisafetyevents.org)

We Ran an Alignment Workshop

aiden ament21 Jan 2023 5:37 UTC

6 points

0 comments3 min readEA link

ARENA 2.0 - Impact Report

TheMcDouglas26 Sep 2023 17:13 UTC

17 points

0 comments13 min readEA link

Executive Director for AIS France—Expression of interest

gergo19 Dec 2024 8:11 UTC

20 points

0 comments4 min readEA link

New Canada AI Safety & Governance community

Wyatt Tessari L'Allié29 Aug 2022 15:58 UTC

32 points

2 comments1 min readEA link

ML4Good Brasil—Applications Open

Nia3 May 2024 10:39 UTC

28 points

1 comment1 min readEA link

Part 3: A Proposed Approach for AI Safety Movement Building: Projects, Professions, Skills, and Ideas for the Future [long post][bounty for feedback]

PeterSlattery22 Mar 2023 0:54 UTC

22 points

8 comments32 min readEA link

[Question] Launching Applications for the Global AI Safety Fellowship 2025!

Impact Academy27 Nov 2024 15:33 UTC

9 points

1 comment1 min readEA link

Recruit the World’s best for AGI Alignment

Greg_Colbourn30 Mar 2023 16:41 UTC

34 points

8 comments22 min readEA link

Why people want to work on AI safety (but don’t)

Emily Grundy24 Jan 2023 6:41 UTC

70 points

10 comments7 min readEA link

AI Safety field-building projects I’d like to see

Akash11 Sep 2022 23:45 UTC

31 points

4 comments6 min readEA link

(www.lesswrong.com)

Formalize the Hashiness Model of AGI Uncontainability

Remmelt9 Nov 2024 16:10 UTC

2 points

0 comments5 min readEA link

(docs.google.com)

All AGI Safety questions welcome (especially basic ones) [April 2023]

StevenKaas8 Apr 2023 4:21 UTC

111 points

174 comments1 min readEA link

Stampy’s AI Safety Info—New Distillations #1 [March 2023]

markov7 Apr 2023 11:35 UTC

19 points

0 comments2 min readEA link

(aisafety.info)

[Question] Platform for Project Spitballing? (e.g., for AI field building)

Marcel D3 Apr 2023 15:45 UTC

7 points

2 comments1 min readEA link

Resources I send to AI researchers about AI safety

Vael Gates11 Jan 2023 1:24 UTC

43 points

0 comments1 min readEA link

SERI MATS—Summer 2023 Cohort

a_e_r8 Apr 2023 15:32 UTC

36 points

2 comments1 min readEA link

No comments.

Build­ing the field of AI safety

Related entries

Building the field of AI safety