AI safety resources and materials

TagLast edit: 5 Oct 2022 14:10 UTC by Lizka

AI safety resources and materials include syllabi and other educational content related to AI safety.

List of AI safety newsletters and other resources

Lizka1 May 2023 17:24 UTC

49 points

5 comments4 min readEA link

How to pursue a career in technical AI alignment

Charlie Rogers-Smith4 Jun 2022 21:36 UTC

270 points

9 comments39 min readEA link

List of AI safety courses and resources

Daniel del Castillo6 Sep 2021 14:26 UTC

51 points

8 comments1 min readEA link

Cost-effectiveness of student programs for AI safety research

Center for AI Safety10 Jul 2023 17:23 UTC

53 points

7 comments15 min readEA link

All AGI Safety questions welcome (especially basic ones) [April 2023]

StevenKaas8 Apr 2023 4:21 UTC

111 points

173 comments2 min readEA link

Modeling the impact of AI safety field-building programs

Center for AI Safety10 Jul 2023 17:22 UTC

86 points

0 comments7 min readEA link

Linkpost: Redwood Research reading list

Julian Stastny10 Jul 2025 19:21 UTC

18 points

0 comments1 min readEA link

(redwoodresearch.substack.com)

MATS AI Safety Strategy Curriculum v2

DanielFilan7 Oct 2024 23:01 UTC

29 points

1 comment13 min readEA link

[Linkpost] AI Alignment, Explained in 5 Points (updated)

Daniel_Eth18 Apr 2023 8:09 UTC

31 points

2 comments1 min readEA link

(medium.com)

Announcing aisafety.training

JJ Hepburn17 Jan 2023 1:55 UTC

110 points

4 comments1 min readEA link

Cost-effectiveness of professional field-building programs for AI safety research

Center for AI Safety10 Jul 2023 17:26 UTC

38 points

2 comments18 min readEA link

The Importance of AI Alignment, explained in 5 points

Daniel_Eth11 Feb 2023 2:56 UTC

50 points

4 comments13 min readEA link

AI Safety Arguments: An Interactive Guide

Lukas Trötzmüller🔸1 Feb 2023 19:21 UTC

32 points

5 comments3 min readEA link

Onboarding students to EA/AIS in 4 days with an intensive fellowship

gergo5 Dec 2023 10:07 UTC

17 points

0 comments4 min readEA link

AI Safety University Organizing: Early Takeaways from Thirteen Groups

Agustín Covarrubias 🔸2 Oct 2024 14:39 UTC

46 points

3 comments9 min readEA link

Distribution Shifts and The Importance of AI Safety

Leon Lang29 Sep 2022 22:38 UTC

7 points

0 comments9 min readEA link

[Question] How to create curriculum for self-study towards AI alignment work?

OIUJHKDFS7 Jan 2023 19:53 UTC

10 points

5 comments1 min readEA link

Technical AI Safety research taxonomy attempt (2025)

Ben Plaut27 Aug 2025 14:07 UTC

10 points

3 comments2 min readEA link

AI Risk Intro 1: Advanced AI Might Be Very Bad

L Rudolf L11 Sep 2022 10:57 UTC

22 points

0 comments30 min readEA link

Poster Session on AI Safety

Neil Crawford12 Nov 2022 3:50 UTC

8 points

0 comments4 min readEA link

How to become an AI safety researcher

peterbarnett12 Apr 2022 11:33 UTC

114 points

15 comments14 min readEA link

Thread: Reflections on the AGI Safety Fundamentals course?

Clifford18 May 2023 13:11 UTC

27 points

7 comments1 min readEA link

(My suggestions) On Beginner Steps in AI Alignment

Joseph Bloom22 Sep 2022 15:32 UTC

37 points

3 comments9 min readEA link

AGISF adaptation for in-person groups

Sam Marks17 Jan 2023 18:33 UTC

30 points

0 comments3 min readEA link

(www.lesswrong.com)

Levelling Up in AI Safety Research Engineering

GabeM2 Sep 2022 4:59 UTC

167 points

21 comments17 min readEA link

$20K in Bounties for AI Safety Public Materials

TW1235 Aug 2022 2:57 UTC

45 points

11 comments6 min readEA link

What are some other introductions to AI safety?

Vishakha Agrawal17 Feb 2025 11:48 UTC

9 points

0 comments7 min readEA link

(aisafety.info)

[Question] (More) recommendations for non-technical readings on AI?

Joseph25 Sep 2025 1:12 UTC

9 points

0 comments2 min readEA link

What are the “no free lunch” theorems?

Vishakha Agrawal4 Feb 2025 2:02 UTC

3 points

0 comments1 min readEA link

(aisafety.info)

Top AI safety newsletters, books, podcasts, etc – new AISafety.com resource

Bryce Robertson4 Mar 2025 17:01 UTC

9 points

0 comments1 min readEA link

Overview: AI Safety Outreach Grassroots Orgs

Severin12 May 2025 14:38 UTC

11 points

0 comments2 min readEA link

How I switched careers from software engineer to AI policy operations

Lucie Philippon 🔸13 Apr 2025 6:41 UTC

14 points

1 comment5 min readEA link

(www.lesswrong.com)

New homepage for AI safety resources – AISafety.com redesign

Bryce Robertson5 Nov 2025 10:28 UTC

22 points

5 comments1 min readEA link

AI Safety Info Distillation Fellowship

robertskmiles17 Feb 2023 16:16 UTC

80 points

1 comment3 min readEA link

We are sharing a new website template for AI Safety groups!

AIS Hungary13 Mar 2024 16:40 UTC

11 points

2 comments1 min readEA link

All AGI Safety questions welcome (especially basic ones) [May 2023]

StevenKaas8 May 2023 22:30 UTC

19 points

11 comments2 min readEA link

[Question] How did the AI Safety talent pipeline come to work so well?

Alejandro Acelas 🔸24 Jul 2025 7:24 UTC

7 points

2 comments1 min readEA link

China x AI Reference List: August 2025 Update

Sarah Weiler9 Sep 2025 7:31 UTC

32 points

2 comments42 min readEA link

(docs.google.com)

AI is advancing fast

Vishakha Agrawal23 Apr 2025 11:04 UTC

2 points

2 comments2 min readEA link

(aisafety.info)

AI Safety Fundamentals: An Informal Cohort Starting Soon! (cross-posted to lesswrong.com)

Tiago4 Jun 2023 18:21 UTC

6 points

0 comments1 min readEA link

(www.lesswrong.com)

Concrete Steps to Get Started in Transformer Mechanistic Interpretability

Neel Nanda26 Dec 2022 13:00 UTC

18 points

0 comments12 min readEA link

Project idea: Aggregation of events for our new era

Julian Nalenz26 Jan 2025 18:16 UTC

8 points

1 comment3 min readEA link

AI Safety & Entrepreneurship v1.0

Chris Leong26 Apr 2025 14:37 UTC

28 points

0 comments2 min readEA link

Open Philanthropy is passing AI safety university group funding to Kairos

abergal22 Jul 2025 17:11 UTC

55 points

0 comments1 min readEA link

An audio version of the alignment problem from a deep learning perspective by Richard Ngo Et Al

Miguel3 Feb 2023 19:32 UTC

18 points

0 comments1 min readEA link

(www.whitehatstoic.com)

Map of AI Safety v2

Bryce Robertson15 Apr 2025 13:04 UTC

59 points

6 comments1 min readEA link

Learning as much Deep Learning math as I could in 24 hours

Phosphorous8 Jan 2023 2:19 UTC

58 points

6 comments7 min readEA link

Overview of recent international demonstrations against AI (AI Protest Actions #1)

Rachel Shu17 Jul 2025 20:22 UTC

17 points

2 comments5 min readEA link

My attempt at explaining the case for AI risk in a straightforward way

JulianHazell25 Mar 2023 16:32 UTC

25 points

7 comments18 min readEA link

(muddyclothes.substack.com)

AI’s goals may not match ours

Vishakha Agrawal28 May 2025 12:07 UTC

2 points

0 comments3 min readEA link

What AI Safety Materials Do ML Researchers Find Compelling?

Vael Gates28 Dec 2022 2:03 UTC

130 points

12 comments2 min readEA link

Summary of 80k’s AI problem profile

JakubK1 Jan 2023 7:48 UTC

19 points

0 comments5 min readEA link

(www.lesswrong.com)

Your AI Safety org could get EU funding up to €9.08M. Here’s how (+ free personalized support) Update: Webinar 18/8 Link Below

SamuelK22 Jul 2025 17:06 UTC

16 points

0 comments3 min readEA link

[Question] Idea: Repository for AI Safety Presentations

Eitan6 Jan 2025 13:04 UTC

14 points

3 comments1 min readEA link

Seeking input on a list of AI books for broader audience

Darren McKee27 Feb 2023 22:40 UTC

49 points

14 comments5 min readEA link

AI Safety For Dummies (Like Me)

Madhav Malhotra24 Aug 2022 20:26 UTC

22 points

7 comments20 min readEA link

A map of work needed to achieve safe AI

Tristan Katz11 Sep 2025 11:33 UTC

16 points

0 comments1 min readEA link

[Question] Best introductory overviews of AGI safety?

JakubK13 Dec 2022 19:04 UTC

21 points

8 comments2 min readEA link

(www.lesswrong.com)

Some AI safety project & research ideas/questions for short and long timelines

Lloy2 🔹8 Aug 2025 21:08 UTC

13 points

0 comments5 min readEA link

Map of all 40 copyright suits v. AI in U.S.

Remmelt26 Mar 2025 7:57 UTC

16 points

0 comments1 min readEA link

(chatgptiseatingtheworld.com)

AI may attain human level soon

Vishakha Agrawal23 Apr 2025 11:10 UTC

2 points

1 comment2 min readEA link

(aisafety.info)

New AI risk intro from Vox [link post]

JakubK21 Dec 2022 5:50 UTC

7 points

1 comment2 min readEA link

(www.vox.com)

AI Safety Executive Summary

Sean Osier6 Sep 2022 8:26 UTC

20 points

2 comments5 min readEA link

(seanosier.notion.site)

[Question] What should I read about defining AI “hallucination?”

James-Hartree-Law23 Jan 2025 1:00 UTC

2 points

0 comments1 min readEA link

Introducing Deep Dive, a 201 AI policy course

Kambar17 Jun 2025 16:50 UTC

31 points

2 comments2 min readEA link

Uncontrollable AI as an Existential Risk

Karl von Wendt9 Oct 2022 10:37 UTC

28 points

0 comments16 min readEA link

An A.I. Safety Presentation at RIT

Nicholas Kross27 Mar 2023 23:49 UTC

5 points

0 comments1 min readEA link

(www.youtube.com)

There should be a public adversarial collaboration on AI x-risk

pradyuprasad23 Jan 2023 4:09 UTC

56 points

5 comments2 min readEA link

Announcement: Learning Theory Online Course

Yegreg28 Jan 2025 8:32 UTC

5 points

0 comments3 min readEA link

(www.lesswrong.com)

Introducing the Mox Guest Program

Austin1 Oct 2025 18:38 UTC

34 points

0 comments2 min readEA link

(moxsf.com)

New 80,000 Hours problem profile on the risks of power-seeking AI

Zershaaneh Qureshi28 Oct 2025 14:37 UTC

45 points

0 comments2 min readEA link

Human-level is not the limit

Vishakha Agrawal23 Apr 2025 11:16 UTC

3 points

0 comments2 min readEA link

(aisafety.info)

EA Netherlands’ guide to AI safety careers

James Herbert16 Jan 2025 17:22 UTC

25 points

0 comments1 min readEA link

(effectiefaltruisme.nl)

AI may pursue goals

Vishakha Agrawal28 May 2025 12:04 UTC

2 points

0 comments1 min readEA link

AGI Safety.

Jensen1130 Aug 2025 13:46 UTC

1 point

0 comments3 min readEA link

Big list of AI safety videos

JakubK9 Jan 2023 6:09 UTC

9 points

0 comments1 min readEA link

(docs.google.com)

China x AI Reference List

Saad Siddiqui13 Mar 2024 18:57 UTC

61 points

3 comments3 min readEA link

(docs.google.com)

AI Risk Intro 2: Solving The Problem

L Rudolf L24 Sep 2022 9:33 UTC

11 points

0 comments28 min readEA link

(www.perfectlynormal.co.uk)

What’s going on in video in AI Safety these days? (A list)

ChanaMessinger15 Sep 2025 20:30 UTC

59 points

11 comments4 min readEA link

The road from human-level to superintelligent AI may be short

Vishakha Agrawal23 Apr 2025 11:19 UTC

3 points

0 comments2 min readEA link

(aisafety.info)

Seeking feedback on: AIS x-risk post for general public

Mike Mantell8 Dec 2025 16:36 UTC

1 point

0 comments14 min readEA link

What are the differences between AGI, transformative AI, and superintelligence?

Vishakha Agrawal23 Jan 2025 10:11 UTC

12 points

0 comments3 min readEA link

(aisafety.info)

MATS 8.0 Research Projects

Jonathan Michala8 Sep 2025 21:36 UTC

9 points

0 comments1 min readEA link

(substack.com)

How do fictional stories illustrate AI misalignment?

Vishakha Agrawal15 Jan 2025 6:16 UTC

4 points

0 comments2 min readEA link

(aisafety.info)

Applications Now Open for Deep Dive: A 201 AI Policy Course by ENAIS

Kambar2 Jul 2025 8:32 UTC

10 points

5 comments1 min readEA link

How To Become A Mechanistic Interpretability Researcher

Neel Nanda2 Sep 2025 23:38 UTC

31 points

0 comments55 min readEA link

Power-Seeking AI and Existential Risk

antoniofrancaib11 Oct 2022 21:47 UTC

10 points

0 comments8 min readEA link

Problems of people new to AI safety and my project ideas to mitigate them

Igor Ivanov3 Mar 2023 17:35 UTC

20 points

0 comments7 min readEA link

My experience building mathematical ML skills with a course from UIUC

Naoya Okamoto9 Jun 2024 11:41 UTC

2 points

0 comments10 min readEA link

ENAIS has launched a newsletter for AIS fieldbuilders

gergo22 Nov 2024 10:45 UTC

25 points

0 comments1 min readEA link

A Potential Strategy for AI Safety — Chain of Thought Monitorability

Strad Slater19 Sep 2025 18:42 UTC

3 points

1 comment7 min readEA link

(williamslater2003.medium.com)

“AI Risk Discussions” website: Exploring interviews from 97 AI Researchers

Vael Gates2 Feb 2023 1:00 UTC

46 points

1 comment1 min readEA link

Let’s talk about uncontrollable AI

Karl von Wendt9 Oct 2022 10:37 UTC

12 points

2 comments3 min readEA link

Highly Opinionated Advice on How to Write ML Papers

Neel Nanda12 May 2025 1:59 UTC

22 points

0 comments32 min readEA link

Resources I send to AI researchers about AI safety

Vael Gates11 Jan 2023 1:24 UTC

43 points

0 comments1 min readEA link

What are some good podcasts about AI safety?

Vishakha Agrawal17 Feb 2025 10:32 UTC

9 points

1 comment1 min readEA link

(aisafety.info)

No comments.

AI safety re­sources and materials

Related entries

AI safety resources and materials