Joe_Carlsmith

Karma: 3,441

Senior research analyst at Open Philanthropy. Doctorate in philosophy at the University of Oxford. Opinions my own.

Video and transcript of talk on automating alignment research

Joe_CarlsmithApr 30, 2025, 5:43 PM

11 points

1 comment EA link

(joecarlsmith.com)

Can we safely automate alignment research?

Joe_CarlsmithApr 30, 2025, 5:37 PM

13 points

1 comment EA link

(joecarlsmith.com)

AI for AI safety

Joe_CarlsmithMar 14, 2025, 3:00 PM

34 points

1 comment EA link

(joecarlsmith.substack.com)

Paths and waystations in AI safety

Joe_CarlsmithMar 11, 2025, 6:52 PM

22 points

2 comments EA link

(joecarlsmith.substack.com)

When should we worry about AI power-seeking?

Joe_CarlsmithFeb 19, 2025, 7:44 PM

21 points

2 comments EA link

(joecarlsmith.substack.com)

Joe_Carlsmith Feb 19, 2025, 8:13 AM
4 points
0 ∶ 0
in reply to: Lizka’s comment on: Fake thinking and real thinking
Very glad to hear it, Lizka :) -- and thanks for letting me know.

What is it to solve the alignment problem?

Joe_CarlsmithFeb 13, 2025, 6:42 PM

25 points

1 comment EA link

(joecarlsmith.substack.com)

How do we solve the alignment problem?

Joe_CarlsmithFeb 13, 2025, 6:27 PM

28 points

1 comment EA link

(joecarlsmith.substack.com)

Fake thinking and real thinking

Joe_CarlsmithJan 28, 2025, 8:05 PM

75 points

3 comments EA link

(joecarlsmith.substack.com)

Takes on “Alignment Faking in Large Language Models”

Joe_CarlsmithDec 18, 2024, 6:22 PM

72 points

1 comment EA link

Incentive design and capability elicitation

Joe_CarlsmithNov 12, 2024, 8:56 PM

9 points

0 comments EA link

Option control

Joe_CarlsmithNov 4, 2024, 5:54 PM

11 points

0 comments EA link

Motivation control

Joe_CarlsmithOct 30, 2024, 5:15 PM

18 points

0 comments EA link

How might we solve the alignment problem? (Part 1: Intro, summary, ontology)

Joe_CarlsmithOct 28, 2024, 9:57 PM

18 points

0 comments EA link

Video and transcript of presentation on Otherness and control in the age of AGI

Joe_CarlsmithOct 8, 2024, 10:30 PM

18 points

1 comment EA link

What is it to solve the alignment problem? (Notes)

Joe_CarlsmithAug 24, 2024, 9:19 PM

32 points

1 comment EA link

Value fragility and AI takeover

Joe_CarlsmithAug 5, 2024, 9:28 PM

38 points

3 comments EA link

A framework for thinking about AI power-seeking

Joe_CarlsmithJul 24, 2024, 10:41 PM

44 points

11 comments EA link

Loving a world you don’t trust

Joe_CarlsmithJun 18, 2024, 7:31 PM

65 points

7 comments EA link

On “first critical tries” in AI alignment

Joe_CarlsmithJun 5, 2024, 12:19 AM

29 points

3 comments EA link

Keyboard shortcuts

Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).

Keys shown in grey (e.g., ?) do not require any modifier keys.

General
? Show keyboard shortcuts
Esc Hide keyboard shortcuts

Site navigation
h Go to Home (a.k.a. “Frontpage”) view
f Go to Featured (a.k.a. “Curated”) view
a Go to All (a.k.a. “Community”) view
m Go to Meta view
v Go to Tags view
c Go to Recent Comments view
r Go to Archive view
q Go to Sequences view
t Go to About page
u Go to User or Login page
o Go to Inbox page

Page navigation
, Jump up to top of page
. Jump down to bottom of page
/ Jump to top of comments section
s Search

Page actions
n New post or comment
e Edit current post

Post/comment list views
. Focus next entry in list
, Focus previous entry in list
; Cycle between links in focused entry
Enter Go to currently focused entry
Esc Unfocus currently focused entry
] Go to next page
[ Go to previous page
\ Go to first page
e Edit currently focused post

Editor
k Bold text
i Italic text
l Insert hyperlink
q Blockquote text

Appearance
= Increase text size
- Decrease text size
0 Reset to default text size
′ Cycle through content width settings
1 Switch to default theme [A]
2 Switch to dark theme [B]
3 Switch to grey theme [C]
4 Switch to ultramodern theme [D]
5 Switch to simple theme [E]
6 Switch to brutalist theme [F]
7 Switch to ReadTheSequences theme [G]
8 Switch to classic Less Wrong theme [H]
9 Switch to modern Less Wrong theme [I]
; Open theme tweaker
Enter Save changes and close theme tweaker
Esc Close theme tweaker (without saving)

Slide shows
l Start/resume slideshow
Esc Exit slideshow
→↓ Next slide
←↑ Previous slide
Space Reset slide zoom

Miscellaneous
x Switch to next view on user page
z Switch to previous view on user page
` Toggle compact comment list view
g Toggle anti-kibitzer