I’ve spent the last couple of years working on AI risk at Coefficient Giving, but it’s only in the last few months that I’ve started to feel more viscerally that transformative AI is likely to happen and potentially very soon. To be honest, it probably took me longer than it should have.
This shift has been a really difficult emotional experience and I’ve been struggling at times. I imagine others reading this Forum might relate, I’m sorry if so.
Last month, I went home to spend Passover with my family, and I realized I needed to say something. It’s just getting too real to sit with people I love and have normal conversations without mentioning how drastically and how quickly I think things could change for all of us. So I wrote them a letter describing where I think things could be headed.
CG has now published it on our Substack. It’s written for a general audience (well, specifically my family), not for people already deep in these topics. I thought I’d share it here in case it’s useful, whether you’re new to these ideas or have been working in the field for a while and thinking about having similar conversations with people you love. I hope it helps.
(I should also caveat that I don’t consider myself a subject-matter expert, so I wouldn’t update on specific substantive claims as independent evidence. I didn’t want that to stop me from writing something though, and I linked various other resources from people who know more than me. Feedback welcome, of course!)
Hi George. Thanks for sharing. I am open to bets against short transformative AI (TAI) timelines, or what they supposedly imply, up to 10 k$. Do you see any that we could make that is good for both of us under our own views?
As someone who ruined Greek Easter recently, I strongly relate.
Reading about existential risks, then talking with normal people—it feels like multiverse travel. Most people don’t register the danger. Not the immediate risks like climate change or nuclear war. Certainly not AI.
I remember a clip from Cunk on Earth, a British mockumentary. Philomena Cunk, the fictional TV host, asked an expert if it feels comforting that we don’t have nuclear weapons anymore. The expert said no—every major power has them. When Cunk realized this is true and how terrible this is, she broke down and cried.
That’s the reaction people should have. When someone says “the Earth is getting warmer” or “AI video models are improving,” people should cry. Instead they talk about it like it’s happening on another planet.
That is the hardest part when I think about these things.