Vasco Grilo🔸 answers I’m interviewing Jan Leike, co-lead of OpenAI’s new Superalignment project. What should I ask him?

[Vasco Grilo🔸]

Thanks for asking!

How much risk of human extinction are you willing to take in a large training run (e.g. one to train GPT-5)?

[NickLaing]

I love this question, because surely there has to be a real maximum probability here.