I think an assumption 80k makes is something like “well if our audience thinks incredibly deeply about the Safety problem and what it would be like to work at a lab and the pressures they could be under while there, then we’re no longer accountable for how this could go wrong. After all, we provided vast amounts of information on why and how people should do their own research before making such a decision”.
The problem is, that is not how most people make decisions. No matter how much rational thinking is promoted, we’re first and foremost emotional creatures that care about things like status. So, if 80k decides to have a podcast with the Superalignment team lead, then they’re effectively promoting the work of OpenAI. That will make people want to work for OpenAI. This is an inescapable part of the Halo effect.
Lastly, 80k is explicitly targeting very young people who, no offense, probably don’t have the life experience to imagine themselves in a workplace where they have to resist incredible pressures to not conform, such as not sharing interpretability insights with capabilities teams.
The whole exercise smacks of nativity and I’m very confident we’ll look back and see it as an incredibly obvious mistake in hindsight.
I think an assumption 80k makes is something like “well if our audience thinks incredibly deeply about the Safety problem and what it would be like to work at a lab and the pressures they could be under while there, then we’re no longer accountable for how this could go wrong. After all, we provided vast amounts of information on why and how people should do their own research before making such a decision”.
The problem is, that is not how most people make decisions. No matter how much rational thinking is promoted, we’re first and foremost emotional creatures that care about things like status. So, if 80k decides to have a podcast with the Superalignment team lead, then they’re effectively promoting the work of OpenAI. That will make people want to work for OpenAI. This is an inescapable part of the Halo effect.
Lastly, 80k is explicitly targeting very young people who, no offense, probably don’t have the life experience to imagine themselves in a workplace where they have to resist incredible pressures to not conform, such as not sharing interpretability insights with capabilities teams.
The whole exercise smacks of nativity and I’m very confident we’ll look back and see it as an incredibly obvious mistake in hindsight.