Insofar as you are recommending the jobs but not endorsing the organization, I think it would be good to be fairly explicit about this in the job listing. The current short description of OpenAI seems pretty positive to me:
OpenAI is a leading AI research and product company, with teams working on alignment, policy, and security. You can read more about considerations around working at a leading AI company in our career review on the topic. They are also currently the subject of news stories relating to their safety work.
I think this should say something like “We recommend jobs at OpenAI because we think these specific positions may be high impact. We would not necessarily recommend working at other jobs at OpenAI (especially jobs which increase AI capabilities).”
I also don’t know what to make of the sentence “They are also currently the subject of news stories relating to their safety work.” Is this an allusion to the recent exodus of many safety people from OpenAI? If so, I think it’s misleading and gives far too positive an impression.
Relatedly, I think that the “Should you work at a leading AI company?” article shouldn’t start with a pros and cons list which sort of buries the fact that you might contribute to building extremely dangerous AI.
I think “Risk of contributing to the development of harmful AI systems” should at least be at the top of the cons list. But overall this sort of reminds me of my favorite graphic from 80k:
?? It’s the second bullet point in the cons list, and reemphasized in the third bullet?
If you’re saying “obviously this is the key determinant of whether you should work at a leading AI company so there shouldn’t even be a pros / cons table”, then obviously 80K disagrees given they recommend some such roles (and many other people (e.g. me) also disagree so this isn’t 80K ignoring expert consensus). In that case I think you should try to convince 80K on the object level rather than applying political pressure.
This thread feels like a fine place for people to express their opinion as a stakeholder.
Like, I don’t even know how to engage with 80k staff on this on the object level, and seems like the first thing to do is to just express my opinion (and like, they can then choose to respond with argument).
Yeah, I think this needs updating to something more concrete. We put it up while ‘everything was happening’ but I’ve neglected to change it, which is my mistake and will probably prioritize fixing over the next few days.
Insofar as you are recommending the jobs but not endorsing the organization, I think it would be good to be fairly explicit about this in the job listing. The current short description of OpenAI seems pretty positive to me:
I think this should say something like “We recommend jobs at OpenAI because we think these specific positions may be high impact. We would not necessarily recommend working at other jobs at OpenAI (especially jobs which increase AI capabilities).”
I also don’t know what to make of the sentence “They are also currently the subject of news stories relating to their safety work.” Is this an allusion to the recent exodus of many safety people from OpenAI? If so, I think it’s misleading and gives far too positive an impression.
Relatedly, I think that the “Should you work at a leading AI company?” article shouldn’t start with a pros and cons list which sort of buries the fact that you might contribute to building extremely dangerous AI.
I think “Risk of contributing to the development of harmful AI systems” should at least be at the top of the cons list. But overall this sort of reminds me of my favorite graphic from 80k:
?? It’s the second bullet point in the cons list, and reemphasized in the third bullet?
If you’re saying “obviously this is the key determinant of whether you should work at a leading AI company so there shouldn’t even be a pros / cons table”, then obviously 80K disagrees given they recommend some such roles (and many other people (e.g. me) also disagree so this isn’t 80K ignoring expert consensus). In that case I think you should try to convince 80K on the object level rather than applying political pressure.
This thread feels like a fine place for people to express their opinion as a stakeholder.
Like, I don’t even know how to engage with 80k staff on this on the object level, and seems like the first thing to do is to just express my opinion (and like, they can then choose to respond with argument).
(Copied from reply to Raemon)
Yeah, I think this needs updating to something more concrete. We put it up while ‘everything was happening’ but I’ve neglected to change it, which is my mistake and will probably prioritize fixing over the next few days.