I think by default good ideas like this never really end up happening, which is sad. Do you or other people have thoughts on how to make your idea actually happen? Some quick thoughts from me:
Just highlight this idea on the Forum more often/prominently
People giving career advice or mentorship to people interested in EA-aligned research careers mention this as one way of testing fit, having an impact, etc.
Heap an appropriate amount of status and attention on good instances of this having been done
That requires it to be done at least once first, of course, but can then increase the rate
E.g., Aaron Gertler could feature it in the EA Forum Digest newsletter, people could make positive comments on the post, someone can share it in a Facebook group and/or other newsletter
I know I found this sort of thing a useful and motivating signal when I started posting stuff (though not precisely this kind of stuff)
Publicly offer to provide financial prizes for good instances of this having been done
One way to do this could mirror Buck’s idea for getting more good book reviews to happen (see my other comment): “If it’s the kind of review I want, I give them $500 in return for them posting the review to EA Forum or LW with a “This post sponsored by the EAIF” banner at the top. (I’d also love to set up an impact purchase thing but that’s probably too complicated).”
Find case studies where someone found such a post useful or having written it helped someone get a good job or something, and then publicise those
As an aside, I decided to focus my shortform on critiques of public research rather than critiques of organizations/people, even though I think the latter is quite valuable too, since a) my intuition is that the former is less acrimonious, b) relatedly, critiques of organizations may be worse at training dispassionate analysis skills (vs eg tribalistic feelings or rhetoric), c) critiques of orgs or people might be easier for newbies to fuck up and d) I think empirically, critiques of organizations have a worse hit rate than critiques of research posts.
I think by default good ideas like this never really end up happening, which is sad. Do you or other people have thoughts on how to make your idea actually happen?
As you know, one of my interns is doing something adjacent to this idea (though framed in a different way), and I may convince another intern to do something similar (depending on their interests and specific project ideas in mind).
Yeah, good point—I guess a more directed version of “People giving career advice or mentorship to people interested in EA-aligned research careers mention this as one way of testing fit, having impact, etc.” is just people encouraging people they manage to do this, or maybe even hiring people with this partly in mind.
Though I think that that wouldn’t capture most of the potential value of this idea, since part of what’s good about is that, as you say, this idea:
requires relatively little training/guidance from external mentors, meaning
our movement devotes less scarce mentorship resources into this
people with worse social skills/network/geographical situation don’t feel (as much) at a disadvantage for getting the relevant training
(People who’ve already gone through a hiring process and have an at least somewhat more experienced researcher managing them will have an easier time than other people in testing fit, having impact, building skills, etc. in other ways as well.)
Yeah I agree that a major upside to this idea (and a key differentiator between it and other proposed interventions for fixing early stages of the research pipeline) is that it ought to be doable without as much guidance from external mentors. I guess my own willingness to suggest this as an intern project suggests that I believe it must comparatively be even more exciting for people without external guidance.
Another possible (but less realistic?) way to make this happen:
Organisations/researchers do something like encouraging red teaming of their own output, setting up a bounty/prize for high-quality instances of that, or similar
An example of something roughly like this is a post on the GiveWell blog that says at the start: “This is a guest post by David Barry, a GiveWell supporter. He emailed us at the end of December to point out some mistakes and issues in our cost-effectiveness calculations for deworming, and we asked him to write up his thoughts to share here. We made minor wording and organizational suggestions but have otherwise published as is; we have not vetted his sources or his modifications to our spreadsheet for comparing deworming and cash. Note that since receiving his initial email, we have discussed the possibility of paying him to do more work like this in the future.”
But I think GiveWell haven’t done that since then?
It seems like this might make sense and be mutually beneficial
Orgs/researchers presumably want more ways to increase the accuracy of their claims and conclusions
A good red teaming of their work might also highlight additional directions for further research and surface someone who’d be a good employee for that org or collaborator for that researcher
Red teaming of that work might provide a way for people to build skills and test fit for work on precisely the topics that the org/researcher presumably considers important and wants more people working on
But I’d guess that this is unlikely to happen in this form
I think this is mainly due to inertia plus people feeling averse to the idea
Another argument against is that, for actually directly improving the accuracy of some piece of work, it’s probably more effective to pay people who are already know to be good at relevant work to do reviewing / red-teaming prior to publication
Another argument against is that, for actually directly improving the accuracy of some piece of work, it’s probably more effective to pay people who are already know to be good at relevant work to do reviewing / red-teaming prior to publication
Yeah I think this is key. I’m much more optimistic about getting trainees to do this being a good training intervention than a “directly improve research quality” intervention. There are some related arguments why you want to pay people who are either a) already good at the relevant work or b) specialized reviewers/red-teamers
paying people to criticize your work would risk creating a weird power dynamic, and more experienced reviewers would be better at navigating this
For example, trainees may be afraid of criticizing you too harshly.
Also, if the critique is in fact bad, you may be placed in a somewhat awkward position when deciding whether to publish/publicize it.
Strong upvote for a idea that seems directly actionable and useful for addressing important problem.
I’m gonna quote your shortform in full (with a link and attribution, obviously) in a comment on my post about Intervention options for improving the EA-aligned research pipeline.
I think by default good ideas like this never really end up happening, which is sad. Do you or other people have thoughts on how to make your idea actually happen? Some quick thoughts from me:
Just highlight this idea on the Forum more often/prominently
People giving career advice or mentorship to people interested in EA-aligned research careers mention this as one way of testing fit, having an impact, etc.
I add the idea to Notes on EA-related research, writing, testing fit, learning, and the Forum [done!]
Heap an appropriate amount of status and attention on good instances of this having been done
That requires it to be done at least once first, of course, but can then increase the rate
E.g., Aaron Gertler could feature it in the EA Forum Digest newsletter, people could make positive comments on the post, someone can share it in a Facebook group and/or other newsletter
I know I found this sort of thing a useful and motivating signal when I started posting stuff (though not precisely this kind of stuff)
Publicly offer to provide financial prizes for good instances of this having been done
One way to do this could mirror Buck’s idea for getting more good book reviews to happen (see my other comment): “If it’s the kind of review I want, I give them $500 in return for them posting the review to EA Forum or LW with a “This post sponsored by the EAIF” banner at the top. (I’d also love to set up an impact purchase thing but that’s probably too complicated).”
Find case studies where someone found such a post useful or having written it helped someone get a good job or something, and then publicise those
See also my thoughts on discovering, writing, and/or promoting case studies of people successfully using interventions for improving the EA-aligned research pipeline
Thanks for linking my idea in your sequence! (onlookers note: MichaelA and I are coworkers)
This arguably happened to alexrjl’s critique of Giving Green, though it was a conjunction of a critique of an organization and a critique of research done.
As an aside, I decided to focus my shortform on critiques of public research rather than critiques of organizations/people, even though I think the latter is quite valuable too, since a) my intuition is that the former is less acrimonious, b) relatedly, critiques of organizations may be worse at training dispassionate analysis skills (vs eg tribalistic feelings or rhetoric), c) critiques of orgs or people might be easier for newbies to fuck up and d) I think empirically, critiques of organizations have a worse hit rate than critiques of research posts.
As you know, one of my interns is doing something adjacent to this idea (though framed in a different way), and I may convince another intern to do something similar (depending on their interests and specific project ideas in mind).
Yeah, good point—I guess a more directed version of “People giving career advice or mentorship to people interested in EA-aligned research careers mention this as one way of testing fit, having impact, etc.” is just people encouraging people they manage to do this, or maybe even hiring people with this partly in mind.
Though I think that that wouldn’t capture most of the potential value of this idea, since part of what’s good about is that, as you say, this idea:
(People who’ve already gone through a hiring process and have an at least somewhat more experienced researcher managing them will have an easier time than other people in testing fit, having impact, building skills, etc. in other ways as well.)
Yeah I agree that a major upside to this idea (and a key differentiator between it and other proposed interventions for fixing early stages of the research pipeline) is that it ought to be doable without as much guidance from external mentors. I guess my own willingness to suggest this as an intern project suggests that I believe it must comparatively be even more exciting for people without external guidance.
Another possible (but less realistic?) way to make this happen:
Organisations/researchers do something like encouraging red teaming of their own output, setting up a bounty/prize for high-quality instances of that, or similar
An example of something roughly like this is a post on the GiveWell blog that says at the start: “This is a guest post by David Barry, a GiveWell supporter. He emailed us at the end of December to point out some mistakes and issues in our cost-effectiveness calculations for deworming, and we asked him to write up his thoughts to share here. We made minor wording and organizational suggestions but have otherwise published as is; we have not vetted his sources or his modifications to our spreadsheet for comparing deworming and cash. Note that since receiving his initial email, we have discussed the possibility of paying him to do more work like this in the future.”
But I think GiveWell haven’t done that since then?
It seems like this might make sense and be mutually beneficial
Orgs/researchers presumably want more ways to increase the accuracy of their claims and conclusions
A good red teaming of their work might also highlight additional directions for further research and surface someone who’d be a good employee for that org or collaborator for that researcher
Red teaming of that work might provide a way for people to build skills and test fit for work on precisely the topics that the org/researcher presumably considers important and wants more people working on
But I’d guess that this is unlikely to happen in this form
I think this is mainly due to inertia plus people feeling averse to the idea
But there may also be good arguments against
This post is probably relevant: https://forum.effectivealtruism.org/posts/gTaDDJFDzqe7jnTWG/some-thoughts-on-public-discourse
Another argument against is that, for actually directly improving the accuracy of some piece of work, it’s probably more effective to pay people who are already know to be good at relevant work to do reviewing / red-teaming prior to publication
Yeah I think this is key. I’m much more optimistic about getting trainees to do this being a good training intervention than a “directly improve research quality” intervention. There are some related arguments why you want to pay people who are either a) already good at the relevant work or b) specialized reviewers/red-teamers
paying people to criticize your work would risk creating a weird power dynamic, and more experienced reviewers would be better at navigating this
For example, trainees may be afraid of criticizing you too harshly.
Also, if the critique is in fact bad, you may be placed in a somewhat awkward position when deciding whether to publish/publicize it.