I sometimes see people claim that EA research tends to be low-quality or “not taken seriously” by scholars in relevant fields.
There are cases where this clearly isn’t true (e.g. AI alignment questions seem to have at least split the scholarly community, with a lot of people on both sites).
But I worry that, as a non-scientist, I’m living in a bubble where I don’t see strong critique of GiveWell’s methodology, FHI’s policy papers, etc.
Does anyone have good examples of respected* scholars who have reviewed EA research and either praised it highly or found it lackluster?
*I’m using this word to mean a combination of “regarded highly within their field” and “regarded reasonably well by EAs who care about their field”; if you’re not sure whether someone counts, please share the example anyway!
Specifically, I’m looking for reviews of EA research that doesn’t go through peer-reviewed research channels, or that gets published in very obscure journals that separate it from being “mainstream” within its field. Examples include:
Eric Drexler’s Comprehensive AI Services model
Wild animal suffering (especially attempts to estimate its magnitude or compare it to human suffering on a moral basis)
GiveWell’s cost-effectiveness models
X-risk policy work from FHI, CSER, or other longtermist research orgs
Recent EA discussion of COVID-19
An example of feedback that fits what I’m looking for:
Judea Pearl, a renowned computer scientist, reviewing Stuart Russell’s Human Compatible:
“Human Compatible made me a convert to Russell’s concerns with our ability to control our upcoming creation—super-intelligent machines. Unlike outside alarmists and futurists, Russell is a leading authority on AI. His new book will educate the public about AI more than any book I can think of, and is a delightful and uplifting read.”
Here’s a thread in which a World Bank economist critiques GiveWell on research/publication methods. (GiveWell responds here.)
In addition to Will MacAskill’s critique of functional decision theory (MIRI-originated and intended to be relevant for AI alignment), there’s this write-up by someone that refereed FDT’s submission to a philosophy journal:
Since then, the related paper Cheating Death in Damascus has apparently been accepted by The Journal of Philosophy, though it doesn’t seem to be published yet.
The Wolfgang Schwarz writeup is exactly the sort of thing I’m looking for; thank you!
Will’s critique is also a reasonable fit; I was hoping to avoid “EA people reviewing other EA people,” but he seems to approach the topic in his capacity as a philosopher and shows no sign of soft-pedaling his critique.
Probably more informal than you want, but here’s a Facebook thread debating AI safety involving some of the biggest names in AI.
As someone who has sometimes made a similar claim, I find a lot of assessments of others’ work, not just that of EAs, tends to be informal, off-the-record, and discussion-based. I in fact think that EAs with some frequency miss out on a wealth of knowledge due to a widespread and often insistent requirement that knowledge be citable in order to be meaningful. There are very strong reasons to greatly prefer and put greater weight on citable knowledge, but there is A LOT of intelligence that people do not share in recorded formats for a variety of reasons, such as effort and reputational risks.
So I believe some lack of answers to this may be due to critiques of EA work being shared e.g. verbally, rather than more formally. Personally, I’ve discussed EA work with at least 4 quite prominent economists, at least 2 of whom I believed had reviewed some significant aspect of EA research and perspective thoroughly, but I have not really shared these accounts. To be sharable, I’d likely require more time and attention of these economists than I’m easily able to get, in order to ensure I provided both full and proper explanation and sufficient guarantee of anonymity.
Do you feel comfortable giving some general impression of what the economists’ views were (e.g. “one favorable, two mixed, one unfavorable”)? If not, that’s understandable!
I would expect EA to have a weaker insistence on citable knowledge than people in other academic fields; do you think the insistence is actually stronger? (Or are most people in academic fields wrong, and EA isn’t an exception?)
The “Worm Wars” could arguably be an example (though the contentious research was not just from the EA community)
How much of that research was from the EA community?
I’ve been involved (in some capacity) with most of the publications at the Centre for the Governance of AI at FHI coming out over the past 1.5 years. I’d say that for most of our research there is someone outside the EA community involved. Reasonably often, one or more of the authors of the piece wouldn’t identify as part of the EA community. As for input to the work: If it is academically published, we’d get input from reviewers. We also seek additional input for all our work from folks we think will be able to provide useful input. This often includes academics we know in relevant fields. (This of course leads to a bit of a selection effect)
Likewise for publications at CSER. I’d add that for policy work, written policy submissions often provide summaries and key takaways and action-relevant points based on ‘primary’ work done by the centre and its collaborators, where the primary work is peer-reviewed.
We’ve received informal/private feedback from people in policy/government roles at various points that our submissions and presentations have been particularly useful or influential. And we’ll have some confidential written testimony to support this for a few examples for University REF (research excellence framework) assessment purposes; however unfortunately I don’t have permission to share these publicly at this time. However, this comment I wrote last year provides some info that could be used as indirect indications of the work being seen as high-quality (being chosen as a select number to be invited to present orally; follow-up engagement, etc).
https://forum.effectivealtruism.org/posts/whDMv4NjsMcPrLq2b/cser-and-fhi-advice-to-un-high-level-panel-on-digital?commentId=y7DjYFE3gjZZ9caij