But I don’t think people blindly defer to evaluators in other life domains either—or at least they shouldn’t for major decisions. For instance, there are fraudulent university accreditation agencies, non-fraudulent ones with rather low standards, ones with standards that are pretty orthogonal to whether you’ll get a good education, and so on.
I suggest that people more commonly rely on a social web of trust—one strand might be: College X looks good in the US News rankings, and I trust the US News rankings because the school guidance counselor thought it reliable, and the guidance counselor’s reputation in the broader school community is good. In reality, there are probably a couple of strands coming out from US News (e.g., my friends were talking about it) and from School X (e.g., I read about some successful alumni). So there’s a broader web to justify the trust placed in the US News evaluation, buttressed by sources in which the decisionmaker already had some confidence. Of course, the guidance counselor could be incompetent, my friends probably are ill-informed, and most schools have at least a few successful alumni. But people don’t have the time or energy to validate everything!
My guess is that for many people, GiveWell doesn’t have the outgoing linkages that US News does in my example. And it has some anti-linkages—e.g., one might be inclined to defer to Stanford professors, and of course one had some harsh things (unjustified in my opinion) to say about GiveWell. It comes up in the AI overview when I google’d “criticisms of Givewell,” so fairly low-hanging fruit that would likely come up on modest due diligence.
I’d also note that independent cannot be assumed and must be either taken on trust (probably through a web of trust) or sufficiently proven (which requires a fair amount of drilling).
My guess is that GiveWell is simply not enmeshed in John’s web of trust the way it is in yours or mine. Making and sustaining a widely trusted brand is hard, so that’s not surprising.
I agree with your first couple of paragraphs. That’s why my initial reply referred to “reputable independent evaluators like GiveWell”.
Conspiracy theorists do, of course, have their own distinct (and degenerate) “webs of trust”, which is why I also flagged that possibility. But mainstream academic opinion (not to mention the opinion of the community that’s most invested in getting these details right, i.e. effective altruists) regards GiveWell as highly reputable.
I didn’t get the sense from John’s comment that he understands reasonable social trust of this sort. He offered a false dichotomy between “thorough and methodical research” and “gut reactions”, and suggested that “trust comes from… [personally] evaluat[ing] the service through normal use and consumption.” I think this is deeply misleading. (Note, for example, that “normal use and consumption” does not give you any indication of how much lead is in your turmeric, whether your medication risks birth defects if taken during pregnancy, etc etc. Social trust, esp. in reputable institutions, is absolutely ubiquitous in navigating the world.)
But I don’t think people blindly defer to evaluators in other life domains either—or at least they shouldn’t for major decisions. For instance, there are fraudulent university accreditation agencies, non-fraudulent ones with rather low standards, ones with standards that are pretty orthogonal to whether you’ll get a good education, and so on.
I suggest that people more commonly rely on a social web of trust—one strand might be: College X looks good in the US News rankings, and I trust the US News rankings because the school guidance counselor thought it reliable, and the guidance counselor’s reputation in the broader school community is good. In reality, there are probably a couple of strands coming out from US News (e.g., my friends were talking about it) and from School X (e.g., I read about some successful alumni). So there’s a broader web to justify the trust placed in the US News evaluation, buttressed by sources in which the decisionmaker already had some confidence. Of course, the guidance counselor could be incompetent, my friends probably are ill-informed, and most schools have at least a few successful alumni. But people don’t have the time or energy to validate everything!
My guess is that for many people, GiveWell doesn’t have the outgoing linkages that US News does in my example. And it has some anti-linkages—e.g., one might be inclined to defer to Stanford professors, and of course one had some harsh things (unjustified in my opinion) to say about GiveWell. It comes up in the AI overview when I google’d “criticisms of Givewell,” so fairly low-hanging fruit that would likely come up on modest due diligence.
I’d also note that independent cannot be assumed and must be either taken on trust (probably through a web of trust) or sufficiently proven (which requires a fair amount of drilling).
My guess is that GiveWell is simply not enmeshed in John’s web of trust the way it is in yours or mine. Making and sustaining a widely trusted brand is hard, so that’s not surprising.
I agree with your first couple of paragraphs. That’s why my initial reply referred to “reputable independent evaluators like GiveWell”.
Conspiracy theorists do, of course, have their own distinct (and degenerate) “webs of trust”, which is why I also flagged that possibility. But mainstream academic opinion (not to mention the opinion of the community that’s most invested in getting these details right, i.e. effective altruists) regards GiveWell as highly reputable.
I didn’t get the sense from John’s comment that he understands reasonable social trust of this sort. He offered a false dichotomy between “thorough and methodical research” and “gut reactions”, and suggested that “trust comes from… [personally] evaluat[ing] the service through normal use and consumption.” I think this is deeply misleading. (Note, for example, that “normal use and consumption” does not give you any indication of how much lead is in your turmeric, whether your medication risks birth defects if taken during pregnancy, etc etc. Social trust, esp. in reputable institutions, is absolutely ubiquitous in navigating the world.)