I do think we should worry about failure modes and being wrong. But I think the main reason to do that is that people are often wrong, they are bad at reasoning, and subject to a host of biases. The fact that we are in a minority of the global population is an extremely weak indicator of being wrong. The majority has been gravely wrong on many moral and empirical questions in the past and today. It’s not at all clear that the base rate of being wrong for ‘minority view’ vs ‘majority view’ is higher or not, and that question is extremely difficult to answer because there are lots of ways of slicing up the minority you are referring to.
I feel like there’s just a crazy number of minority views (in the limit a bunch of psychoses held by just one individual), most of which must be wrong. We’re more likely to hear about minority views which later turn out to be correct, but it seems very implausible that the base rate of correctness is higher for minority views than majority views.
On the other hand I think there’s some distinction to be drawn between “minority view disagrees with strongly held majority view” and “minority view concerns something that majority mostly ignores / doesn’t have a view on”.
that is a fair point. departures from global majority opinion still seems like a pretty weak ‘fire alarm’ for being wrong. Taking a position that is eg contrary to most experts on a topic would be a much greater warning sign.
I see how this could be misread. I’ll reformulate the statement; “If our small, non-representative group comes to a conclusion, we should wonder, given base rates about correctness in general and the outside view, about which failure modes have affected similar small groups in the past, and consider if they apply, and how we might be wrong or misguided.”
So yes, errors are common to all groups, and being a minority isn’t a indicator of truth, which I mistakenly implied. But the way in which groups are wrong is influenced by group-level reasoning fallacies and biases, which are a product of both individual fallacies and characteristics of the group. That’s why I think that investigating how previous similar groups failed seems like a particularly useful way to identify relevant failure modes.
I do think we should worry about failure modes and being wrong. But I think the main reason to do that is that people are often wrong, they are bad at reasoning, and subject to a host of biases. The fact that we are in a minority of the global population is an extremely weak indicator of being wrong. The majority has been gravely wrong on many moral and empirical questions in the past and today. It’s not at all clear that the base rate of being wrong for ‘minority view’ vs ‘majority view’ is higher or not, and that question is extremely difficult to answer because there are lots of ways of slicing up the minority you are referring to.
I feel like there’s just a crazy number of minority views (in the limit a bunch of psychoses held by just one individual), most of which must be wrong. We’re more likely to hear about minority views which later turn out to be correct, but it seems very implausible that the base rate of correctness is higher for minority views than majority views.
On the other hand I think there’s some distinction to be drawn between “minority view disagrees with strongly held majority view” and “minority view concerns something that majority mostly ignores / doesn’t have a view on”.
that is a fair point. departures from global majority opinion still seems like a pretty weak ‘fire alarm’ for being wrong. Taking a position that is eg contrary to most experts on a topic would be a much greater warning sign.
I see how this could be misread. I’ll reformulate the statement;
“If our small, non-representative group comes to a conclusion, we should wonder, given base rates about correctness in general and the outside view, about which failure modes have affected similar small groups in the past, and consider if they apply, and how we might be wrong or misguided.”
So yes, errors are common to all groups, and being a minority isn’t a indicator of truth, which I mistakenly implied. But the way in which groups are wrong is influenced by group-level reasoning fallacies and biases, which are a product of both individual fallacies and characteristics of the group. That’s why I think that investigating how previous similar groups failed seems like a particularly useful way to identify relevant failure modes.
yes I agree with that.