There is a good Cold Takes blog on the ‘Bayesian mindset’ - which gets at something related to this as ‘~20-minute read rather than the >1000 pages of Rationality: A-Z (aka The Sequences).’
Summary:
This piece is about the in-practice pros and cons of trying to think in terms of probabilities and expected value for real-world decisions, including decisions that don’t obviously lend themselves to this kind of approach.
The mindset examined here is fairly common in the “effective altruist” and “rationalist” communities, and there’s quite a bit of overlap between this mindset and that of Rationality: A-Z (aka The Sequences), although there are some differing points of emphasis.1 If you’d like to learn more about this kind of thinking, this piece presents a ~20-minute read rather than the >1000 pages of Rationality: A-Z.
This piece is a rough attempt to capture the heart of the ideas behind rationalism, and I think a lot of the ideas and habits of these communities will make more sense if you’ve read it, though I of course wouldn’t expect everyone in those communities to think I’ve successfully done this.
If you’re already deeply familiar with this way of thinking and just want my take on the pros and cons, you might skip to Pros and Cons. If you want to know why I’m using the term “Bayesian mindset” despite not mentioning Bayes’s rule much, see footnote 3.
This piece is about the “Bayesian mindset,” my term for a particular way of making decisions. In a nutshell, the Bayesian mindset is trying to approximate an (unrealistic) ideal of making every decision based entirely on probabilities and values, like this:
Should I buy travel insurance for $10? I think there’s about a 1% chance I’ll use it (probability—blue), in which case it will get me a $500 airfare refund (value—red). Since 1% * $500 = $5, I should not buy it for $10.
The ideal here is called expected utility maximization (EUM): making decisions that get you the highest possible expected value of what you care about.2 (I’ve put clarification of when I’m using “EUM” and when I’m using “Bayesian mindset” in a footnote, as well as notes on what “Bayesian” refers to in this context, but it isn’t ultimately that important.3)
It’s rarely practical to literally spell out all the numbers and probabilities like this. But some people think you should do so when you can, and when you can’t, use this kind of framework as a “North Star”—an ideal that can guide many decisions even when you don’t do the whole exercise.
Others see the whole idea as much less promising.
I think it’s very useful to understand the pros and cons, and I think it’s good to have the Bayesian Mindset as one option for thinking through decisions. I think it’s especially useful for decisions that are (a) important; (b) altruistic (trying to help others, rather than yourself); (c) “unguided,” in the sense that normal rules of thumb aren’t all that helpful.
In the rest of this piece, I’m going to walk through:
The “dream” behind the Bayesian mindset.
If we could put the practical difficulties aside and make every decision this way, we’d be able to understand disagreements and debates much better—including debates one has with oneself. In particular, we’d know which parts of these disagreements and debates are debates about how the world is (probabilities) vs. disagreements in what we care about (values).
When debating probabilities, we could make our debates impersonal, accountable, and focused on finding the truth. Being right just means you have put the right probabilities on your predictions. Over time, it should be possible to see who has and has not made good predictions. Among other things, this would put us in a world where bad analysis had consequences.
When disagreeing over values, by contrast, we could all have transparency about this. If someone wanted you to make a certain decision for their personal benefit, or otherwise for values you didn’t agree with, they wouldn’t get very far asking you to trust them.
The “how” of the Bayesian mindset—what kinds of practices one can use to assign reasonable probabilities and values, and (hopefully) come out with reasonable decisions.
The pros and cons of approaching decisions this way.
There is a good Cold Takes blog on the ‘Bayesian mindset’ - which gets at something related to this as ‘~20-minute read rather than the >1000 pages of Rationality: A-Z (aka The Sequences).’
Summary: