You write:
(iv) Roodman’s review of incarceration notes that multiple studies find strong evidence that incapacitation works to prevent crime.
But that’s tautological or close to tautological given Roodman’s definition of incapacitation (p. 10, Sec. 2.2.2):
Because prison crime is so rarely studied, and because crime outside of prison has particular political salience, “incapacitation” in this review will refer to crime outside of prison.
(I say “close to tautological” because some crimes committed by someone in prison, e.g. mail fraud, might nonetheless be considered crimes outside of prison.)
If we consider total crime, not just reported crime or just crime outside of prison, then the quoted incapacitation figures will be overstated. Indeed, it’s quite plausible that the full incapacitation effect is negative on some margins. So for instance consider someone in jail for a relatively short period of a week or a month. I would guess their risk of being a victim of crime (theft, assault, rape) is typically higher than the risk of them committing or being a victim of a crime outside of jail over the same period.
Thanks for the reply. I agree that’s a natural tentative interpretation of Table 26, taken in isolation. But note that table doesn’t give any indication of confidence intervals for the relevant column.
Have a look at Table 11 (below). We see the same numbers (up to rounding) in the final row, with 90% confidence intervals. Note the negative point estimates for rape and assault are very close to the center of their confidence intervals and thus not distinguishable from zero. Basically, there was a natural experiment in which California reduced the prisoner population and for those two categories, on a relative basis to (most of) the rest of the country, crime happened to decrease very slightly, but only to an extent well within the statistical noise. (In fact of the seven categories, only motor vehicle theft is significant—and barely so—at the p=0.1 level and none is significant at the conventional p=0.05 level.)
Note the crime numbers being used here are inferred from official crimes reported, rescaled using national estimates of the reporting rate (which helps to put e.g. murder and larceny on the same footing, despite their very different reporting rates). Since only a tiny fraction of crimes in prison are reported (at least that’s my sense), that means that crimes in prisons and jails are essentially being ignored (as Roodman states in his definition of incapacitation I initially cited).
The bottom line as I see it: If someone wants to do a CEA analysis of an intervention in this space, they should think carefully about the incapacitation term as sources (Roodman and I suspect the underlying literature) will tend to exclude crimes in prisons and jails. In fairness, it’s likely hard to get good estimates, but things don’t fail to be real because they are hard to estimate.