I’ve been reading a few academic papers on my “to-read” list, and The Crisis of Confidence in Research Findings in Psychology: Is Lack of Replication the Real Problem? Or Is It Something Else? has a section that made me think about epistemics, knowledge, and how we try to make the world a better place. I’ll include the exact quote below, but my rough summary of it would be that multiple studies found no relationship between the presence or absence of highway shoulders and accidents/deaths, and thus they weren’t built. Unfortunately, none of the studies had sufficient statistical power, and thus the conclusions drawn were inaccurate. I suppose that absence of evidence is not evidence of absence might be somewhat relevant here. Lo and behold, later on a meta-analysis was done, finding that having highway shoulders reduced accidents/deaths. So my understanding is that inaccurate knowledge (shoulders don’t help) led to choices (don’t build shoulders) that led to accidents/deaths that wouldn’t otherwise have happened.
I’m wondering if there are other areas of life that we can find facing similar issues. These wouldn’t necessarily be new cause areas, but the general idea of identify an area that involves life/death decisions, and then either make sure the knowledge is accurate or attempt to bring accurate knowledge to the decision-makers would be incredibly helpful. Hard though. Probably not very tractable.
For anyone curious, here is the relevant excerpt that prompted my musings:
A number of studies had been conducted to determine whether highway shoulders, which allow drivers to pull over to the side of the road and stop if they need to, reduce accidents and deaths. None of these inadequately powered studies found a statistically significant relationship between the presence or absence of shoulders and accidents or deaths. Traffic safety engineers concluded that shoulders have no effect, and as a result fewer shoulders were built in most states. Hauer’s (2004) meta-analysis of these studies showed clearly that shoulders reduced both accidents and deaths. In this case, people died as a result of failure to understand sampling error and statistical power.
I’ve been reading a few academic papers on my “to-read” list, and The Crisis of Confidence in Research Findings in Psychology: Is Lack of Replication the Real Problem? Or Is It Something Else? has a section that made me think about epistemics, knowledge, and how we try to make the world a better place. I’ll include the exact quote below, but my rough summary of it would be that multiple studies found no relationship between the presence or absence of highway shoulders and accidents/deaths, and thus they weren’t built. Unfortunately, none of the studies had sufficient statistical power, and thus the conclusions drawn were inaccurate. I suppose that absence of evidence is not evidence of absence might be somewhat relevant here. Lo and behold, later on a meta-analysis was done, finding that having highway shoulders reduced accidents/deaths. So my understanding is that inaccurate knowledge (shoulders don’t help) led to choices (don’t build shoulders) that led to accidents/deaths that wouldn’t otherwise have happened.
I’m wondering if there are other areas of life that we can find facing similar issues. These wouldn’t necessarily be new cause areas, but the general idea of identify an area that involves life/death decisions, and then either make sure the knowledge is accurate or attempt to bring accurate knowledge to the decision-makers would be incredibly helpful. Hard though. Probably not very tractable.
For anyone curious, here is the relevant excerpt that prompted my musings: