Very nice find on Croke (2019), I wasn’t aware of it! I think it’s worth mentioning that though their results aren’t statistically significant, their point estimates are positive for the literacy and numeracy effects. Since GiveWell is basically meta-analyzing the existing literature in trying to come up with its effect size estimates, there’s a meaningful difference between a positive point estimate and a zero or negative point estimate in the case where a study doesn’t find statistically significant results.
Very nice find on Croke (2019), I wasn’t aware of it! I think it’s worth mentioning that though their results aren’t statistically significant, their point estimates are positive for the literacy and numeracy effects. Since GiveWell is basically meta-analyzing the existing literature in trying to come up with its effect size estimates, there’s a meaningful difference between a positive point estimate and a zero or negative point estimate in the case where a study doesn’t find statistically significant results.