This is a very good point. Also, one of the coauthors of that paper was my Honours supervisor (Ullrich Ecker), and I’m pretty confident that that general body of research holds up pretty well (though not 100% that it holds up perfectly). That’s based primarily based on my impression of the studies’ methodologies (having read quite a few), on there being a variety of studies from different authors finding similar results, and on there being plausible theories to explain findings. On the other hand, I don’t think I’ve seen replications using exactly the same methodologies as earlier studies (more like tweaking them in small ways and seeing how effects generalise) - not sure that’s a problem; just saying.
I’ve also briefly discussed the relevance of this area of research to EA’s epistemic norms here, and I may try to go into more detail on that in future if I have time and people think it’d be valuable.
This is a very good point. Also, one of the coauthors of that paper was my Honours supervisor (Ullrich Ecker), and I’m pretty confident that that general body of research holds up pretty well (though not 100% that it holds up perfectly). That’s based primarily based on my impression of the studies’ methodologies (having read quite a few), on there being a variety of studies from different authors finding similar results, and on there being plausible theories to explain findings. On the other hand, I don’t think I’ve seen replications using exactly the same methodologies as earlier studies (more like tweaking them in small ways and seeing how effects generalise) - not sure that’s a problem; just saying.
I’ve also briefly discussed the relevance of this area of research to EA’s epistemic norms here, and I may try to go into more detail on that in future if I have time and people think it’d be valuable.