Sure, one should attend to priors in interpretation, but that doesn’t make the experiment useless.
If a pre-registered experiment reliably gives you a severalfold likelihood ratio, you can repeat it or scale it up and overcome significant prior skepticism (although limited by credence in hidden flaws).
I’m not saying any experiment is necessarily useless, but if MFA is going to spend a bunch of resources on another study they should use methods that won’t exaggerate effectiveness.
And it’s not only that “one should attend to priors in interpretation”—one should specify priors beforehand and explicitly update conditional on the data.
Sure, one should attend to priors in interpretation, but that doesn’t make the experiment useless.
If a pre-registered experiment reliably gives you a severalfold likelihood ratio, you can repeat it or scale it up and overcome significant prior skepticism (although limited by credence in hidden flaws).
I’m not saying any experiment is necessarily useless, but if MFA is going to spend a bunch of resources on another study they should use methods that won’t exaggerate effectiveness.
And it’s not only that “one should attend to priors in interpretation”—one should specify priors beforehand and explicitly update conditional on the data.