“The one you should use depends on context. It should depend on how much you care about false positives vs false negatives in that particular case”
Yep, exactly! Assume you’re a doctor, have a bunch of patients with a disease that is definitely going to kill them tomorrow, and there is a new, very low-cost, possible cure. Even if there’s only one study of this possible cure showing a p-value of 0.2, you really should still recommend it!
“The one you should use depends on context. It should depend on how much you care about false positives vs false negatives in that particular case”
Yep, exactly! Assume you’re a doctor, have a bunch of patients with a disease that is definitely going to kill them tomorrow, and there is a new, very low-cost, possible cure. Even if there’s only one study of this possible cure showing a p-value of 0.2, you really should still recommend it!