The core of this person’s disagreement with us is that they think we’ve underestimated the insidiousness of the winner’s curse.
Extreme nitpick, but you mean the optimizer’s curse, not the winner’s curse. The winner’s curse is that when you win an auction, you should expect to have overpaid (similar dynamics to the optimizer’s curse though.) The optimizer’s curse is really interesting and worth a read IMO! Doesn’t come from worries with p-hacking but applies even when the data you look at is fair and unbiased. IIRC due to the distribution of random errors but I could be wrong.
Extreme nitpick, but you mean the optimizer’s curse, not the winner’s curse. The winner’s curse is that when you win an auction, you should expect to have overpaid (similar dynamics to the optimizer’s curse though.) The optimizer’s curse is really interesting and worth a read IMO! Doesn’t come from worries with p-hacking but applies even when the data you look at is fair and unbiased. IIRC due to the distribution of random errors but I could be wrong.