And yes, I totally agree that how well we can predict (rather than just the question whether predictability is zero or nonzero) is relevant in practice.
If the ex-post distribution is heavy-tailed, there are a bunch of subtle considerations here I’d love someone to tease out. For example, if you have a prediction method that is very good for the bottom 90% but biased toward ‘typical’ outcomes, i.e. the median, then you might be better off in expectation to allocate by a lottery over the full population (b/c this gets you the mean, which for heavy-tailed distributions will be much higher than the median).
Data from the IAP indicates that they can identify the top few percent of successful inventions with pretty good accuracy. (Where “success” is a binary variable – not sure how they perform if you measure financial returns.)
And yes, I totally agree that how well we can predict (rather than just the question whether predictability is zero or nonzero) is relevant in practice.
If the ex-post distribution is heavy-tailed, there are a bunch of subtle considerations here I’d love someone to tease out. For example, if you have a prediction method that is very good for the bottom 90% but biased toward ‘typical’ outcomes, i.e. the median, then you might be better off in expectation to allocate by a lottery over the full population (b/c this gets you the mean, which for heavy-tailed distributions will be much higher than the median).
Data from the IAP indicates that they can identify the top few percent of successful inventions with pretty good accuracy. (Where “success” is a binary variable – not sure how they perform if you measure financial returns.)