I guess now, given that, Iām a bit confused by the statement āas data becomes available on prediction track records, aggregation and scoring can become less subjective.ā Do you think data will naturally become available on the issue of differences in question difficulty across platforms? Or is it that you think that (a) thereāll at least be more data on calibration + accuracy, and (b) people will think more (though without much new data) about how to deal with the question difficult issue, and together (a) and (b) will reduce this issue?
Ah, that makes sense, thanks.
I guess now, given that, Iām a bit confused by the statement āas data becomes available on prediction track records, aggregation and scoring can become less subjective.ā Do you think data will naturally become available on the issue of differences in question difficulty across platforms? Or is it that you think that (a) thereāll at least be more data on calibration + accuracy, and (b) people will think more (though without much new data) about how to deal with the question difficult issue, and together (a) and (b) will reduce this issue?