Do you have a source for the “carrying forward” on gjopen? I usually don’t take the time to update my forecasts if I don’t think I’d be able to beat the current median but might want to adjust my strategy in light of this.
Also, because the Median score is the median of all Brier scores (and not Brier score of the median forecast) it might still be good for your Accuracy score to forecast something close to community’s median.
To determine your accuracy over the lifetime of a question, we calculate a Brier score for every day on which you had an active forecast, then take the average of those daily Brier scores and report it on your profile page. On days before you make your first forecast on a question, you do not receive a Brier score. Once you make a forecast on a question, we carry that forecast forward each day until you update it by submitting a new forecast.
I guess you’re right (I read this before and interpreted “active foreast” as “forecast made very recently”).
If they also used this way of scoring things for the results in Superforecasting, this seems like an important caveat for forecasting advice that is derived from the book: For example the efficacy of updating your beliefs might mostly be explained by this. I previously thought that the results meant that a person who forecasts a question daily will make better forecasts on sundays than a person who only forecasts on sundays.
Do you have a source for the “carrying forward” on gjopen? I usually don’t take the time to update my forecasts if I don’t think I’d be able to beat the current median but might want to adjust my strategy in light of this.
Also, because the Median score is the median of all Brier scores (and not Brier score of the median forecast) it might still be good for your Accuracy score to forecast something close to community’s median.
https://www.gjopen.com/faq says:
I guess you’re right (I read this before and interpreted “active foreast” as “forecast made very recently”).
If they also used this way of scoring things for the results in Superforecasting, this seems like an important caveat for forecasting advice that is derived from the book: For example the efficacy of updating your beliefs might mostly be explained by this. I previously thought that the results meant that a person who forecasts a question daily will make better forecasts on sundays than a person who only forecasts on sundays.