Greenberg 2018 lists and evaluates forecasting scoring rules. Research on additionally more complex metrics that take into account e.g.:
importance of the questions forecasted on (perhaps using an interest score such as Metaculus)
number of questions forecasted on (brier score distorts if only few forecasts)
relative performance as compared to other forecasters on similar sets of questions
Might be useful to set incentives right in forecasting tournaments. Prediction markets solve the first point by logarithmic subsidising.
Current theme: default
Less Wrong (text)
Less Wrong (link)
Arrow keys: Next/previous image
Escape or click: Hide zoomed image
Space bar: Reset image size & position
Scroll to zoom in/out
(When zoomed in, drag to pan; double-click to close)
Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).
]
Keys shown in grey (e.g., ?) do not require any modifier keys.
?
Esc
h
f
a
m
v
c
r
q
t
u
o
,
.
/
s
n
e
;
Enter
[
\
k
i
l
=
-
0
′
1
2
3
4
5
6
7
8
9
→
↓
←
↑
Space
x
z
`
g
Greenberg 2018 lists and evaluates forecasting scoring rules. Research on additionally more complex metrics that take into account e.g.:
importance of the questions forecasted on (perhaps using an interest score such as Metaculus)
number of questions forecasted on (brier score distorts if only few forecasts)
relative performance as compared to other forecasters on similar sets of questions
Might be useful to set incentives right in forecasting tournaments. Prediction markets solve the first point by logarithmic subsidising.