I’m curious about model 3 - the policy evaluation model.
I think this point is particularly insightful: “Conditional forecasting would also require policymakers to identify discrete and falsifiable goals of their policies, which would already be a major process improvement.”
But I don’t quite understand the thinking behind the following two points:
“generating discrete probabilities about the likely success of certain policy tools would incentivize decision-makers to engage with the logic underlying relevant forecasts.”—how exactly do you see this model changing the incentives policymakers face, relative to the status quo (which includes conditional forecasts sometimes being generated on the likes of Metaculus etc)?
“It would also provide the foundations for more active learning in the policymaking sphere: policymakers would be able to improve their policymaking skills by studying which of their interventions succeeded and failed.”—what’s the process you envision here that enables active leasing? If policymakers themselves are the ones that are making forecasts, and can see how their predictions compare to actual outcomes, then I can see where the learning comes in. But if policymakers are still just consumers of forecasts in this model, I don’t see how the supply of conditional forecasts would itself support policymakers’ learning.
Thanks in advance for any additional detail you can provide on this proposal!
Thanks for writing this up, it’s very useful!
I’m curious about model 3 - the policy evaluation model.
I think this point is particularly insightful: “Conditional forecasting would also require policymakers to identify discrete and falsifiable goals of their policies, which would already be a major process improvement.”
But I don’t quite understand the thinking behind the following two points:
“generating discrete probabilities about the likely success of certain policy tools would incentivize decision-makers to engage with the logic underlying relevant forecasts.”—how exactly do you see this model changing the incentives policymakers face, relative to the status quo (which includes conditional forecasts sometimes being generated on the likes of Metaculus etc)?
“It would also provide the foundations for more active learning in the policymaking sphere: policymakers would be able to improve their policymaking skills by studying which of their interventions succeeded and failed.”—what’s the process you envision here that enables active leasing? If policymakers themselves are the ones that are making forecasts, and can see how their predictions compare to actual outcomes, then I can see where the learning comes in. But if policymakers are still just consumers of forecasts in this model, I don’t see how the supply of conditional forecasts would itself support policymakers’ learning.
Thanks in advance for any additional detail you can provide on this proposal!