If you read the expert comments, very often they complain that the question is poorly phrased. It’s typically about wording like “would greatly increase” where there’s not even an attempt to define “greatly”. So if you want to improve the panel or replicate it, that is my #1 recommendation.
...My #2 recommendation is to create a Metaculus market for every IGM question and see how it compares.
Additionally, sometimes the question seems to ask about one specific cost or benefit of a policy, and respondents are unsure how to answer if they think that issue is unimportant but disagree/agree for other reasons.
If you read the expert comments, very often they complain that the question is poorly phrased. It’s typically about wording like “would greatly increase” where there’s not even an attempt to define “greatly”. So if you want to improve the panel or replicate it, that is my #1 recommendation.
...My #2 recommendation is to create a Metaculus market for every IGM question and see how it compares.
Additionally, sometimes the question seems to ask about one specific cost or benefit of a policy, and respondents are unsure how to answer if they think that issue is unimportant but disagree/agree for other reasons.