Yes. We may not be that far apart on this one now. The validity of the results is only as good as the extent to which the answer stems accurately convey what you are trying to measure.
Although I understand why Nathan wrote it as he did, this answer stem isn’t (in my opinion) a good reflection of the underlying text because that text used “select” in a less common way that is only clear in context. Thus, the response to the stem only has validity, at most, for what the stem itself actually says.
I think the need for a summary to accurately reflect the idea in question is endemic to all attempts to gauge opinion, not just this method. Writing good summaries can be hard.
Yes. We may not be that far apart on this one now. The validity of the results is only as good as the extent to which the answer stems accurately convey what you are trying to measure.
Although I understand why Nathan wrote it as he did, this answer stem isn’t (in my opinion) a good reflection of the underlying text because that text used “select” in a less common way that is only clear in context. Thus, the response to the stem only has validity, at most, for what the stem itself actually says.
I think the need for a summary to accurately reflect the idea in question is endemic to all attempts to gauge opinion, not just this method. Writing good summaries can be hard.