I really love the visuals of the voting tool, here’s how we could make it even better for future iterations.
The axes currently aren’t labeled and, if I’m being really honest I ended up being too lazy to vote as I would have had to count up the notches manually. I’m pretty sure I’m not the only one (see Beware Trivial Inconveniences).
I also suspect that it makes the results less meaningful. Even though people have wildly different views on what 7⁄10 or strongly agree means, there’s still some degree of social consensus that has implicitly formed around these from use. Since this is a relatively novel interface, there’s going to be a lot more variation in terms of what three notches means for one person versus another.
Anyway, thanks again to the team for building the tool/running this debate week!
I like the idea of operationalizing the Agree/Disagree as probability that the statement is true. So “Agree” is 100%, neutral is 50%, disagree is 0%. In this case, 20% vs 40% means something concrete.
I wonder if we’d rather capture something like “how strongly this is true” (e.g. would $100m be much better spent on animals...) which captures both confidence and importance.
I really love the visuals of the voting tool, here’s how we could make it even better for future iterations.
The axes currently aren’t labeled and, if I’m being really honest I ended up being too lazy to vote as I would have had to count up the notches manually. I’m pretty sure I’m not the only one (see Beware Trivial Inconveniences).
I also suspect that it makes the results less meaningful. Even though people have wildly different views on what 7⁄10 or strongly agree means, there’s still some degree of social consensus that has implicitly formed around these from use. Since this is a relatively novel interface, there’s going to be a lot more variation in terms of what three notches means for one person versus another.
Anyway, thanks again to the team for building the tool/running this debate week!
That’s helpful- thanks! Should be an easy one to fix next time.
I like the idea of operationalizing the Agree/Disagree as probability that the statement is true. So “Agree” is 100%, neutral is 50%, disagree is 0%. In this case, 20% vs 40% means something concrete.
I wonder if we’d rather capture something like “how strongly this is true” (e.g. would $100m be much better spent on animals...) which captures both confidence and importance.
That sounds great too. Perhaps both axes labels should be possible and it should just be specified for each question asked.