What do you think of your sample size? Is it hard to draw inferences from 300 people?
Also I’d be careful about drawing inferences from data via Prolific without attempts to reweigh the sample for representativeness. The raw Prolific crew is quite liberal and quite educated. 74% of them voted for Joe Biden over Donald Trump.
Hi Peter, thanks for your comment. We do think the conclusions we draw are robust based on our sample size. If course it depends on the signal: if there’s a change in e.g. awareness from 5% to 50%, a small sample size should be plenty to show that. However, if you’re trying to measure a signal of only 1% difference, your sample size should be much larger. While we stand by our conclusions, we do think there would be significant value in others doing similar research, if possible with larger sample sizes.
Again, thanks for your comments, we take the input into account.
What do you think of your sample size? Is it hard to draw inferences from 300 people?
Also I’d be careful about drawing inferences from data via Prolific without attempts to reweigh the sample for representativeness. The raw Prolific crew is quite liberal and quite educated. 74% of them voted for Joe Biden over Donald Trump.
Hi Peter, thanks for your comment. We do think the conclusions we draw are robust based on our sample size. If course it depends on the signal: if there’s a change in e.g. awareness from 5% to 50%, a small sample size should be plenty to show that. However, if you’re trying to measure a signal of only 1% difference, your sample size should be much larger. While we stand by our conclusions, we do think there would be significant value in others doing similar research, if possible with larger sample sizes.
Again, thanks for your comments, we take the input into account.