Thanks Tom.
I’m limited in my spreadsheet wrangling at the moment I’m afraid, but looking at non response rates that are cited in the document above, and comparing to the order or questions, non responses seem to be low (30-50) until the question on income and donation specifics, after which they are much higher (150-220). A question that requires financial specifics seems likely to require someone to stop and seek documents, so could well cause someone to abandon the survey at least temporarily.
If somebody abandoned the survey at that point, would the information they had entered so far be submitted? Or would they have to get to the end and cluck submit for any of their data to be included?
That’s a good point, could well have happened, and is something we should consider changing.
The questions were split into a few pages, and people’s answers got saved when they clicked the ‘Continue’ button at the bottom of each page—so if they only submitted 2 pages, only those pages would be saved. We searched for retakes and saw a small number which we deleted.
I looked for identical names or email addresses, and then manually checked them. The other thing we could do would be to record people’s IP addresses and look for identical ones. However I chose not to record them due to privacy concerns. I would promise not to use them to try guessing who people are, and this identifying data never gets shared with anyone but me—I’d appreciate feedback on whether people would be comfortable with IP addresses getting recorded given this.
Thanks Tom. I’m limited in my spreadsheet wrangling at the moment I’m afraid, but looking at non response rates that are cited in the document above, and comparing to the order or questions, non responses seem to be low (30-50) until the question on income and donation specifics, after which they are much higher (150-220). A question that requires financial specifics seems likely to require someone to stop and seek documents, so could well cause someone to abandon the survey at least temporarily. If somebody abandoned the survey at that point, would the information they had entered so far be submitted? Or would they have to get to the end and cluck submit for any of their data to be included?
That’s a good point, could well have happened, and is something we should consider changing.
The questions were split into a few pages, and people’s answers got saved when they clicked the ‘Continue’ button at the bottom of each page—so if they only submitted 2 pages, only those pages would be saved. We searched for retakes and saw a small number which we deleted.
Oh cool. How were you able to identify duplicates?
I looked for identical names or email addresses, and then manually checked them. The other thing we could do would be to record people’s IP addresses and look for identical ones. However I chose not to record them due to privacy concerns. I would promise not to use them to try guessing who people are, and this identifying data never gets shared with anyone but me—I’d appreciate feedback on whether people would be comfortable with IP addresses getting recorded given this.