Thanks for this, it was useful advice even for me as someone who has done quite a few surveys.
I agree with the suggestions and with most of what DM has said to follow up.
Probably, the most generalisable lesson we learned is more meta: if youâre thinking of running a large scale survey, you should seriously consider having at least one person on your team who has experience with surveys.
I definitely agree with this. An approach that we use at READI is to try to involve several âtopicâ and âmethodologicalâ experts in every research project to minimise the risk of errors and oversights. We share a protocol/âplan with them before we preregister it so that they can assess materials. Then we engage them again at analysis and write up so they can check that we executed the plan appropriately.
It generally doesnât take much of their time (maybe 2-20 hours each over a projectâwe should have a good estimate of the exact time taken in the future once we have had more projects complete (i.e., end in publication)).
In my experience, such experts are also are relatively happy with the pay-off of a publication or acknowledgement for a few hours of work so it is a relatively fair and sustainable exchange (again, we will soon have better data on that).
Finally, this probably wonât be useful for most readers but just in case, these resources (a free chapter/â and two related blog posts (part 1/â part 2)) provide a lot of introductory advice for doing âaudience researchâ.
Iâd also suggest the Sage series on research methods as a good resource for non-experts who want at least a basic level of understanding of what to do. In this case, Fowlerâs âSurvey Research Methodsâ would have provided most of these insights without trial and errorâitâs around 150 pages, but itâs not heavy reading.
Thanks for this, it was useful advice even for me as someone who has done quite a few surveys.
I agree with the suggestions and with most of what DM has said to follow up.
I definitely agree with this. An approach that we use at READI is to try to involve several âtopicâ and âmethodologicalâ experts in every research project to minimise the risk of errors and oversights. We share a protocol/âplan with them before we preregister it so that they can assess materials. Then we engage them again at analysis and write up so they can check that we executed the plan appropriately.
It generally doesnât take much of their time (maybe 2-20 hours each over a projectâwe should have a good estimate of the exact time taken in the future once we have had more projects complete (i.e., end in publication)).
In my experience, such experts are also are relatively happy with the pay-off of a publication or acknowledgement for a few hours of work so it is a relatively fair and sustainable exchange (again, we will soon have better data on that).
Finally, this probably wonât be useful for most readers but just in case, these resources (a free chapter/â and two related blog posts (part 1/â part 2)) provide a lot of introductory advice for doing âaudience researchâ.
Iâd also suggest the Sage series on research methods as a good resource for non-experts who want at least a basic level of understanding of what to do. In this case, Fowlerâs âSurvey Research Methodsâ would have provided most of these insights without trial and errorâitâs around 150 pages, but itâs not heavy reading.