Agreed! As well as a careful sampling plan, things to think about in advance are: how will your questions be tested (to make sure you are asking about the information you think you are asking about). To be rigorous, you should also have a pre-specified analysis plan, which includes what comparisons you are going to make, what tests are appropriate for the data set, and how big your sample needs to be to detect the difference you are interested in.
The planning and design of surveys is a whole area of study. I would suggest finding someone knowledgeable in it to help. It’s possible somebody studying a relevant subject might be able to get involved and help you as part of their coursework. (At Oxford University these things are taught in Health Sciences, and there are study design modules that have projects doing just that)
Agreed! As well as a careful sampling plan, things to think about in advance are: how will your questions be tested (to make sure you are asking about the information you think you are asking about). To be rigorous, you should also have a pre-specified analysis plan, which includes what comparisons you are going to make, what tests are appropriate for the data set, and how big your sample needs to be to detect the difference you are interested in.
The planning and design of surveys is a whole area of study. I would suggest finding someone knowledgeable in it to help. It’s possible somebody studying a relevant subject might be able to get involved and help you as part of their coursework. (At Oxford University these things are taught in Health Sciences, and there are study design modules that have projects doing just that)