Firstly, we should use commercial software to operate the survey rather than trying to build something ourselves. These are both less effort and more reliable. For example, SurveyMonkey could have done everything this survey does for about £300. I’m happy to pay that myself next year to avoid some of the data quality issues.
It does seem clearly to be worth this expense. I’m concerned that .impact/the community team behind the survey are too reluctant to spend money and undervalue the time relative to it. I suppose that’s the cost of not being a funded organization.
asking people to answer a question with a given answer, removing any random clickers or poor quality respondents who are speeding through (eg “Please enter the number ‘2’ in letters into the textbox to prove you are not a robot. For example, the number ‘1’ in letters is ‘one’”)
Seconded—I’d urge the team to do this, even if it means ignoring some genuine answers (I would expect Effective Altruists to generally put enough effort into the survey to spot and complete this question, though I might be naïve).
Thirdly, we should do more testing by trying out draft versions with respondents who have not written the survey.
An excellent suggestion also. I’d be willing to do this—I imagine anyone else who’d volunteer can comment below and hopefully someone from the team will spot this and send messages.
It does seem clearly to be worth this expense. I’m concerned that .impact/the community team behind the survey are too reluctant to spend money and undervalue the time relative to it. I suppose that’s the cost of not being a funded organization.
Seconded—I’d urge the team to do this, even if it means ignoring some genuine answers (I would expect Effective Altruists to generally put enough effort into the survey to spot and complete this question, though I might be naïve).
An excellent suggestion also. I’d be willing to do this—I imagine anyone else who’d volunteer can comment below and hopefully someone from the team will spot this and send messages.
Great suggestion Stens!
I’m happy to trial draft versions of the survey