That’s still a very important point that doesn’t seem to have been made in the analysis here: the demographic questions were not included in the questions put to all respondents. Since there are good reasons to think that people taking the “full” and “donations only” survey will differ systematically (e.g. more likely to have been involved with EA for longer). If the non responses are not random that’s an important caveat on all these findings and very much limits any comparisons that can be done over time. I can’t seem to see it discussed in the post?
Yeah. I personally think that offering the donations only survey was a bad idea for the reason that you said and a few other reasons.
Even if everyone took the full survey, the non-response would still be pretty non-random—you still have to have the tenacity to persist to page seven, which I imagine correlates with being more involved in EA and you also have to have taken the survey in the first place, which we also know is not random. It would have been nice to not make this worse, though.
That’s still a very important point that doesn’t seem to have been made in the analysis here: the demographic questions were not included in the questions put to all respondents. Since there are good reasons to think that people taking the “full” and “donations only” survey will differ systematically (e.g. more likely to have been involved with EA for longer). If the non responses are not random that’s an important caveat on all these findings and very much limits any comparisons that can be done over time. I can’t seem to see it discussed in the post?
Yeah. I personally think that offering the donations only survey was a bad idea for the reason that you said and a few other reasons.
Even if everyone took the full survey, the non-response would still be pretty non-random—you still have to have the tenacity to persist to page seven, which I imagine correlates with being more involved in EA and you also have to have taken the survey in the first place, which we also know is not random. It would have been nice to not make this worse, though.