You make some really good points about how tricky it is to sample EA, not the least because defining “EA” is so hard. We don’t have any good information to reweigh the population of the survey, so it’s hard to say if our populations are over- or underrepresented, though I would agree with your intuitions.
I don’t remember the survey link and am on several of those mailing lists.
For one example, we did have an entire EA Newsletter dedicated solely to the EA Survey—I’m not sure how to make it more apparent without being obnoxious. I am a bit surprised by how few sign-ups we got through the EA Newsletter. I do agree that the inclusion in some of the other newsletters was more subtle.
Yeah, upon reflection I don’t think the problem is how the survey is presented in a newsletter but whether people read the newsletter at all. Most newsletters end up in the promotions folder on Gmail and I imagine a similar folder elsewhere. What I’ve found in the past is you have to find a way to make it appear as a personal email (not have images or formatting, for example, and use people’s names), and that can get around it sometimes.
What I’ve found in the past is you have to find a way to make it appear as a personal email (not have images or formatting, for example, and use people’s names), and that can get around it sometimes.
We did also send 1-1 personal emails to everyone who gave an email address for past surveys, though we only got three survey completions from this. Maybe we did something wrong here?
I believe the 1-1 personal emails were still sent through a mail service. In my experience (from being the sender for similar emails) those still get caught in promotions or spam a lot of the time.
A solution for this would be to send “normal” emails (not bulk, no images) from a “normal” email address (like Gmail). I’ll definitely consider this for the 2018 survey.
You make some really good points about how tricky it is to sample EA, not the least because defining “EA” is so hard. We don’t have any good information to reweigh the population of the survey, so it’s hard to say if our populations are over- or underrepresented, though I would agree with your intuitions.
For one example, we did have an entire EA Newsletter dedicated solely to the EA Survey—I’m not sure how to make it more apparent without being obnoxious. I am a bit surprised by how few sign-ups we got through the EA Newsletter. I do agree that the inclusion in some of the other newsletters was more subtle.
Yeah, upon reflection I don’t think the problem is how the survey is presented in a newsletter but whether people read the newsletter at all. Most newsletters end up in the promotions folder on Gmail and I imagine a similar folder elsewhere. What I’ve found in the past is you have to find a way to make it appear as a personal email (not have images or formatting, for example, and use people’s names), and that can get around it sometimes.
We did also send 1-1 personal emails to everyone who gave an email address for past surveys, though we only got three survey completions from this. Maybe we did something wrong here?
I believe the 1-1 personal emails were still sent through a mail service. In my experience (from being the sender for similar emails) those still get caught in promotions or spam a lot of the time.
A solution for this would be to send “normal” emails (not bulk, no images) from a “normal” email address (like Gmail). I’ll definitely consider this for the 2018 survey.