Hi! I’m not an expert in survey design, but I’d love to get the most out of the data you collect here, so some thoughts as I read through it (ignore if unhelpful):
“Think about the other people who work with you at your organization: Are managers and supervisors at your organization disproportionately one gender? If so, which?”
I would find this more helpful if it asked what percentage of managers and supervisors at my organization were men (or women or also asked about nonbinary) to get numerical and not make too much depend on what “disproportionate” means
“Think about your interactions in EA social spaces (e.g. conferences, social retreats). While in these spaces, how often have you felt, or do you feel, each of the following? (Don’t worry about whether you can pinpoint exact moments.)”
Really interested in this, and I’m glad you pulled professional contexts out, though I’d also really want to know about conferences and retreats separate from general social spaces
“Think of all the granters and regranters you’ve ever known of or heard about. How many of them were of what gender? (# women, # men, # third gender/nonbinary, etc.)”
This seems most useful as numerical answers rather than having them all put in the same box for data analysis purposes
“If you hypothetically raised concerns about cause area prioritization on the EA Forum, how confident do you feel that your concerns would be taken seriously?
I realize all of these things are fuzzy, and it’s still good to know about fuzzy things, but I would understand results better with some operationalization of taken seriously.
“Have you ever encountered any of these behaviors while at work?”
Might be more helpful to have the frequency markers than the yes/no? I realize this makes the survey longer.
It’s always easier to critique than to make things, so kudos for trying to do a thing and hope this is helpful.
(I’ll also probably just flag the obvious about selection bias and the sensitivity of this data.)
+1, thanks for designing this! Another thing that wasn’t entirely clear to me was whether questions like “Have you made professional decisions based on wanting to escape a particular group of coworkers or company culture?” and “Have you ever experienced any of these behaviors while at work, or from your coworkers, managers, or other individuals you knew in a professional setting?” were meant to refer to my current role, or my entire career.
Likewise I wasn’t sure if this one was meant to be specific to EA spaces or to every social space I’ve ever been in: “Have you ever experienced retaliation for rejected romantic or sexual advances in your social sphere?”
Hi! I’m not an expert in survey design, but I’d love to get the most out of the data you collect here, so some thoughts as I read through it (ignore if unhelpful):
“Think about the other people who work with you at your organization: Are managers and supervisors at your organization disproportionately one gender? If so, which?”
I would find this more helpful if it asked what percentage of managers and supervisors at my organization were men (or women or also asked about nonbinary) to get numerical and not make too much depend on what “disproportionate” means
“Think about your interactions in EA social spaces (e.g. conferences, social retreats). While in these spaces, how often have you felt, or do you feel, each of the following? (Don’t worry about whether you can pinpoint exact moments.)”
Really interested in this, and I’m glad you pulled professional contexts out, though I’d also really want to know about conferences and retreats separate from general social spaces
“Think of all the granters and regranters you’ve ever known of or heard about. How many of them were of what gender? (# women, # men, # third gender/nonbinary, etc.)”
This seems most useful as numerical answers rather than having them all put in the same box for data analysis purposes
“If you hypothetically raised concerns about cause area prioritization on the EA Forum, how confident do you feel that your concerns would be taken seriously?
I realize all of these things are fuzzy, and it’s still good to know about fuzzy things, but I would understand results better with some operationalization of taken seriously.
“Have you ever encountered any of these behaviors while at work?”
Might be more helpful to have the frequency markers than the yes/no? I realize this makes the survey longer.
It’s always easier to critique than to make things, so kudos for trying to do a thing and hope this is helpful.
(I’ll also probably just flag the obvious about selection bias and the sensitivity of this data.)
+1, thanks for designing this! Another thing that wasn’t entirely clear to me was whether questions like “Have you made professional decisions based on wanting to escape a particular group of coworkers or company culture?” and “Have you ever experienced any of these behaviors while at work, or from your coworkers, managers, or other individuals you knew in a professional setting?” were meant to refer to my current role, or my entire career.
Likewise I wasn’t sure if this one was meant to be specific to EA spaces or to every social space I’ve ever been in: “Have you ever experienced retaliation for rejected romantic or sexual advances in your social sphere?”