It looks like you’re asking people to estimate impact while still at the conference, which seems much too short for me. Is there a follow-up survey asking for reports 6 months later? 5 years?
Yes, we also run follow-up surveys, usually 3 months after the event. We think these are better for measuring impact.
We don’t expect attendees to estimate the overall impact of the event for them while at the event, that’s our mistake (we had written “The EA Global team uses several key metrics to estimate the impact of our events” but we’ve changed that to “The EA Global team tracks several key metrics for our events”).
We do ask for valuable experiences, but we’re not asking people to estimate the impact of the event, per se. Our post-event metrics primarily track if the event is something they’d recommend to others, and if it seemed like a good use of their time which are decent proxies for overall event quality and value.
There are other surveys such as Open Phil’s Longtermist Survey and the EA Survey which ask people (often several years after the event) whether it played an important role in their career.
It looks like you’re asking people to estimate impact while still at the conference, which seems much too short for me. Is there a follow-up survey asking for reports 6 months later? 5 years?
Yes, we also run follow-up surveys, usually 3 months after the event. We think these are better for measuring impact.
We don’t expect attendees to estimate the overall impact of the event for them while at the event, that’s our mistake (we had written “The EA Global team uses several key metrics to estimate the impact of our events” but we’ve changed that to “The EA Global team tracks several key metrics for our events”).
We do ask for valuable experiences, but we’re not asking people to estimate the impact of the event, per se. Our post-event metrics primarily track if the event is something they’d recommend to others, and if it seemed like a good use of their time which are decent proxies for overall event quality and value.
There are other surveys such as Open Phil’s Longtermist Survey and the EA Survey which ask people (often several years after the event) whether it played an important role in their career.