But I would guess that about the closest you can get is doing user interviews (or surveys but I don’t think you could get many people to fill them out) multiple months out, and just asking people how they think it affected them, and how counterfactual they think that impact was. I think people will have good enough insight here for this to get you most of the valuable information. My first EAG was the difference between me working in an EA org and being a software engineering. My most recent EAG did almost nothing for me, on reflection, even though I made new connections and rated it very highly.
I think just asking this directly probably gets us closer than trying to assign what portion of the impact each particular event might get, even though I agree in reality the picture is much more complicated than this.
And if anyone has ideas on how to do better impact on analysis than this on events, PLEASE tell me. But I think this is already a huge improvement on my sense of what the default impact analysis for EA events is, and anything more complicated won’t give us too much more information.
I have not!
But I would guess that about the closest you can get is doing user interviews (or surveys but I don’t think you could get many people to fill them out) multiple months out, and just asking people how they think it affected them, and how counterfactual they think that impact was. I think people will have good enough insight here for this to get you most of the valuable information. My first EAG was the difference between me working in an EA org and being a software engineering. My most recent EAG did almost nothing for me, on reflection, even though I made new connections and rated it very highly.
I think just asking this directly probably gets us closer than trying to assign what portion of the impact each particular event might get, even though I agree in reality the picture is much more complicated than this.
And if anyone has ideas on how to do better impact on analysis than this on events, PLEASE tell me. But I think this is already a huge improvement on my sense of what the default impact analysis for EA events is, and anything more complicated won’t give us too much more information.