Humans in general often don’t take critical feedback nearly as seriously as they should, and often don’t adjust their thinking/actions due to sunk costs, wanting to save face in their peer group, grandiose personality, etc. This also applies to EAs (maybe somewhat but not vastly less so).
Agree that this can be tough (from experience). I would add that it can be emotionally draining, especially if the feedback is uncharitable or has some basis of misunderstanding or factual error. Also, it can be further complicated if after reflection one still doesn’t fully agree with the feedback and there is a genuine philosophical disagreement. (NB I’m happy to have received feedback from Jonas Vollmer and think it has/will make the EA Hotel project stronger; “uncharitable or has some basis of misunderstanding or factual error” does not apply to his feedback).
Aaron Gertler’s approach of “looking at the Hotel’s guest list, picking the best-sounding project, and offering money directly to the person behind it.”
This does require the hotel to exist though (or something like it). See my comment here.
I have also shared some thoughts for how to design the admission process with EA Hotel staff.
Based on some initial ideas from Jonas, we are working on a rating system for applicants and ongoing hosted projects. Tentatively it might be something like a logarithmic scale of EV, {-5,+5} with +1 = giving the money to GiveDirectly*. Trustees/Manager in one anonymous pool, Advisors in another. Bayesian priors stated in words. 95% confidence intervals given. Another round of scoring after seeing others’ input and discussion (special care taken to discuss when ratings <=-1 are given). Final scores aggregated. Guests accepted if clearing a bar of +1 (to increase with diminishing capacity). If falling below, guests have 3 months to pivot/improve.
*Would be interested in comparing with any numerical schemes other EA grantmakers are using.
Agree that this can be tough (from experience). I would add that it can be emotionally draining, especially if the feedback is uncharitable or has some basis of misunderstanding or factual error. Also, it can be further complicated if after reflection one still doesn’t fully agree with the feedback and there is a genuine philosophical disagreement. (NB I’m happy to have received feedback from Jonas Vollmer and think it has/will make the EA Hotel project stronger; “uncharitable or has some basis of misunderstanding or factual error” does not apply to his feedback).
This does require the hotel to exist though (or something like it). See my comment here.
Based on some initial ideas from Jonas, we are working on a rating system for applicants and ongoing hosted projects. Tentatively it might be something like a logarithmic scale of EV, {-5,+5} with +1 = giving the money to GiveDirectly*. Trustees/Manager in one anonymous pool, Advisors in another. Bayesian priors stated in words. 95% confidence intervals given. Another round of scoring after seeing others’ input and discussion (special care taken to discuss when ratings <=-1 are given). Final scores aggregated. Guests accepted if clearing a bar of +1 (to increase with diminishing capacity). If falling below, guests have 3 months to pivot/improve.
*Would be interested in comparing with any numerical schemes other EA grantmakers are using.
I agree. The changes you’re making seem great! I also like the concise description.
(Will get back on some of the details via email, e.g., not sure 95% CIs are worth the effort.)
(Strong upvoted.)