Looking into the specifics of the quantification (here and here), I see that this is based on estimating the number of “achievements” per $100k. I think that this is:
Very ingenious: it allows for rapid comparison of many different programs in different areas
Hopefully something that can be refined later: I’m not sure that achievements in different areas should be worth the same, and it’s not clear what goes into an “impact score”.
Yes, and thank you for the detailed private proposal you sent the research team. I didn’t see it but heard about it, and it seems like it was a huge help and just a massive amount of volunteer labor. I know they really appreciated it.
Hi Nuño, we’ve now published our blog post on our approach to assessing Cost Effectiveness, including a charity’s approaches to implementing interventions, their recent achievements, and the costs associated with those achievements. Thanks, Holly
For next year, we are considering moving further toward a quantitative approach that analyzes the level of suffering prevented given the resources used, while also quantifying our level of uncertainty in our estimates. Importantly, we will carefully review the reasoning for moving away from fully quantitative models in the past to avoid reinstating the same limitations.
Thank you for this initial feedback, Nuño—we appreciate you taking the time. In the coming weeks, we’ll be publishing one blog post for each of the evaluation criteria that we use when reviewing charities (for a total of 4 posts). The blog posts will give more detail on how we made our assessments, how this year’s approach differs from previous years, and any limitations we see. The Cost Effectiveness blog post will be published on Dec 15th, so we look forward to sharing more details then.
Looking into the specifics of the quantification (here and here), I see that this is based on estimating the number of “achievements” per $100k. I think that this is:
Very ingenious: it allows for rapid comparison of many different programs in different areas
Hopefully something that can be refined later: I’m not sure that achievements in different areas should be worth the same, and it’s not clear what goes into an “impact score”.
Yes, and thank you for the detailed private proposal you sent the research team. I didn’t see it but heard about it, and it seems like it was a huge help and just a massive amount of volunteer labor. I know they really appreciated it.
Hi Nuño, we’ve now published our blog post on our approach to assessing Cost Effectiveness, including a charity’s approaches to implementing interventions, their recent achievements, and the costs associated with those achievements. Thanks, Holly
Cheers, excited about this:
Thank you for this initial feedback, Nuño—we appreciate you taking the time. In the coming weeks, we’ll be publishing one blog post for each of the evaluation criteria that we use when reviewing charities (for a total of 4 posts). The blog posts will give more detail on how we made our assessments, how this year’s approach differs from previous years, and any limitations we see. The Cost Effectiveness blog post will be published on Dec 15th, so we look forward to sharing more details then.
- Elisabeth