A past event has shown how reputation damage to one EA entity can affect the entire movementâs credibility and therefore funding and influence. While GiveWellâs evaluation process is thorough, it largely relies on charity-provided data. I propose they consider implementing independent verification methods.
Reliance on coverage surveys
GiveWell performs no independent verification of their charityâs claims to draw their conclusions. However they do do a downward adjustment.
Getting numbers that are closer to reality not only increases the cost effectiveness calculation accuracy but also reduces the risk of adding a new entry to their mistake list.
GiveWell is an important cornerstone of the movement and thus preserving its reputation should be further explored to see if more could be done.
GiveWellâs Response
GiveWell would also like to improve in this area. Some work has already been done. However, this year our cross-cutting research subteam, which focuses on high-priority questions affecting all intervention areas, plans to improve our coverage survey estimates. Examples of work weâve done to address our concerns with coverage survey estimates include:
Our research team is working on a project to identify, connect with, and potentially test different external evaluator organizations to make it easier for grantmakers to identify well-suited evaluation partners for the questions theyâre trying to answer.
We recently approved a grant to Busara Center to conduct a qualitative survey of actors in Helen Keller Intlâs vitamin A supplementation delivery, including caregivers of children who receive vitamin A supplementation.
We made a grant to IDinsight to review and provide feedback on Against Malaria Foundationâs monitoring process for their 2025 campaign in Democratic Republic of the Congo.
For New Incentives, we mainly rely on the randomized controlled trial of their work to estimate coverage, which was run by an independent evaluator, IDinsight. Only recently have we begun to give weight to their coverage surveys.
We funded a Tufts University study to compare findings to Evidence Actionâs internal monitoring and evaluation for their Dispensers for Safe Water program, which caused us to update our coverage data and consider funding an external coverage survey.
Reputation Hardening: GiveWell
Edit: GiveWellâs Response at the Bottom
A past event has shown how reputation damage to one EA entity can affect the entire movementâs credibility and therefore funding and influence. While GiveWellâs evaluation process is thorough, it largely relies on charity-provided data. I propose they consider implementing independent verification methods.
Reliance on coverage surveys
GiveWell performs no independent verification of their charityâs claims to draw their conclusions. However they do do a downward adjustment.
Malaria Consortiumâs seasonal malaria chemoprevention program: â2%
Against Malaria Foundation: â4%
Helen Keller Intlâs vitamin A supplementation program: â17%
New Incentivesâ conditional cash transfers for childhood vaccination: â2%
This feels lacking.
Getting numbers that are closer to reality not only increases the cost effectiveness calculation accuracy but also reduces the risk of adding a new entry to their mistake list.
Suggestions to shore it up
Mystery evaluators conducting unannounced site visits
Independent surveyors (potentially hiring former charity employees) collecting impact data
Creating funding opportunities for third-party monitoring organizations. GiveWell have already been involved in market shaping
GiveWell is an important cornerstone of the movement and thus preserving its reputation should be further explored to see if more could be done.
GiveWellâs Response
GiveWell would also like to improve in this area. Some work has already been done. However, this year our cross-cutting research subteam, which focuses on high-priority questions affecting all intervention areas, plans to improve our coverage survey estimates. Examples of work weâve done to address our concerns with coverage survey estimates include:
Our research team is working on a project to identify, connect with, and potentially test different external evaluator organizations to make it easier for grantmakers to identify well-suited evaluation partners for the questions theyâre trying to answer.
We recently approved a grant to Busara Center to conduct a qualitative survey of actors in Helen Keller Intlâs vitamin A supplementation delivery, including caregivers of children who receive vitamin A supplementation.
We made a grant to IDinsight to review and provide feedback on Against Malaria Foundationâs monitoring process for their 2025 campaign in Democratic Republic of the Congo.
For New Incentives, we mainly rely on the randomized controlled trial of their work to estimate coverage, which was run by an independent evaluator, IDinsight. Only recently have we begun to give weight to their coverage surveys.
We funded a Tufts University study to compare findings to Evidence Actionâs internal monitoring and evaluation for their Dispensers for Safe Water program, which caused us to update our coverage data and consider funding an external coverage survey.
Our grant to CHAI to strengthen and support a community-based tuberculosis household contact management program includes IDinsight to evaluate the program through a large-scale cluster randomized control trial (cRCT) and process evaluation.