GiveWell

New pod­cast epi­sode: Malaria fund­ing at a crossroads

• GiveWellJul 15, 2025, 10:10 PM

  13 points

  1 ∶ 0

  in reply to: NickLaing’s comment on: San­ity Check—Givewell’s New In­cen­tives es­ti­mate seems optimistic

  Hi Nick,

  Thanks for noting that section of the post could have been clearer! We’ve edited the article to clarify that New Incentives went from serving 70,000 to 1.5 million children per year.

  We agree that the extra lives saved (“indirect deaths” in our analysis) is an interesting question. Both the magnitude of the adjustment and the exact mechanisms (i.e., which other causes those deaths are coming from in the GBD bucket) are major sources of uncertainty in our model, and we don’t currently specify what other deaths are being averted through vaccination in our analysis. We may follow up with a post to share more about our work on indirect deaths in the future.

  Thanks again for the feedback!

• GiveWellJul 14, 2025, 10:30 PM

  19 points

  0 ∶ 0

  on: San­ity Check—Givewell’s New In­cen­tives es­ti­mate seems optimistic

  Hi Nick,
  
  Thank you for providing this feedback! My name is Vicky, and I am a Research Associate at GiveWell, on the vaccines team. We really appreciate these kinds of rough sense checks on our work and thought this was a great approach.
  
  Our lookback includes children enrolled across multiple years of programming (roughly covering 2020 to 2026) whereas the enrollment figures in your estimate only include a single year of program operations.

  • Our lookback aims to roughly capture the impact of our grants which cover New Incentives’ operations from 2020 through 2026. The estimated 1.5 million children enrolled that you cite is based on a single operating year, 2023.^[1] We think New Incentives will enroll closer to 6.3 million children between 2020 and 2026.^[2]

  • Using the same assumption that roughly 81% of children enrolled would be counterfactually vaccinated absent the program,^[3] we estimate that roughly 1.2 million children would be counterfactually vaccinated by the program from 2020 through 2026.^[4]

  • This implies an upper bound of roughly 60,000 deaths averted with your approach (assuming 5% of deaths in unvaccinated children might be preventable as an upper bound).^[5]
    

  We think this difference–the assumed number of children enrolled with GiveWell funding—is the main reason the upper bound you estimated for the number of deaths averted appears significantly lower than the estimates in our lookback, although we’re still exploring other potential discrepancies between the numbers in your approach and our estimates.^[6]
  
  Thanks again for your engagement!

  1. ^

     In 2023, New Incentives reported enrolling 1,518,904 children across 9 states. See New Incentives, 2023 Annual Report, p.8-9

  2. ^

     We estimated this by taking the total amount of funding (roughly $120 million) divided by the cost per child enrolled (roughly $19 per child enrolled) between 2020 and 2024. This assumes that the cost per child enrolled between 2025 and 2026 will remain similar to the historical weighted average.

     • We have not published our most recent estimates yet, but you can see our approach to estimating cost per child enrolled based on data from 2020 through 2023 here.

     • New Incentives publishes enrollment figures here. When calculating the cost per child, we adjust their estimates to account for potential repeat enrollments.

  3. ^

     The 81% in our public report is based on a single state, Bauchi, and the exact percentage differs across states depending on baseline coverage and New Incentives’ expected impact in that state. In addition, we’ve made some internal updates to the model since the last version of our intervention report was published.

  4. ^

     6.3 million * (1 − 81%) = roughly 1.2 million children counterfactually vaccinated by the program.

  5. ^

     1.2 million children counterfactually vaccinated * 5% risk of dying from causes that might be preventable through vaccination = 60,000 deaths potentially averted as an upper bound.

     • The 5% risk of dying parameter is derived from two assumptions in your post:

       • 12.5% of unvaccinated kids might die from non-birth/​neonatal and non-malarial causes.

       • 40% of non-birth/​neonatal and non-nalarial deaths could potentially be vaccine-preventable.

       • 12.5% * 40% = 5%

  6. ^

     Across states where the New Incentives program operates, we estimate that unvaccinated children experience roughly a 3% to 8% chance of dying from vaccine-preventable diseases and that vaccination reduces their risk of dying by roughly 50%, which appears more in-line with your estimates. For more on how we estimate these, see our public report here.

New pod­cast epi­sode: Deep­en­ing GiveWell’s fo­cus on liveli­hoods Programs

New pod­cast epi­sode: Fore­cast­ing the fu­ture of global health funding

• GiveWellJun 20, 2025, 5:58 PM

  16 points

  2 ∶ 1

  on: “Tech­ni­cal Sup­port Units”—A Du­bi­ous GiveWell Grant?

  Thanks for sharing your critique of our recent grants with Open Philanthropy for technical support units (TSUs). We really appreciate this thoughtful pushback! We’ve recommended (and are considering) a number of grants to help respond to the current situation with cuts in US foreign health assistance. So, getting critiques like yours is helpful since it encourages us to pause and consider whether we’re making the right tradeoffs in these grants. While we share some of your perspectives on the uncertainties of this work, we’re still excited about our decision in this case.

  While this grant’s impact is particularly uncertain, we see this as a difference in degree, not kind, compared to other grants we recommend. Most of our funding still goes to Top Charities—proven programs backed by strong evidence and our cost-effectiveness analysis. But we also recommend opportunities through the All Grants Fund. The goal of this fund is to find and fund what we believe are the highest-impact uses of marginal dollars, even when those opportunities are riskier or harder to model. This grant fits squarely in that approach. We’ve funded technical assistance from the All Grants Fund before, alongside grants that are uncertain for other reasons. For example, sometimes we’re trying to generate new evidence, while at other times we’re recommending high expected value bets even when we know we’re unlikely to get a definitive answer on their impact.

  We agree that the evidence base for TSUs is thin. In general, we think it’s challenging to evaluate technical assistance programs because

  • particular programs might not have very convincing controls or comparators and

  • technical assistance packages can vary widely so aggregating results from many programs might not be that informative, even if they’re targeting the same outcome

  So even if the review that Nick cites had found good evidence for past TA programs, we still might not feel sure that it would generalize to the TSUs we recommended funding.

  But as discussed above, we don’t consider high uncertainty to be a dealbreaker in grants funded from the All Grants Fund. We still think it can be worth funding TA (see, e.g., our maternal syphilis grants) and we’re very interested in building up our ability to learn about programs like this over time. (We’re working on a project looking back on a subset of technical assistance grants we’ve funded, but don’t have a publication date for that yet.)

  While we don’t have detailed theories of change, we still think it’s plausible that TSUs could be impactful. We are excited about this grant because we think it could help governments to make difficult prioritization and program adaptation decisions in countries affected by US government funding freezes and cuts. We expect that the details of how this could look will vary by country and so we don’t feel confident that any particular mechanism will cash out in impact. But for example, we think TSUs could help governments to:

  • Adapt programs away from more expensive models implemented with USG support to more cost-efficient models (e.g., by integrating disease-specific verticals or moving from international to local implementing organizations)

  • Target programs (e.g., to certain regions or populations) based on cost-effectiveness analyses

  • Crowd in philanthropic or other funding by identifying funding gaps

  While we think the above examples are plausible, we agree that the theory of change for these programs is not tightly specified. However, we spoke with senior Ministry of Health officials in each country about this grant, and overall governments voiced support and demand for the proposed TSUs and were eager to have CHAI and PATH’s support on this work. We also think both organizations are well-placed to support this work, as both have supported on malaria-specific TSUs in the past, have teams with specific focus on health systems and health financing, and have established relationships with the governments they’re supporting.

  Budget—Thank you for sharing your estimates—this is helpful for us as we continue to update how we review budgets. We’ll share a high level budget breakdown for this grant with our public grant write-ups (which are coming—see below!). One quick clarification (which wasn’t clear in the podcast) is that costs for Nigeria reflect support in seven states as well as national support.

  Outside of that, we think that the higher budget reflects both higher salaries and a higher non-salary budget share (to account for travel, coordinating stakeholder engagement, and support from global technical teams). Our understanding is that salaries are set based on globally-benchmarked salary ranges and localized equity adjustments to account for organizational equitable pay standards and differential cost of living across different geographies. A portion of the compensation costs is also due to benefits (such as health insurance) that may be standard to each location.

  Learning—We agree that we should try to learn about the impact of these grants and also agree with commenters and Nick’s revision that an RCT isn’t an appropriate strategy. We’ve asked CHAI and PATH to track and report out on the following.

  • Process indicators (staff hiring, government engagement, TSU recommendations made and implemented);

  • Case studies of how government prioritization decisions are made;

  • Promising funding opportunities identified through the TSU work;

  • Contexts where cost-effectiveness considerations are or aren’t helpful for government decision-making.

  We’ll attempt to triangulate these reports through speaking with other stakeholders, though we expect we’ll still have substantial uncertainty about impact given the lack of counterfactuals.

  No CEA and grant write up. These are coming! We typically have a lag between making grants and publishing our write-ups, but wanted to share about this grant sooner because we’ve received a lot of interest in our response to the funding cuts. We expect to publish pages for CHAI and PATH (including a rough BOTEC) by the end of June.

  Urgency. We see the urgency here as being specifically related to governments’ needs to adapt to frozen or cut US health assistance: we heard when investigating this grant that governments were already beginning this planning process and that lighter touch versions of the support offered by TSUs were already being provided on nights and weekends by CHAI staff in certain countries. We also think this kind of grant is inherently uncertain and it didn’t seem likely that we’d reduce that uncertainty by spending additional time investigating. So, with apparent demand for support at the time and since we didn’t think waiting would lead to a better decision, we chose to recommend funding relatively quickly.

GiveWell is hiring up to two Strate­gic Com­mu­ni­ca­tions Managers

New pod­cast epi­sode: Ex­plor­ing HIV/​AIDS fund­ing cuts and emerg­ing needs

GiveWell is hiring a Liveli­hoods Pro­gram Officer

• GiveWellMay 16, 2025, 5:34 PM

  4 points

  0 ∶ 0

  in reply to: NickLaing’s comment on: New pod­cast epi­sode: Sup­port­ing gov­ern­ments nav­i­gat­ing US fund­ing cuts

  Hi Nick,

  Thanks for reaching out and for your interest in these grants. We’re currently working on grant write-ups that we plan to publish soon, but unfortunately, we don’t have anything available to share just yet.

New pod­cast epi­sode: Sup­port­ing gov­ern­ments nav­i­gat­ing US fund­ing cuts

New pod­cast epi­sode: Mak­ing cost-effec­tive grants amid uncertainty

GiveWell’s re­sponse to the USAID fund­ing cuts

GiveWell is hiring a Ta­lent Ac­qui­si­tion Specialist

GiveWell is hiring two Pro­gram Officers

GiveWell is hiring a Man­ager of Em­ployee Experience

GiveWell is hiring a Se­nior Accountant

GiveWell is hiring a Man­ager of Ta­lent Acquisition

Are our Top Char­i­ties sav­ing the same lives each year?

Join GiveWell as a Re­search Analyst