Hi, thanks for raising these questions. I lead Open Philanthropy’s biosecurity and pandemic prevention work and I was the investigator of this grant. For context, in September last year, I got an introduction to Helena along with some information about work they were doing in the health policy space. Before recommending the grant, I did some background reference calls on the impact claims they were making, considered similar concerns to ones in this post, and ultimately felt there was enough of a case to place a hits-based bet (especially given the more permissive funding bar at the time).
Just so there’s no confusion: I think it’s easy to misread the nepotism claim as saying that I or Open Phil have a conflict of interest with Helena, and want to clarify that this is not the case. My total interactions with Helena have been three phone calls and some email, all related to health security work.
Just noting that this reply seems to be, to me, very close to content-free, in terms of addressing object-level concerns. I think you could compress it to “I did due diligence” without losing very much.
If you’re constrained in your ability to discuss things on the object-level, i.e. due to promises to keep certain information secret, or other considerations like “discussing policy work in advance of it being done tends to backfire”, I would appreciate that being said explicitly. As it is, I can’t update very much on it.
ETA: to be clear, I’m not sure I how I feel about the broader norm of requesting costly explanations when something looks vaguely off. My first instinct is “against”, but if I were to adopt a policy of not engaging with such requests (unless they actually managed to surface something I’d consider a mistake I didn’t realize I’d made), I’d make that policy explicit.
The “considered similar concerns to ones in this post” part and the explanation of how much investigation went into making the grant seem like content to me?
I think Robert’s comment recognizes there is content related to process (we investigated X, and considered Y concern). As Elias implies, there’s also a bottom-line conclusion (met the old funding bar on a hits-based rationale).
I think when Robert says there is very little content “in terms of addressing object-level concerns,” he may mean something like “there’s very little content here to explain why OP thought there was a sufficient chance of outsized impact to justify awarding the grant on hits-based reasoning.”
very little content here to explain why OP thought there was a sufficient chance of outsized impact
I guess I’m surprised that people are expecting that from OP? They haven’t committed to giving public justifications for their grants, and have written about why they often choose not to.
I got a reply to this as a private message from someone who says they don’t feel comfortable criticizing OP in public:
I wonder if you’ve considered whether it’s reasonable that a large foundation calls itself “Open” Philanthropy even though it decided 6 years ago that openness is not that important to it? I’ve seen EAs criticize OpenAI for not being open but profiting off its name, but no EA criticize Open Philanthropy for the same. Curious to hear what you think.
I replied: I think the name is a somewhat bad fit for the organization, and reflects that their views on transparency changed over time (mostly in their first few years). But they’re still much more open than most foundations, and I don’t think it’s a bad fit to the point that they should change their name.
(They said it was fine to post our exchange publicly.)
That’s their preogative, sure. It is also individuals’ preogative to critique them for that lack of transparency, and to judge the grant on the basis of publicly available information if they wish. (I think when an organization accepts the implied public subsidy that tax-advantaged status provides, it opens itself up to a considerably broader range of scrutiny and criticism than would be fair game without that status.)
I think most people realize there may be grant-specific reasons for a low-transparency approach. There are doubtless cases in which very little information should be disclosed, although I think one could safely disclose more information than this in the vast majority of cases. I think Robert’s bottom-line conclusion that there isn’t much in the response to update with (unless you started with concerns about due dilligence) makes sense. So I think one ultimately has to judge this grant on a combination of publicly available information and one’s priors about OP’s grantmaking skills.
I think when an organization accepts the implied public subsidy that tax-advantaged status provides, it opens itself up to a considerably broader range of scrutiny and criticism than would be fair game without that status.
That’s not where I thought you were going to go with this! If I wrote to a random foundation (ex: Hewlett) and asked why they made a specific grant I think they’d probably decline, and I don’t think there’s any sort of commonly held view that foundations are supposed to be making their evidence and reasoning public in exchange for their tax treatment.
I thought instead you’d say that OP is different because they use the word “open” in their name, initially had a goal of being extremely transparent about their decisions, spun out of GiveWell, cross-pollinate with EA, etc?
I think there are sound practical reasons for OP to be more open-by-default than other foundations. In my view, OP (in conjunction with its financial backers) is the most central animating organization in EA. There are a lot of people who sacrifice a lot for the goals OP is pursuing, and I think having the most central animating organization keep its decisions unnecessarily shrouded in mystery probably hurts community cohesion. But that’s not the reason I think people are entitled to criticize OP here—I think accepting criticism is simply part of the deal when a charity accepts tax-advantaged status.
Another angle, I think, is that the public information on Helena appears to make awarding the grant inconsistent with OP’s stated principles. For instance, if you had a foundation whose stated purpose was to improve the welfare of children, most people would probably look at it funny if it announced a grant to a senior center. Maybe the grant actually serves the foundation’s purposes, but many people wouldn’t be impressed if the hypothetical foundation suggested it was part of a hits-based approach to child welfare with hardly any substantive supporting detail. Given OP’s stated emphasis on effectiveness, and given that Helena appears to be an unusually ineffective charity, that scenario seems somewhat analogous here.
>> OP to be more open-by-default than other foundations
Which foundations do you think are more open than OP? Transparency is a spectrum and OP certainly seems to publish quite a bit. No others have forums dedicated to verbosely tearing apart their grants when they smell weakness.
That said, Open has an oft-forgotten second meaning: OP is open to any cause area in theory. i.e. it is cause neutral.
I think the primary content in ASB’s comment is actually “hits-based”—i.e. this is a grant with a low probability of a big win. To think it is obviously bad, as so many commenters here do, you must have e.g. 90% confidence that the grant won’t result in $5M worth of counterfactual x-risk funding. (I do not have inside information that this was the goal/haven’t talked to ASB about it; it just seems like the right kind of goal for an org focused on “elephant bumping”). Striking this bit out as someone pointed out you might have more rules-based objections to the grant.
Apologies for the snarky language, but I did not mean to disparage the criticisms in the slightest. I think they are quite fine as they are, and do add value (80% confidence). I’m just pointing out that people frequently say there is no scrutiny of OP while engaging in an explicit act of scrutiny.
It’s very true that big philanthropies are surprisingly bad at giving reasons for their grants publicly, and that EA orgs are far better. This is part of the reason I’m a fan of EA philanthropies. The only foundation I know of which writes content reasons for every grant is GiveWell, and besides that very few are more transparent than OP.
I think a reasonable response might be for OpenPhil to not change anything -and list information the same way they do now, but if scrutiny comes like here, then perhaps they could respond in detail. Helena and Atlas I think are the only 2 that have come under the pump recently on the forum—I don’t think moderately in depth and specific replies would be that difficult. There may be on occasions good reasons for not sharing information, then saying that in a reply would be good.
I don’t think that this forum is overly dedicated to verbosely tearing apart grants from OpenPhil. A small percentage of Openphil grants come under scrutiny here, and a lot of respondants to the posters who criticise make efforts to steelman grants. Also just looking at Karma and agreement voting there is more support for defence of OP in the thread than criticism here at least.
As a tiny note—the hits based approach is great no issues there, but with this approach it might be easy and helpful here to outline what the hit would be if successful, and why the org is well placed to potentially (even if low percentage chance) of hitting that home run.
I’m not Nick, but if I were concerned enough about the grant, I would ask if it would be possible to disclose those reasons to a few independent community members under an NDA that allows them to tell the community only whether there were good reasons not to disclose more info, and whether the grant was reasonable in their eyes. That would be cumbersome and only appropriate in fairly rare cases.
I am not personally concerned about this grant very much—I can surmise a plausible and defensible reason for making it that Open Phil would prefer not to disclose, and am OK assuming that was the reason.
“And in general is be interested if there was a format of forum critiques that OP would be most interested in.” I really like this, and feels in the spirit of EA.
I think when an organization accepts the implied public subsidy that tax-advantaged status provides, it opens itself up to a considerably broader range of scrutiny and criticism than would be fair game without that status.
Worth noting that OP’s biosecurity funding comes from a single private individual and is conducted via an LLC, so I don’t think this particular argument works in this particular case.
(To be clear, not trying to say here I agree or disagree with the Helena grant or OP’s approach to transparency on grants—just trying to make this much smaller point)
Can you confirm this is true specifically for biosecurity grants made to 501(c)(3)s like Helena? I know a lot of the biosecurity funding needs to be channeled through for-profit channels because of who the recipients are (or because the transaction is actually an investment vs. a pure grant), but it’s not clear to me why you wouldn’t run a pure grant to a 501(c)(3) through tax-advantaged channels.
I cannot confirm that. Reflecting on what I said, I think I may have misunderstood you at first, and think you have a better point than I first thought.
What Jason has said above is the thrust of my inquiry. If Open Phil said that in weighing the grant impact (as a hits-based grant) the private information they had justified the grant (which is not really what was in the comment on behalf of Open Phil). Then I would accept that as a pragmatic response based on the real world constraints to their grant-making, even if the rationale does not answer my own questions about the grant. I would expect a little more detail about what the grant actually entails, since it is about the least descriptive grant on the website.
It does open up questions about the importance we place on accountability and transparency in regard to norm- and priority-setting within EA and philanthropic giving.
Would do you mean by “costly explanations?” If it’s time you mean wouldn’t have thought OpenPhil spending a couple of hours on a question was that costly given the reputational / community confidence importance of a post like this. Or do you mean the explanation could reveal something which could cost OpenPhil money in the future? Or legal cost? Sorry this might be obvious to most people...
Also I think this grant and org could potentially be interpreted as a bit more than “vaguely off” given that the org has already received some negative public scrutiny and doesn’t have a clear track record.
But I also think the “vaguely off” assessment could be reasonable too.
...coming back to this discussion 6 months later, having had nothing to do with any of this except as an observer, I’m incredibly happy with their recent work. Given that, I think that in retrospect, their work basically fully justifies the grant. (To be clear: a failure does not refute a claim of value based on hits-based giving, at best if functions as weak evidence—but success does strongly justify the claim.)
I had hoped Open Phil could be a bit more specific about this grant and the assessment that was made, and add some more details to your general comment. There might be some reason you can’t answer these questions and if so that’s all good.
What was the good work Helena were doing in the health policy space that made you interested in the organisation?
What were the impact claims Helena was making, and what made you think that Helena might be able to achieve that impact?
Was an expected value calculation done before the grant was given?
Hi, thanks for raising these questions. I lead Open Philanthropy’s biosecurity and pandemic prevention work and I was the investigator of this grant. For context, in September last year, I got an introduction to Helena along with some information about work they were doing in the health policy space. Before recommending the grant, I did some background reference calls on the impact claims they were making, considered similar concerns to ones in this post, and ultimately felt there was enough of a case to place a hits-based bet (especially given the more permissive funding bar at the time).
Just so there’s no confusion: I think it’s easy to misread the nepotism claim as saying that I or Open Phil have a conflict of interest with Helena, and want to clarify that this is not the case. My total interactions with Helena have been three phone calls and some email, all related to health security work.
Just noting that this reply seems to be, to me, very close to content-free, in terms of addressing object-level concerns. I think you could compress it to “I did due diligence” without losing very much.
If you’re constrained in your ability to discuss things on the object-level, i.e. due to promises to keep certain information secret, or other considerations like “discussing policy work in advance of it being done tends to backfire”, I would appreciate that being said explicitly. As it is, I can’t update very much on it.
ETA: to be clear, I’m not sure I how I feel about the broader norm of requesting costly explanations when something looks vaguely off. My first instinct is “against”, but if I were to adopt a policy of not engaging with such requests (unless they actually managed to surface something I’d consider a mistake I didn’t realize I’d made), I’d make that policy explicit.
The “considered similar concerns to ones in this post” part and the explanation of how much investigation went into making the grant seem like content to me?
I think Robert’s comment recognizes there is content related to process (we investigated X, and considered Y concern). As Elias implies, there’s also a bottom-line conclusion (met the old funding bar on a hits-based rationale).
I think when Robert says there is very little content “in terms of addressing object-level concerns,” he may mean something like “there’s very little content here to explain why OP thought there was a sufficient chance of outsized impact to justify awarding the grant on hits-based reasoning.”
I guess I’m surprised that people are expecting that from OP? They haven’t committed to giving public justifications for their grants, and have written about why they often choose not to.
I got a reply to this as a private message from someone who says they don’t feel comfortable criticizing OP in public:
I replied: I think the name is a somewhat bad fit for the organization, and reflects that their views on transparency changed over time (mostly in their first few years). But they’re still much more open than most foundations, and I don’t think it’s a bad fit to the point that they should change their name.
(They said it was fine to post our exchange publicly.)
That’s their preogative, sure. It is also individuals’ preogative to critique them for that lack of transparency, and to judge the grant on the basis of publicly available information if they wish. (I think when an organization accepts the implied public subsidy that tax-advantaged status provides, it opens itself up to a considerably broader range of scrutiny and criticism than would be fair game without that status.)
I think most people realize there may be grant-specific reasons for a low-transparency approach. There are doubtless cases in which very little information should be disclosed, although I think one could safely disclose more information than this in the vast majority of cases. I think Robert’s bottom-line conclusion that there isn’t much in the response to update with (unless you started with concerns about due dilligence) makes sense. So I think one ultimately has to judge this grant on a combination of publicly available information and one’s priors about OP’s grantmaking skills.
That’s not where I thought you were going to go with this! If I wrote to a random foundation (ex: Hewlett) and asked why they made a specific grant I think they’d probably decline, and I don’t think there’s any sort of commonly held view that foundations are supposed to be making their evidence and reasoning public in exchange for their tax treatment.
I thought instead you’d say that OP is different because they use the word “open” in their name, initially had a goal of being extremely transparent about their decisions, spun out of GiveWell, cross-pollinate with EA, etc?
I think there are sound practical reasons for OP to be more open-by-default than other foundations. In my view, OP (in conjunction with its financial backers) is the most central animating organization in EA. There are a lot of people who sacrifice a lot for the goals OP is pursuing, and I think having the most central animating organization keep its decisions unnecessarily shrouded in mystery probably hurts community cohesion. But that’s not the reason I think people are entitled to criticize OP here—I think accepting criticism is simply part of the deal when a charity accepts tax-advantaged status.
Another angle, I think, is that the public information on Helena appears to make awarding the grant inconsistent with OP’s stated principles. For instance, if you had a foundation whose stated purpose was to improve the welfare of children, most people would probably look at it funny if it announced a grant to a senior center. Maybe the grant actually serves the foundation’s purposes, but many people wouldn’t be impressed if the hypothetical foundation suggested it was part of a hits-based approach to child welfare with hardly any substantive supporting detail. Given OP’s stated emphasis on effectiveness, and given that Helena appears to be an unusually ineffective charity, that scenario seems somewhat analogous here.
>> OP to be more open-by-default than other foundations
Which foundations do you think are more open than OP? Transparency is a spectrum and OP certainly seems to publish quite a bit. No others have forums dedicated to verbosely tearing apart their grants when they smell weakness.
That said, Open has an oft-forgotten second meaning: OP is open to any cause area in theory. i.e. it is cause neutral.
I think the primary content in ASB’s comment is actually “hits-based”—i.e. this is a grant with a low probability of a big win.
To think it isobviouslybad, as so many commenters here do, you must have e.g. 90% confidence that the grant won’t result in $5M worth of counterfactual x-risk funding. (I do not have inside information that this was the goal/haven’t talked to ASB about it; it just seems like the right kind of goal for an org focused on “elephant bumping”).Striking this bit out as someone pointed out you might have more rules-based objections to the grant.“No others have forums dedicated to verbosely tearing apart their grants when they smell weakness.”
How could people’s input be best framed? Do you think this critique adds any value? I guess it does, so how best to frame it?
Apologies for the snarky language, but I did not mean to disparage the criticisms in the slightest. I think they are quite fine as they are, and do add value (80% confidence). I’m just pointing out that people frequently say there is no scrutiny of OP while engaging in an explicit act of scrutiny.
It’s very true that big philanthropies are surprisingly bad at giving reasons for their grants publicly, and that EA orgs are far better. This is part of the reason I’m a fan of EA philanthropies. The only foundation I know of which writes content reasons for every grant is GiveWell, and besides that very few are more transparent than OP.
I think a reasonable response might be for OpenPhil to not change anything -and list information the same way they do now, but if scrutiny comes like here, then perhaps they could respond in detail. Helena and Atlas I think are the only 2 that have come under the pump recently on the forum—I don’t think moderately in depth and specific replies would be that difficult. There may be on occasions good reasons for not sharing information, then saying that in a reply would be good.
I don’t think that this forum is overly dedicated to verbosely tearing apart grants from OpenPhil. A small percentage of Openphil grants come under scrutiny here, and a lot of respondants to the posters who criticise make efforts to steelman grants. Also just looking at Karma and agreement voting there is more support for defence of OP in the thread than criticism here at least.
As a tiny note—the hits based approach is great no issues there, but with this approach it might be easy and helpful here to outline what the hit would be if successful, and why the org is well placed to potentially (even if low percentage chance) of hitting that home run.
If ASB said “there are good reasons not to provide more details”, would you accept that, or ask for the reasons?
I’m not Nick, but if I were concerned enough about the grant, I would ask if it would be possible to disclose those reasons to a few independent community members under an NDA that allows them to tell the community only whether there were good reasons not to disclose more info, and whether the grant was reasonable in their eyes. That would be cumbersome and only appropriate in fairly rare cases.
I am not personally concerned about this grant very much—I can surmise a plausible and defensible reason for making it that Open Phil would prefer not to disclose, and am OK assuming that was the reason.
Yea that’s reasonable.
Thanks yes i would accept that and what Jason said below would be absolute gold standard.
Great.
And in general is be interested if there was a format of forum critiques that OP would be most interested in.
Also, for Nuno I’ll ask when OP gonna let us bet against them.
“And in general is be interested if there was a format of forum critiques that OP would be most interested in.” I really like this, and feels in the spirit of EA.
Worth noting that OP’s biosecurity funding comes from a single private individual and is conducted via an LLC, so I don’t think this particular argument works in this particular case.
(To be clear, not trying to say here I agree or disagree with the Helena grant or OP’s approach to transparency on grants—just trying to make this much smaller point)
Can you confirm this is true specifically for biosecurity grants made to 501(c)(3)s like Helena? I know a lot of the biosecurity funding needs to be channeled through for-profit channels because of who the recipients are (or because the transaction is actually an investment vs. a pure grant), but it’s not clear to me why you wouldn’t run a pure grant to a 501(c)(3) through tax-advantaged channels.
I cannot confirm that. Reflecting on what I said, I think I may have misunderstood you at first, and think you have a better point than I first thought.
What Jason has said above is the thrust of my inquiry. If Open Phil said that in weighing the grant impact (as a hits-based grant) the private information they had justified the grant (which is not really what was in the comment on behalf of Open Phil). Then I would accept that as a pragmatic response based on the real world constraints to their grant-making, even if the rationale does not answer my own questions about the grant. I would expect a little more detail about what the grant actually entails, since it is about the least descriptive grant on the website.
It does open up questions about the importance we place on accountability and transparency in regard to norm- and priority-setting within EA and philanthropic giving.
Basically what Jason said, yes. The process described sounds reasonable but my prior, even given this post, was that it would sound reasonable.
I think it might match your prior, but it doesn’t seem to me like it matches the prior of the person writing the post?
Agree with your take nice one!
Would do you mean by “costly explanations?” If it’s time you mean wouldn’t have thought OpenPhil spending a couple of hours on a question was that costly given the reputational / community confidence importance of a post like this. Or do you mean the explanation could reveal something which could cost OpenPhil money in the future? Or legal cost? Sorry this might be obvious to most people...
Also I think this grant and org could potentially be interpreted as a bit more than “vaguely off” given that the org has already received some negative public scrutiny and doesn’t have a clear
track record.
But I also think the “vaguely off” assessment could be reasonable too.
Nice one.
There does seem to be non-negligible content in the references to hits-based giving and the lower funding bar, but otherwise I agree.
...coming back to this discussion 6 months later, having had nothing to do with any of this except as an observer, I’m incredibly happy with their recent work. Given that, I think that in retrospect, their work basically fully justifies the grant. (To be clear: a failure does not refute a claim of value based on hits-based giving, at best if functions as weak evidence—but success does strongly justify the claim.)
Thanks ASB
I had hoped Open Phil could be a bit more specific about this grant and the assessment that was made, and add some more details to your general comment. There might be some reason you can’t answer these questions and if so that’s all good.
What was the good work Helena were doing in the health policy space that made you interested in the organisation?
What were the impact claims Helena was making, and what made you think that Helena might be able to achieve that impact?
Was an expected value calculation done before the grant was given?
Thanks.