Note: The Open Philanthropy Project was formerly known as GiveWell Labs. Before the launch of the Open Philanthropy Project Blog, this post appeared on the GiveWell Blog. Uses of “we” and “our” in the below post may refer to the Open Philanthropy Project or to GiveWell as an organization. Additional comments may be available at the original post.
As noted previously, I’ve been exploring the question, “What are the best opportunities for funders aiming to contribute to progress in life sciences (i.e., biology and medicine)?” This post lays out what we’ve done to date and how we plan to move forward.
The basic approach I’ve taken: interviews and immersion
Because this area is so different from anything GiveWell has looked at before, I’ve initially tried to “immerse” myself in it: I’ve taken opportunities to have extended and low-stakes interactions with scientists and learn a little bit of the basic knowledge underlying life sciences, without having specific questions or goals in mind.
For the early stages of investigation, Dario has served as our informal scientific advisor,* guiding our investigation by recommending readings, offering connections, etc. I feel that he has been a good fit for this role because he combines experience as a scientist with an extremely strong understanding of GiveWell’s values and goals, and is highly accessible to us. We’ve come to believe that in the early stages of an investigation, when we often don’t know which questions to ask, the ability to have extended, repeated, friendly, low-stakes interactions to get “grounded in the basics” is crucial, and we’ve taken a similar approach to exploring policy advocacy (which we wrote about previously).
Under Dario’s guidance, I have:
Conducted a series of interviews with representatives of major life sciences funders including Howard Hughes Medical Institute (the largest private philanthropic funder of scientific research in the U.S.), Wellcome Trust (the largest private philanthropic funder of life sciences in the U.K., with similar scale to Howard Hughes and to the British government’s research funding), and the American Cancer Society. (We have also had several other off-the-record conversations, including with U.S. government staff.)
Studied a small amount of the basics of cell biology. Specifically, I read chapters 1, 5, 6, 7, 8, 18 and 20 from Essential Cell Biology; reviewed the more detailed version of chapter 7; and questioned Dario about them at length. The two of us also discussed the abstracts of several NIH grant proposals and Nature papers. The goal here was simply to improve my basic comprehension of common terms used in discussing life sciences; after the calls discussed above, he and I agreed that it was important for me to improve on this front.
Taken opportunities to attend larger meetings of scientists in appropriate settings: relatively low-stakes settings in which communication in layperson’s terms was encouraged. I attended a meeting at the Banbury Center, intended to bring together people with different areas of expertise to discuss possible approaches to oncology; a meeting organized by Good Ventures (with Dario’s help) to discuss potential prizes in science; and several meetings of Vannevar Group. All of these meetings were organized by Dario or people in his network.
Several perspectives on giving opportunities aiming at furthering progress in life sciences
One natural way to look for underfunded opportunities is to focus on the question of “what diseases and conditions should be getting more focus and funding?” It’s possible that some diseases and conditions are overlooked because they primarily affect people in the developing world (for example, malaria and tuberculosis); it’s possible that some are overlooked because they don’t have the same sorts of interest groups behind them (for example, chronic pain and other symptoms of aging, which have no analogue to groups like American Cancer Society). Prior to starting this investigation, this was the main framework we were thinking about for finding overlooked giving opportunities, and we believe there may be a lot of potential in thinking in this way.
However, the interviews we’ve done so far have led us to believe that this is far from the only—and may not be the best—framework for thinking about “what sorts of science are underfunded.” Much scientific research—including many of the discoveries that have been associated with the Nobel Prize—is not clearly associated with a particular disease or condition at all. Conversely, it’s possible that funding officially directed toward a particular disease or condition is instead used for work with more general ambitions. Thinking about “which disease and condition should be targeted” is a natural framework for humanitarian-oriented non-scientists, but it isn’t necessarily the most natural way of dividing up different types of science from a scientist’s perspective.
The interviews we’ve done so far have included several criticisms of the primary existing science funding mechanisms, particularly those of the National Institutes of Health (NIH). The NIH provides over half of all U.S. funding in life sciences, and about half of all NIH funding is via a particular grant mechanism, called the R01. The R01, and the NIH more broadly, is perceived as a major factor in researchers’ incentives, and observations about “what the science world needs more of” seem closely connected with critiques of the NIH and the R01. I refer to the NIH, and particularly the R01, as “the existing” system in the bullet points below, listing some of the claims discussed in our interviews:
The existing system favors researchers with strong track records, and is not good at supporting young investigators. This was the most commonly raised concern, and is mentioned in all three of our public interviews.
The existing system favors a particular brand of research—generally incremental testing of particular hypotheses—and is less suited to supporting research that doesn’t fit into this mold. Research that doesn’t fit into this mold may include:
Very high-risk research representing a small chance of a big breakthrough.
Research that focuses on developing improved tools and techniques (for example, better microscopy or better genome sequencing), rather than on directly investigating particular hypotheses.
“Translational research” aiming to improve the transition between basic scientific discoveries and clinical applications, and not focused on traditionally “academic” topics (for example, research focusing on predicting drug toxicity).
The existing system focuses on time-consuming, paperwork-heavy grant applications for individual investigators; more attention to differently structured grants and grant applications would be welcome. These could include mechanisms focused on providing small amounts of funding, along with feedback on ideas, quickly and with minimal paperwork, as well as mechanisms focused on supporting larger-scale projects that require collaboration between multiple investigators.
We don’t yet endorse any of these claims, and we’re aware that in many cases the NIH has mechanisms that intend to address alleged shortcomings. In order to assess these claims, we feel that we would need staff and/or advisors with substantial technical knowledge, as discussed in the next section.
Generalist GiveWell staff (everyone we currently employ should be thought of as a generalist) gather information on many different causes, through methods including interviewing those with relevant expertise, and seek to understand different causes’ importance, tractability, and “crowdedness” at a high level.
Generalist staff will be responsible for evaluating cause-specific staff; cause-specific staff will be responsible for synthesizing expert opinion and other information to make giving recommendations. However, when investigating scientific research, we believe that another link in the chain is needed. We believe that we need generalist scientific advisors in order to evaluate and compare different approaches to scientific funding at a high level. This is because, based on the early investigation detailed above, I don’t feel positioned even to understand the meaning—much less the plausibility—of many key claims. For example, in order to evaluate the claim that “high-risk” research is under-invested in, I’d want to be able to distinguish high-risk from lower-risk research and be able to assess how much is invested in each—something that I believe is likely to require substantial technically informed judgment calls. To some degree, this dynamic holds for any cause. In any field, there will be people whose greater experience makes subtle contributions to how they see many debates and evaluate many interventions. But scientific research is distinguished from other fields I’ve investigated by the degree to which expertise (often in the form of understanding a very specific, near-universal knowledge base that requires extended study to absorb) is a prerequisite to understanding the basics of what people are claiming and how one might reasonably go about comparing and drilling down on claims. Therefore, we chose to pause further investigation of scientific research until we recruit an appropriate set of generalist scientific advisors. (We have very recently—as of this week—formed a few new advisory relationships and restarted research.)
What we’re looking for in generalist scientific advisors
What follows is a draft spec that we have started to circulate in search of generalist scientific advisors. We plan to distribute it both within our network and more broadly, and initially Dario and I are evaluating candidates based on scientific aptitude and accomplishments (Dario and his network assess this) and fit with GiveWell (I assess this). So far, we have circulated this spec informally and found a few advisors we are working with on a trial basis; yesterday we started distributing the spec more broadly.
About us
GiveWell (www.givewell.org) finds outstanding giving opportunities and publishes the full details of its analysis to help donors decide where to give. It has historically focused on direct aid, but is now exploring the idea of funding (via recommendation) scientific research. GiveWell works as an advisor to Good Ventures (www.goodventures.org), a foundation funded by Dustin Moskovitz (co-founder of Facebook and, more recently, Asana) and run by Cari Tuna.
GiveWell’s ultimate goal is to accomplish humanitarian good, but it believes that some of the most beneficial scientific breakthroughs will come via long-term, high-risk fundamental research and is highly open to promoting work in this category.
GiveWell is not limited to any particular field, disease, biological condition, or population. We seek to broadly consider and identify the approaches that are most (a) promising and (b) under-invested in by other funders. We are likely to focus initially on life sciences (though this will include other areas with applications to life sciences, e.g., novel measurement platforms), but intend to explore other areas as well. We are seeking both advisors with backgrounds in life sciences and/or physical sciences who think strategically about future implications of fundamental research, with an eye to long-term, transformative impact.
GiveWell seeks scientists who are deeply experienced and (depending on career stage) accomplished, and who are committed to identifying the most promising science, regardless of how unconventional it may be. GiveWell hopes to find opportunities that are potentially transformative, and appear after substantial scrutiny (by world-class scientists) to represent intelligent (if sometimes risky) philanthropic investments.
The role
Generalist scientific advisors will help GiveWell find the best opportunities for a funder to accomplish good—whether it takes the form of pursuing short-term, cost-effective research with direct humanitarian applications, or pursuing long-term, fundamental research aiming for breakthroughs with wide-reaching and difficult-to-predict applications. Activities may include:
Interviewing other funders’ staff and scientific advisors to evaluate different approaches to research funding.
Finding, interviewing, and evaluating scientists doing particularly promising work.
Assessing (via literature review, interviews, etc.) the tractability of particular scientific goals and the likely future progress of particular fields
Seeking out, and presenting arguments regarding, inefficiencies in the current infrastructure for funding scientific research
GiveWell expects advisors to serve on a part-time basis, with significant variability in time commitment from week to week. In our early stages, we will likely seek to work with advisors on a trial basis, without long-term commitments. GiveWell’s staff will provide support (scheduling, documentation, etc.) as appropriate.
The team
We expect initially to retain 5-10 scientific advisors, at a variety of career stages (potentially ranging from junior faculty or even postdoctoral fellows to very senior scientists). We are interested in advisors from both academia and industry. This team will interact with each other regularly and bring diverse perspectives to the questions we’re asking. These will not be the only scientists we work with, but they will be the team of “generalists” that has primary responsibility for broad, comparative analysis identifying particularly promising areas and people to invest in.
Qualifications
Strong scientific accomplishments for one’s career stage.
Technical intelligence, as assessed by both track record and by interviews (with scientists we retain for interviewing).
Breadth of interests and abilities. Generalist scientific advisors should be interested in—and good at—comparatively assessing science and scientists in a broad variety of fields.
Willingness and ability to think critically and strategically but unconventionally, in order to find the ways in which existing funding infrastructure for science falls short of its potential.
Deep and broad network of high-quality scientific colleagues with whom the advisor may consult for specific technical expertise as needed to assess opportunities.
Willingness and ability to communicate one’s views to non-technical people, and technical experts outside one’s own scientific field.
Interest in assessing the potential connection between scientific progress and humanitarian progress, both over the short and long run.
This is an opportunity to influence the scientific priorities of a potentially major source of funds whose focus is on humanitarian good accomplished, without pre-commitments to particular fields, diseases, conditions, or populations. We are seeking people who are excited by the opportunity to have this influence, passionate about finding opportunities for scientific funders to accomplish good, and accordingly prepared to accept compensation that is reasonable but below what they could earn consulting for for-profit organizations.
* We’ve recently started paying Dario for work that is focused on GiveWell’s priorities. These expenses have fallen under the heading of “independent research contractors,” which are covered by a specially earmarked grant from Good Ventures.
Exploring Life Sciences Funding
Link post
Note: The Open Philanthropy Project was formerly known as GiveWell Labs. Before the launch of the Open Philanthropy Project Blog, this post appeared on the GiveWell Blog. Uses of “we” and “our” in the below post may refer to the Open Philanthropy Project or to GiveWell as an organization. Additional comments may be available at the original post.
As noted previously, I’ve been exploring the question, “What are the best opportunities for funders aiming to contribute to progress in life sciences (i.e., biology and medicine)?” This post lays out what we’ve done to date and how we plan to move forward.
The basic approach I’ve taken: interviews and immersion
Because this area is so different from anything GiveWell has looked at before, I’ve initially tried to “immerse” myself in it: I’ve taken opportunities to have extended and low-stakes interactions with scientists and learn a little bit of the basic knowledge underlying life sciences, without having specific questions or goals in mind.
The most helpful person in this endeavor has been Dario Amodei. Dario is currently a postdoctoral research fellow at Stanford Medical School studying proteomics; he is a recipient of the Hertz Fellowship and winner of the Hertz Foundation’s 2012 Thesis prize for his Ph.D. dissertation in the field of neuroscience. He is also a longtime GiveWell fan and supporter (see his 2009 guest post on the GiveWell blog), and the two of us have been housemates since GiveWell relocated to San Francisco.
For the early stages of investigation, Dario has served as our informal scientific advisor,* guiding our investigation by recommending readings, offering connections, etc. I feel that he has been a good fit for this role because he combines experience as a scientist with an extremely strong understanding of GiveWell’s values and goals, and is highly accessible to us. We’ve come to believe that in the early stages of an investigation, when we often don’t know which questions to ask, the ability to have extended, repeated, friendly, low-stakes interactions to get “grounded in the basics” is crucial, and we’ve taken a similar approach to exploring policy advocacy (which we wrote about previously).
Under Dario’s guidance, I have:
Conducted a series of interviews with representatives of major life sciences funders including Howard Hughes Medical Institute (the largest private philanthropic funder of scientific research in the U.S.), Wellcome Trust (the largest private philanthropic funder of life sciences in the U.K., with similar scale to Howard Hughes and to the British government’s research funding), and the American Cancer Society. (We have also had several other off-the-record conversations, including with U.S. government staff.)
Studied a small amount of the basics of cell biology. Specifically, I read chapters 1, 5, 6, 7, 8, 18 and 20 from Essential Cell Biology; reviewed the more detailed version of chapter 7; and questioned Dario about them at length. The two of us also discussed the abstracts of several NIH grant proposals and Nature papers. The goal here was simply to improve my basic comprehension of common terms used in discussing life sciences; after the calls discussed above, he and I agreed that it was important for me to improve on this front.
Taken opportunities to attend larger meetings of scientists in appropriate settings: relatively low-stakes settings in which communication in layperson’s terms was encouraged. I attended a meeting at the Banbury Center, intended to bring together people with different areas of expertise to discuss possible approaches to oncology; a meeting organized by Good Ventures (with Dario’s help) to discuss potential prizes in science; and several meetings of Vannevar Group. All of these meetings were organized by Dario or people in his network.
Several perspectives on giving opportunities aiming at furthering progress in life sciences
One natural way to look for underfunded opportunities is to focus on the question of “what diseases and conditions should be getting more focus and funding?” It’s possible that some diseases and conditions are overlooked because they primarily affect people in the developing world (for example, malaria and tuberculosis); it’s possible that some are overlooked because they don’t have the same sorts of interest groups behind them (for example, chronic pain and other symptoms of aging, which have no analogue to groups like American Cancer Society). Prior to starting this investigation, this was the main framework we were thinking about for finding overlooked giving opportunities, and we believe there may be a lot of potential in thinking in this way.
However, the interviews we’ve done so far have led us to believe that this is far from the only—and may not be the best—framework for thinking about “what sorts of science are underfunded.” Much scientific research—including many of the discoveries that have been associated with the Nobel Prize—is not clearly associated with a particular disease or condition at all. Conversely, it’s possible that funding officially directed toward a particular disease or condition is instead used for work with more general ambitions. Thinking about “which disease and condition should be targeted” is a natural framework for humanitarian-oriented non-scientists, but it isn’t necessarily the most natural way of dividing up different types of science from a scientist’s perspective.
The interviews we’ve done so far have included several criticisms of the primary existing science funding mechanisms, particularly those of the National Institutes of Health (NIH). The NIH provides over half of all U.S. funding in life sciences, and about half of all NIH funding is via a particular grant mechanism, called the R01. The R01, and the NIH more broadly, is perceived as a major factor in researchers’ incentives, and observations about “what the science world needs more of” seem closely connected with critiques of the NIH and the R01. I refer to the NIH, and particularly the R01, as “the existing” system in the bullet points below, listing some of the claims discussed in our interviews:
The existing system favors researchers with strong track records, and is not good at supporting young investigators. This was the most commonly raised concern, and is mentioned in all three of our public interviews.
The existing system favors a particular brand of research—generally incremental testing of particular hypotheses—and is less suited to supporting research that doesn’t fit into this mold. Research that doesn’t fit into this mold may include:
Very high-risk research representing a small chance of a big breakthrough.
Research that focuses on developing improved tools and techniques (for example, better microscopy or better genome sequencing), rather than on directly investigating particular hypotheses.
“Translational research” aiming to improve the transition between basic scientific discoveries and clinical applications, and not focused on traditionally “academic” topics (for example, research focusing on predicting drug toxicity).
The existing system focuses on time-consuming, paperwork-heavy grant applications for individual investigators; more attention to differently structured grants and grant applications would be welcome. These could include mechanisms focused on providing small amounts of funding, along with feedback on ideas, quickly and with minimal paperwork, as well as mechanisms focused on supporting larger-scale projects that require collaboration between multiple investigators.
We don’t yet endorse any of these claims, and we’re aware that in many cases the NIH has mechanisms that intend to address alleged shortcomings. In order to assess these claims, we feel that we would need staff and/or advisors with substantial technical knowledge, as discussed in the next section.
The centrality of scientific advisors
The basic approach we’re picturing for GiveWell Labs runs roughly as follows:
Generalist GiveWell staff (everyone we currently employ should be thought of as a generalist) gather information on many different causes, through methods including interviewing those with relevant expertise, and seek to understand different causes’ importance, tractability, and “crowdedness” at a high level.
For particularly promising causes, GiveWell will consider hiring staff to specialize in these causes (or recommending that major philanthropists hire staff for this purpose), since we believe that having the appropriate amount of context to evaluate giving opportunities in a cause may take in excess of a year (even with good access to relevant experts).
Generalist staff will be responsible for evaluating cause-specific staff; cause-specific staff will be responsible for synthesizing expert opinion and other information to make giving recommendations. However, when investigating scientific research, we believe that another link in the chain is needed. We believe that we need generalist scientific advisors in order to evaluate and compare different approaches to scientific funding at a high level. This is because, based on the early investigation detailed above, I don’t feel positioned even to understand the meaning—much less the plausibility—of many key claims. For example, in order to evaluate the claim that “high-risk” research is under-invested in, I’d want to be able to distinguish high-risk from lower-risk research and be able to assess how much is invested in each—something that I believe is likely to require substantial technically informed judgment calls. To some degree, this dynamic holds for any cause. In any field, there will be people whose greater experience makes subtle contributions to how they see many debates and evaluate many interventions. But scientific research is distinguished from other fields I’ve investigated by the degree to which expertise (often in the form of understanding a very specific, near-universal knowledge base that requires extended study to absorb) is a prerequisite to understanding the basics of what people are claiming and how one might reasonably go about comparing and drilling down on claims. Therefore, we chose to pause further investigation of scientific research until we recruit an appropriate set of generalist scientific advisors. (We have very recently—as of this week—formed a few new advisory relationships and restarted research.)
What we’re looking for in generalist scientific advisors
What follows is a draft spec that we have started to circulate in search of generalist scientific advisors. We plan to distribute it both within our network and more broadly, and initially Dario and I are evaluating candidates based on scientific aptitude and accomplishments (Dario and his network assess this) and fit with GiveWell (I assess this). So far, we have circulated this spec informally and found a few advisors we are working with on a trial basis; yesterday we started distributing the spec more broadly.
About us
GiveWell (www.givewell.org) finds outstanding giving opportunities and publishes the full details of its analysis to help donors decide where to give. It has historically focused on direct aid, but is now exploring the idea of funding (via recommendation) scientific research. GiveWell works as an advisor to Good Ventures (www.goodventures.org), a foundation funded by Dustin Moskovitz (co-founder of Facebook and, more recently, Asana) and run by Cari Tuna.
GiveWell’s ultimate goal is to accomplish humanitarian good, but it believes that some of the most beneficial scientific breakthroughs will come via long-term, high-risk fundamental research and is highly open to promoting work in this category.
GiveWell is not limited to any particular field, disease, biological condition, or population. We seek to broadly consider and identify the approaches that are most (a) promising and (b) under-invested in by other funders. We are likely to focus initially on life sciences (though this will include other areas with applications to life sciences, e.g., novel measurement platforms), but intend to explore other areas as well. We are seeking both advisors with backgrounds in life sciences and/or physical sciences who think strategically about future implications of fundamental research, with an eye to long-term, transformative impact.
GiveWell seeks scientists who are deeply experienced and (depending on career stage) accomplished, and who are committed to identifying the most promising science, regardless of how unconventional it may be. GiveWell hopes to find opportunities that are potentially transformative, and appear after substantial scrutiny (by world-class scientists) to represent intelligent (if sometimes risky) philanthropic investments.
The role
Generalist scientific advisors will help GiveWell find the best opportunities for a funder to accomplish good—whether it takes the form of pursuing short-term, cost-effective research with direct humanitarian applications, or pursuing long-term, fundamental research aiming for breakthroughs with wide-reaching and difficult-to-predict applications. Activities may include:
Interviewing other funders’ staff and scientific advisors to evaluate different approaches to research funding.
Finding, interviewing, and evaluating scientists doing particularly promising work.
Assessing (via literature review, interviews, etc.) the tractability of particular scientific goals and the likely future progress of particular fields
Seeking out, and presenting arguments regarding, inefficiencies in the current infrastructure for funding scientific research
GiveWell expects advisors to serve on a part-time basis, with significant variability in time commitment from week to week. In our early stages, we will likely seek to work with advisors on a trial basis, without long-term commitments. GiveWell’s staff will provide support (scheduling, documentation, etc.) as appropriate.
The team
We expect initially to retain 5-10 scientific advisors, at a variety of career stages (potentially ranging from junior faculty or even postdoctoral fellows to very senior scientists). We are interested in advisors from both academia and industry. This team will interact with each other regularly and bring diverse perspectives to the questions we’re asking. These will not be the only scientists we work with, but they will be the team of “generalists” that has primary responsibility for broad, comparative analysis identifying particularly promising areas and people to invest in.
Qualifications
Strong scientific accomplishments for one’s career stage.
Technical intelligence, as assessed by both track record and by interviews (with scientists we retain for interviewing).
Breadth of interests and abilities. Generalist scientific advisors should be interested in—and good at—comparatively assessing science and scientists in a broad variety of fields.
Willingness and ability to think critically and strategically but unconventionally, in order to find the ways in which existing funding infrastructure for science falls short of its potential.
Deep and broad network of high-quality scientific colleagues with whom the advisor may consult for specific technical expertise as needed to assess opportunities.
Willingness and ability to communicate one’s views to non-technical people, and technical experts outside one’s own scientific field.
Interest in assessing the potential connection between scientific progress and humanitarian progress, both over the short and long run.
This is an opportunity to influence the scientific priorities of a potentially major source of funds whose focus is on humanitarian good accomplished, without pre-commitments to particular fields, diseases, conditions, or populations. We are seeking people who are excited by the opportunity to have this influence, passionate about finding opportunities for scientific funders to accomplish good, and accordingly prepared to accept compensation that is reasonable but below what they could earn consulting for for-profit organizations.
* We’ve recently started paying Dario for work that is focused on GiveWell’s priorities. These expenses have fallen under the heading of “independent research contractors,” which are covered by a specially earmarked grant from Good Ventures.