Whose job is it to identify EA questions which could benefit from better forecasts?
Consider two different hypotheses:
-
Forecasting is only helpful for AI
-
Forecasting is helpful outside of AI, but AI has captured much more forecasting interest than other cause areas
How much time are non-AI org leaders spending trying to think up decision-relevant forecasts related to their cause areas?
-
If leaders are not spending any time trying to think up such forecasts, maybe there is low-hanging fruit here. Maybe EA has latent forecasting capability which can be tapped to improve organizational decision-making. Or maybe such forecasting capability will free up in a few years if AI turns out to be a nothingburger.
-
If leaders have spent a lot of time trying to think up useful forecasts, and failed, maybe forecasting really is fairly useless outside of AI.
If I was leading a non-AI EA organization, and I had a forecast I really wanted to see the result of, who would I even talk to? Which forecasting organizations are actively soliciting ideas for EA-related forecast questions?
It seems to me that a lot of what EA does is implicit forecasting in some sense, e.g. if you give someone a grant, it’s an implicit forecast about the probability that they will be able to accomplish something with that grant. EA is often critiqued for neglecting “systemic change”. If you want to do systemic change, being able to forecast the effects of various systemic changes is really useful. If you take any action, there’s an implicit forecast that it will lead to a good outcome and not backfire somehow. Wouldn’t it be better to make this forecast explicit? All else equal, wouldn’t it be good to get some perspective from people outside of the organization, who are perhaps forecasting in their free time as a replacement for watching TV or other downtime activities?
To be fair, CG’s grant to OpenAI looks fairly terrible with the benefit of hindsight. That does seem to suggest that AI grantmaking should be done with care, or something of that nature. But I would say that problem would be better fixed through public reflection on what went wrong with the OpenAI grant, as opposed to just trying to monopolize more talent. It would really suck if CG is monopolizing talent for an organization that is fundamentally broken at a structural incentives level, e.g. excessive focus on prestige-maxxing.