Futurologist, public speaker, consultant https://danilamedvedev.com
NeyroKod architect http://neyrokod.info (knowledge management, exocortex, complex thinking)
NanoLab founder http://nanolabvr.com (VR chemistry education and nanomachine design)
KrioRus founder/director https://kriorus.com
Other interests: intelligence augmentation https://augmentek.online innovation systems, R&D policy aging, life extension, transhumanism
Marcus’s experience can be questioned and his position challenged, but in other comments other knowledgeable and experienced people supported some of his arguments, even though they were objecting to others. So I would say that in general Marcus’s position is strong. It’s clear it’s provocative, but I don’t see a problem with that personally.
The metrics could be chosen based on your overall decision making system. The end points are measured by NPV, QLY, etc. It’s clear that you need some intermediate metrics, of course, which I would say, is the number and scale of decisions where forecasting not only “informed” the decisions, but “determined”.
Examples from determining the impact of scientific research: lead is bad ⇒ leaded gasoline banned. CO2 is bad ⇒ fight global warming.
I would ideally like to see something similar (obviously the scale/impact can be smaller). It’s clear that forecasting is distinct from finding a causal link, but the general process of incorporating something in decision making process and having that something affect decisions is similar.
Also, I am very skeptical about the value of research.
As a (sorta) constructive proposal. Consider how foresight (as a formerly great practice from the 1960s) is used. Consider that foresight (essentially a more advanced form of working with the future than extrapolation and than forecasting) is not promoted or supported by EA-related organizations (or supported to a very limited degree). This is an example of how funding can and should be shifted.