Good question! I’ll need to think more about this, but my initial impression is that regular surveying of developers about AI progress could help by quantifying their level of uncertainty over the arrival rate of particular milestones, which is likely correlated with how they believe expected capabilities investments map onto progress.
That seems right, though it likely depends upon how substitutable safety research is across firms.
Thanks for your thoughts!
Good question! I’ll need to think more about this, but my initial impression is that regular surveying of developers about AI progress could help by quantifying their level of uncertainty over the arrival rate of particular milestones, which is likely correlated with how they believe expected capabilities investments map onto progress.
That seems right, though it likely depends upon how substitutable safety research is across firms.