I think that just as the risks of AGI are overstated, so too are the potential benefits. Don’t get me wrong, i expect it would still be revolutionary and incredible, just not magical.
Going from tens of thousands of biomedical researchers to hundreds of millions would definitely greatly speed up medical research… but I think you would run into diminishing returns, as the limiting bottleneck is often not the number of researchers. For example, coming up with the covid vaccine took barely any time at all, but it took years to get it out due to the need for human trials and to actually build and distribute the thing.
I still think there would be a massive boost, but perhaps not a “jump in forward a century” one. It’s hard to predict exactly what the shortcomings of AGI will be, but there has never been a technology that lacked shortcomings, and I don’t think AGI will be the exception.
I agree that bottlenecks like the ones you mention will slow things down. I think that’s compatible with this being a “jump in forward a century” thing though.
Let’s consider the case of a cure for cancer. First of all, even if it takes “years to get it out due to the need for human trials and to actually build and distribute the thing” AGI could still bring the cure forward from 2200 to 2040 (assuming we get AGI in 2035).
Second, the excess top-quality labour from AGI could help us route-around the bottlenecks you mentioned:
Human trials: AGI might develop ultra-high-reliability ways to verify that drugs work without human trials. That could either lead to a change in regulatory requirements or to people buying the AGI-designed drugs sooner in countries where that’s legal.
Manufacturing and distributing the drug: Imagine if we’d had 100 million of the most competent humans working (remotely) full time on optimising every step of the manufacturing+distribution process for COVID? They could have:
Planned out how to use all the US’ available manufacturing and transportation infrastructure maximally efficiently
Give real-time instructions to all the humans working in those industries so that they were more productive and better coordinated.
Recruit and train of new human workers (again instructing them in real-time) to increase the available labour.
More speculatively, it might not take long for AGI to design robots that could do the physical labour needed to manufacture and distribute the vaccines.
I think that just as the risks of AGI are overstated, so too are the potential benefits. Don’t get me wrong, i expect it would still be revolutionary and incredible, just not magical.
Going from tens of thousands of biomedical researchers to hundreds of millions would definitely greatly speed up medical research… but I think you would run into diminishing returns, as the limiting bottleneck is often not the number of researchers. For example, coming up with the covid vaccine took barely any time at all, but it took years to get it out due to the need for human trials and to actually build and distribute the thing.
I still think there would be a massive boost, but perhaps not a “jump in forward a century” one. It’s hard to predict exactly what the shortcomings of AGI will be, but there has never been a technology that lacked shortcomings, and I don’t think AGI will be the exception.
I agree that bottlenecks like the ones you mention will slow things down. I think that’s compatible with this being a “jump in forward a century” thing though.
Let’s consider the case of a cure for cancer. First of all, even if it takes “years to get it out due to the need for human trials and to actually build and distribute the thing” AGI could still bring the cure forward from 2200 to 2040 (assuming we get AGI in 2035).
Second, the excess top-quality labour from AGI could help us route-around the bottlenecks you mentioned:
Human trials: AGI might develop ultra-high-reliability ways to verify that drugs work without human trials. That could either lead to a change in regulatory requirements or to people buying the AGI-designed drugs sooner in countries where that’s legal.
Manufacturing and distributing the drug: Imagine if we’d had 100 million of the most competent humans working (remotely) full time on optimising every step of the manufacturing+distribution process for COVID? They could have:
Planned out how to use all the US’ available manufacturing and transportation infrastructure maximally efficiently
Give real-time instructions to all the humans working in those industries so that they were more productive and better coordinated.
Recruit and train of new human workers (again instructing them in real-time) to increase the available labour.
More speculatively, it might not take long for AGI to design robots that could do the physical labour needed to manufacture and distribute the vaccines.