I do tend to favor longer AGI/TAI timelines than many for roughly these reasons. But I don’t think you are exactly right about the AI data access trend. For one, whether or not me or Americans at large are “happy to give an ASI full autonomous power to gather such biomedical data”, China will be.
I tentatively I expect capabilities with real-world economic importance to come to some extent in the US as well, even if the most radical and transformative stuff requires further integration into the physical world for modeling. And at that point there may simply be a iterative process of greater and greater integration, as public perception improves and dependence increases. The complication here is moral backlash of some sort, which I note you’ve written about before. I agree that this is plausible, I simply wouldn’t call it probable. Things look more bi-modal to me; most likely we get the outcome I’ve described above (mild harms could still be disregarded by China), or we get a longer slow down before curing aging.
I do tend to favor longer AGI/TAI timelines than many for roughly these reasons. But I don’t think you are exactly right about the AI data access trend. For one, whether or not me or Americans at large are “happy to give an ASI full autonomous power to gather such biomedical data”, China will be.
I tentatively I expect capabilities with real-world economic importance to come to some extent in the US as well, even if the most radical and transformative stuff requires further integration into the physical world for modeling. And at that point there may simply be a iterative process of greater and greater integration, as public perception improves and dependence increases. The complication here is moral backlash of some sort, which I note you’ve written about before. I agree that this is plausible, I simply wouldn’t call it probable. Things look more bi-modal to me; most likely we get the outcome I’ve described above (mild harms could still be disregarded by China), or we get a longer slow down before curing aging.