I agree with much of what you’re saying, but disagree that slowing down is impossible. General ASI is not a tool, it’s an adversary. As many have pointed out, ASI is also a threat to whoever “gets there first” first.
Furthermore, these’s some evidence that labs in China are advancing on the coattails of US based labs, so slowing work in the US, even unilaterally, would slow labs in China.
The speed of action required and adverse economic incentives make this challenging, but we have precedent as humans overcoming great challenges in the past, including nuclear weapons, and terrible diseases. We developed international governance, and non-proliferation treaties. It is achievable—there are only a few labs capable of doing this kind of work, and the supply chain is long and relatively easy to control. It is a solvable problem, if we work together.
I agree with much of what you’re saying, but disagree that slowing down is impossible. General ASI is not a tool, it’s an adversary. As many have pointed out, ASI is also a threat to whoever “gets there first” first.
Furthermore, these’s some evidence that labs in China are advancing on the coattails of US based labs, so slowing work in the US, even unilaterally, would slow labs in China.
The speed of action required and adverse economic incentives make this challenging, but we have precedent as humans overcoming great challenges in the past, including nuclear weapons, and terrible diseases. We developed international governance, and non-proliferation treaties. It is achievable—there are only a few labs capable of doing this kind of work, and the supply chain is long and relatively easy to control. It is a solvable problem, if we work together.