This was a really interesting and useful read! Posting the summary from the end of the post, as I found it helpful:
To summarise, here are the most important factors informing my view:
China’s research on the important sub-domains of AI (such as transformer architectures and deep learning) are less impressive than headlines might otherwise indicate.
I suspect China’s economic growth will slow down considerably unless its political and economic system changes in a more pluralistic direction (and even then, that might not be enough). This will make spending on large, speculative projects like TAI more difficult to justify politically, provided basic needs are not being met and growth is stagnant.
China might create interesting narrow applications of AI in domains such as surveillance and other consumer products, but this might not be enough to propel their labs and firms to the frontier.
China has a massive problem with producing compute, and the proposed solutions do not seem to be sufficient to emerge at the cutting-edge of semiconductor manufacturing.
Some of the most promising short-to-medium-term paths towards TAI will require access to gargantuan volumes of computing power, and the US government has recently taken decisive action to prevent China from accessing it.
First mover advantages are real: China is not in a great position to emerge at the front any time soon, and the most important actors from a governance point of view are probably the ones who are most likely to develop TAI first.
China will struggle with talent if it primarily relies on Chinese-born scientists, who tend to return to China at low rates. A more liberal China with higher quality-of-life might attract foreign workers, but creating such a society is not exactly easy, nor is it necessarily desirable for many government elites.
Here are some things that would cause me to update in the other direction:
China manages to avoid a huge growth slowdown, and this cumulative economic growth makes the Chinese economy truly enormous, and solidifies the CCP’s political power even further.
China begins producing leading research in important TAI sub-domains, or is able to closely follow the West. A cutting-edge algorithmic or architectural discovery coming out of China would be particularly interesting in this respect.
China’s centralised access to data gives them a massive advantage over the West and their pesky data protection laws in the long-run.
Creating narrow AI products and services for the Chinese market proves to be insanely profitable, enough to flush Chinese labs with more cash than their Western counterparts.
China solves its semiconductor struggles and begins taking a large chunk of the semiconductor market, or manages to emerge as a frontrunner in an alternative computing paradigm such as quantum computing.
Creating TAI requires less compute than previously thought, or is possible to do with the kind of inferior-generation semiconductors that China can produce domestically.
First-mover advantages are not as important as once thought, and the Chinese government can spend in an attempt to narrow the gap.
China begins repatriating researchers who go abroad at much greater rates, or manages to start attracting non-Chinese talent in considerable numbers.
The Chinese government decides to throw a much larger portion of their GDP towards AI than other comparatively sized economies, and it turns out that money can buy AI progress.
A cutting-edge algorithmic or architectural discovery coming out of China would be particularly interesting in this respect.
Kaiming He was at MSR in China when he invented ResNets in 2015. Residual connections are part of transformers, and probably the 2nd most important architectural breakthrough in modern Deep Learning.
This was a really interesting and useful read! Posting the summary from the end of the post, as I found it helpful:
Kaiming He was at MSR in China when he invented ResNets in 2015. Residual connections are part of transformers, and probably the 2nd most important architectural breakthrough in modern Deep Learning.