A cutting-edge algorithmic or architectural discovery coming out of China would be particularly interesting in this respect.
Kaiming He was at MSR in China when he invented ResNets in 2015. Residual connections are part of transformers, and probably the 2nd most important architectural breakthrough in modern Deep Learning.
Kaiming He was at MSR in China when he invented ResNets in 2015. Residual connections are part of transformers, and probably the 2nd most important architectural breakthrough in modern Deep Learning.