It’s ambiguous who this “we” is. It obscures the fact there are overlapping and distinct communities among AI alignment as an umbrella movement. There have also been increasing concerns that a couple of those communities serving as nodes in that network, namely rationality and effective altruism, are becoming more trouble than they’re worth. This has been coming from effective altruists and rationalists themselves.
I’m aware of, and have been part of, increasingly frequent conversations that AI safety and alignment, as a movement/community/whatever, shouldn’t just “divorce” from EA or rationality, but can and should become more autonomous and independent from them.
What that implies for ‘the cavalry’ is, first, that much of the standing calvary is more trouble than it’s worth. It might be prudent to discard and dismiss much of the existing cavalry.
Second, the AI safety/alignment community gaining more control over its own trajectory may provide an opportunity to rebuild the cavalry, for the better. AI alignment as a field could become more attractive to those who find it offputting, at this point, understandably, because of its association with EA and the rationality community.
AI safety and AI alignment, freed of the baggage EA and rationality, could bring in fresh ranks to the cavalry to replace those standing ranks still causing so many problems.
It’s ambiguous who this “we” is. It obscures the fact there are overlapping and distinct communities among AI alignment as an umbrella movement. There have also been increasing concerns that a couple of those communities serving as nodes in that network, namely rationality and effective altruism, are becoming more trouble than they’re worth. This has been coming from effective altruists and rationalists themselves.
I’m aware of, and have been part of, increasingly frequent conversations that AI safety and alignment, as a movement/community/whatever, shouldn’t just “divorce” from EA or rationality, but can and should become more autonomous and independent from them.
What that implies for ‘the cavalry’ is, first, that much of the standing calvary is more trouble than it’s worth. It might be prudent to discard and dismiss much of the existing cavalry.
Second, the AI safety/alignment community gaining more control over its own trajectory may provide an opportunity to rebuild the cavalry, for the better. AI alignment as a field could become more attractive to those who find it offputting, at this point, understandably, because of its association with EA and the rationality community.
AI safety and AI alignment, freed of the baggage EA and rationality, could bring in fresh ranks to the cavalry to replace those standing ranks still causing so many problems.