This is a scenario that I haven’t seen discussed on the EA Forum yet: AI consciousness (with a possible mechanism for it). In his recent podcast with Lex Fridman, Max Tegmark speculates that recurrent neural networks (RNNs) could be a source of consciousness (whereas the linear, feed-forward, architecture of the current dominant architecture of LLMs, isn’t). I’m not sure if this helps with us being fine, as the consciousness could have very negative valence (so it hates us for bringing it into being), but this idea to me seems more of a way out of doom by default (given AGI) than anything else I’ve seen so far.
This is a scenario that I haven’t seen discussed on the EA Forum yet: AI consciousness (with a possible mechanism for it). In his recent podcast with Lex Fridman, Max Tegmark speculates that recurrent neural networks (RNNs) could be a source of consciousness (whereas the linear, feed-forward, architecture of the current dominant architecture of LLMs, isn’t). I’m not sure if this helps with us being fine, as the consciousness could have very negative valence (so it hates us for bringing it into being), but this idea to me seems more of a way out of doom by default (given AGI) than anything else I’ve seen so far.