I specialize in AI, and I respectfully disagree. I think there’s much more low-hanging fruit available when studying consciousness. Interpretability research is a thriving subfield best left to PhD students and I don’t really think that bloggers add much value here.
I personally am also not concerned about AGI because I think consciousness is quantum.
ha I see. Your advice might be right but I don’t think “consciousness is quantum”. I wonder if you could say what you mean by that?
Of course I’ve heard that before. In the past when I have heard people say that before, it’s by advocates of free will theories of consciousness trying to propose a physical basis for consciousness that preserves indeterminacy of decision-making. Some objections I have to this view:
Most importantly, as I pointed out here: consciousness is roughly orthogonal to intelligence. So your view shouldn’t give you reassurance about AGI. We could have a formal definition of intelligence, and causal instantiations of it, without any qualia what-its-like-to-be subjective consciousness existing in the system. There is also conscious experience with minimal intelligence, like experiences of raw pleasure, pain, or observing the blueness of the sky. As I explain in the linked post, consciousness is also orthogonal to agency or goal-directed behavior.
There’s a great deal of research about consciousness. I described one account in my post, and Nick Humphrey does go out on a limb more than most researchers do. But my sense is most neuroscientists of consciousness endorse some account of consciousness roughly equivalent to Nick’s. While probably some (not all or even a majority) would concede the hard problem remains, based on what we do know about the structure of the physical substrates underlying consciousness, it’s hard to imagine what role “quantum” would do.
It fails to add any sense of meaningful free will, because a brain that makes decisions based on random quantum fluctuations doesn’t in any meaningful way have more agency than a brain that makes decisions based on pre-determined physical causal chains. While a [hypothetical] quantum-based brain does avoid being pre-determined by physical causal chains, now it is just pre-determined by random quantum fluctuations.
Lastly I have to confess a bit of prejudice against this view. In the past it seems like this view has been proposed so naively it seems like people are just mashing together two phenomena that no one fully understands, and proposing they’re related because ???? But the only thing they have in common, as far as I know, is that we don’t understand them. That’s not much of a reason to believe in a hypothesis that links them.
Assuming your view was correct, if someone built a quantum computer, would you then be more worried about AGI? That doesn’t seem so far off.
Good job. Posts like these are why I still check the EA forum despite the ridiculous nonsense (castles et al).
I feel like I should be writing and reading posts about AI but honestly I am too intimidated to go near that topic.
I specialize in AI, and I respectfully disagree. I think there’s much more low-hanging fruit available when studying consciousness. Interpretability research is a thriving subfield best left to PhD students and I don’t really think that bloggers add much value here.
I personally am also not concerned about AGI because I think consciousness is quantum.
ha I see. Your advice might be right but I don’t think “consciousness is quantum”. I wonder if you could say what you mean by that?
Of course I’ve heard that before. In the past when I have heard people say that before, it’s by advocates of free will theories of consciousness trying to propose a physical basis for consciousness that preserves indeterminacy of decision-making. Some objections I have to this view:
Most importantly, as I pointed out here: consciousness is roughly orthogonal to intelligence. So your view shouldn’t give you reassurance about AGI. We could have a formal definition of intelligence, and causal instantiations of it, without any qualia what-its-like-to-be subjective consciousness existing in the system. There is also conscious experience with minimal intelligence, like experiences of raw pleasure, pain, or observing the blueness of the sky. As I explain in the linked post, consciousness is also orthogonal to agency or goal-directed behavior.
There’s a great deal of research about consciousness. I described one account in my post, and Nick Humphrey does go out on a limb more than most researchers do. But my sense is most neuroscientists of consciousness endorse some account of consciousness roughly equivalent to Nick’s. While probably some (not all or even a majority) would concede the hard problem remains, based on what we do know about the structure of the physical substrates underlying consciousness, it’s hard to imagine what role “quantum” would do.
It fails to add any sense of meaningful free will, because a brain that makes decisions based on random quantum fluctuations doesn’t in any meaningful way have more agency than a brain that makes decisions based on pre-determined physical causal chains. While a [hypothetical] quantum-based brain does avoid being pre-determined by physical causal chains, now it is just pre-determined by random quantum fluctuations.
Lastly I have to confess a bit of prejudice against this view. In the past it seems like this view has been proposed so naively it seems like people are just mashing together two phenomena that no one fully understands, and proposing they’re related because ???? But the only thing they have in common, as far as I know, is that we don’t understand them. That’s not much of a reason to believe in a hypothesis that links them.
Assuming your view was correct, if someone built a quantum computer, would you then be more worried about AGI? That doesn’t seem so far off.