Thanks for this analysis. I continue to be impressed with the advancements the industry has been making, which in the last five or so years in particular have been far beyond what I had expected. Nevertheless, I haven’t fully moved out of the skeptic camp for two reasons. One reason, regarding the hazards of extrapolating curves, has been discussed in some other comments.
The other reason is that, despite some attempts to make it rigorous, I still find the term “artificial general intelligence” to be vague, and I expect it to continue to be subject to a moving goalposts problem. There was a time when researchers reasoned that, since chess is a pinnacle of human cognition, AGI would be inherent in a system that can play chess better than any person. This view was revealed to be obviously false after Deep Blue in 1997.
I think a bold prognostication about the development of AI would be on firmer grounds if we avoided anthropomorphisms such as “human level”.
They way to deal with the vagueness of “AGI” is to think about substitutability for human labour in an imaginary world where no regulatory barriers prevent this.
Thanks for this analysis. I continue to be impressed with the advancements the industry has been making, which in the last five or so years in particular have been far beyond what I had expected. Nevertheless, I haven’t fully moved out of the skeptic camp for two reasons. One reason, regarding the hazards of extrapolating curves, has been discussed in some other comments.
The other reason is that, despite some attempts to make it rigorous, I still find the term “artificial general intelligence” to be vague, and I expect it to continue to be subject to a moving goalposts problem. There was a time when researchers reasoned that, since chess is a pinnacle of human cognition, AGI would be inherent in a system that can play chess better than any person. This view was revealed to be obviously false after Deep Blue in 1997.
I think a bold prognostication about the development of AI would be on firmer grounds if we avoided anthropomorphisms such as “human level”.
They way to deal with the vagueness of “AGI” is to think about substitutability for human labour in an imaginary world where no regulatory barriers prevent this.