Thanks for taking the time to formalizing this a bit more. I think you’re capturing my ideas quite well and indeed I can’t think of ways how this would scale exponentially. Your point on “let’s remove the human bottleneck” goes a bit in the direction of the last simulation paragraph where I suggest that you could parallelize knowledge acquisition. But as I argue there I think that’s unrealistic to scale exponentially.
In general, I think I focused too much on the robotics examples when trying to illustrate that generating new knowledge takes time and is difficult but the same applies of course also to performing any kind of other experiment that an AI would have to do such as generating knowledge on human psychology by doing experiments with us, testing new training algorithms, performing experiments on quantum physics for chip research, etc.
Thanks for taking the time to formalizing this a bit more. I think you’re capturing my ideas quite well and indeed I can’t think of ways how this would scale exponentially. Your point on “let’s remove the human bottleneck” goes a bit in the direction of the last simulation paragraph where I suggest that you could parallelize knowledge acquisition. But as I argue there I think that’s unrealistic to scale exponentially.
In general, I think I focused too much on the robotics examples when trying to illustrate that generating new knowledge takes time and is difficult but the same applies of course also to performing any kind of other experiment that an AI would have to do such as generating knowledge on human psychology by doing experiments with us, testing new training algorithms, performing experiments on quantum physics for chip research, etc.