All that said, I don’t imagine the period I’m describing lasting all too long. Once humans become simulated well, and we really reach TAI++, lots of bets are off. It seems really tough to have a great model of that world, outside of “humans basically split up light cone, by dividing the sources of production, which will basically be AIs”[1]
I agree that humans will basically stop being useful at that point.
But if that point is far away (40-90 years), this could be enough time for many humans to make a lot of that money/capital, for that time. [1] “Split up” could mean “The CCP gets all of it”
Basically, I naively expect there to be some period where we have a lot of AI, but humans are still getting paid a lot—followed by some point where humans just altogether stop. (unless weird lock-in happens)
All that said, I don’t imagine the period I’m describing lasting all too long. Once humans become simulated well, and we really reach TAI++, lots of bets are off. It seems really tough to have a great model of that world, outside of “humans basically split up light cone, by dividing the sources of production, which will basically be AIs”[1]
I agree that humans will basically stop being useful at that point.
But if that point is far away (40-90 years), this could be enough time for many humans to make a lot of that money/capital, for that time.
[1] “Split up” could mean “The CCP gets all of it”
Basically, I naively expect there to be some period where we have a lot of AI, but humans are still getting paid a lot—followed by some point where humans just altogether stop. (unless weird lock-in happens)