Oh, you said “evolution-type optimization”, so I figured you were thinking of the case where the inner/outer distinction is clear cut. If you don’t think the inner/outer distinction will be clear cut, then I’d question whether you actually disagree with the post :) See the section defining what I’m arguing against, in particular the “inner as AGI” discussion.
Ok, seems like this might have been more a terminological misunderstanding on my end. I think I agree with what you say here, ‘What if the “Inner As AGI” criterion does not apply? Then the outer algorithm is an essential part of the AGI’s operating algorithm’.
Oh, you said “evolution-type optimization”, so I figured you were thinking of the case where the inner/outer distinction is clear cut. If you don’t think the inner/outer distinction will be clear cut, then I’d question whether you actually disagree with the post :) See the section defining what I’m arguing against, in particular the “inner as AGI” discussion.
Ok, seems like this might have been more a terminological misunderstanding on my end. I think I agree with what you say here, ‘What if the “Inner As AGI” criterion does not apply? Then the outer algorithm is an essential part of the AGI’s operating algorithm’.