I don’t think control is likely to scale to arbitrarily powerful systems. But it may not need to… which sets us up well for the following phases.
Under the concept of ‘control’, I am including the capacity of the AI system to control their own components’ effects.
I am talking about fundamental workings of control. Ie. control theory and cybernetics. I.e. as general enough that results are applicable to any following phases as well.
Anders Sandberg has been digging lately into fundamental controllability limits. Could be interesting to talk with Anders.
Under the concept of ‘control’, I am including the capacity of the AI system to control their own components’ effects.
I am talking about fundamental workings of control. Ie. control theory and cybernetics.
I.e. as general enough that results are applicable to any following phases as well.
Anders Sandberg has been digging lately into fundamental controllability limits.
Could be interesting to talk with Anders.