Personally I’m quite concerned about futures where things get decided this quickly, or at least where they get decided on an object level very quickly.
I think to get anywhere near most value achievable in the future we need to have a relatively comprehensive reflection process before making lasting decisions. This could be achieved through some kind of bootstrapping process, or some other kind of slow down period, but I do worry that something like this may not be very likely by default,it seems possible humanity may not be nearly patient enough for this kind of thing, even if superintelligence can speed up the process quite a bit.
I did a lot of research on the importance of a comprehensive reflection process last year which you may find interesting, I’m hoping to finish editing soon, but if you’d like to see the current draft and/or have feedback here it is.
Thanks Niki, this was great!
Personally I’m quite concerned about futures where things get decided this quickly, or at least where they get decided on an object level very quickly.
I think to get anywhere near most value achievable in the future we need to have a relatively comprehensive reflection process before making lasting decisions. This could be achieved through some kind of bootstrapping process, or some other kind of slow down period, but I do worry that something like this may not be very likely by default,it seems possible humanity may not be nearly patient enough for this kind of thing, even if superintelligence can speed up the process quite a bit.
I did a lot of research on the importance of a comprehensive reflection process last year which you may find interesting, I’m hoping to finish editing soon, but if you’d like to see the current draft and/or have feedback here it is.