Sounds reasonable! I think the empirical side to the question “Will society be better equipped to set AI values in 2123?” is more lacking. For this purpose, I think “better equipped” can be nicely operationalized in a very value-uncertain way as “making decisions based on more reflection & evidence and higher-order considerations”.
This kind of exploration may include issues like:
Populism. Has it significantly decreased the amount of rationality that goes into gov. decision-making, in favor of following incentives & intuitions? And what will be faster—new manipulative technologies or the rate at which new generations get immune to them?
Demographics. Given that fundamentalists tend to have more children, should we expect there will be more of them in 2123?
Cultural evolution. Is Ian Morris or Christopher Brown more right, i.e. should we expect that as we get richer, we’ll be less prone to decide based on what gives us more power, and in turn attain values better calibrated with the most honest interpretation of reality?
Sounds reasonable! I think the empirical side to the question “Will society be better equipped to set AI values in 2123?” is more lacking. For this purpose, I think “better equipped” can be nicely operationalized in a very value-uncertain way as “making decisions based on more reflection & evidence and higher-order considerations”.
This kind of exploration may include issues like:
Populism. Has it significantly decreased the amount of rationality that goes into gov. decision-making, in favor of following incentives & intuitions? And what will be faster—new manipulative technologies or the rate at which new generations get immune to them?
Demographics. Given that fundamentalists tend to have more children, should we expect there will be more of them in 2123?
Cultural evolution. Is Ian Morris or Christopher Brown more right, i.e. should we expect that as we get richer, we’ll be less prone to decide based on what gives us more power, and in turn attain values better calibrated with the most honest interpretation of reality?