Rather, it seems logical to consider that “utilitarianism” must be measured according to the nature of the agent who defines utility.
What is useful for civilized human beings is to complete their civilizing process. The very process of choosing utilitarianism implies civilization, because hunter-gatherer Homo sapiens has no utility other than the satisfaction of their immediate needs in the context of species preservation (like any other mammal).
The civilizing process involves extracting the maximum benefit from human cooperative intelligence, which, to begin with, requires the control of aggressive instincts and innate irrationalisms.
An artificial intelligence can understand this perfectly. A human being in the process of civilization, however, will always continue to face their own prejudices and other innate limitations.
“The civilizing process involves extracting the maximum benefit from human cooperative intelligence, which, to begin with, requires the control of aggressive instincts and innate irrationalisms.”
Nowadays, there is trade off between “social orientation” and “individual iniciative”, while perhaps if you have enough advanced AI, it does not matter anymore.
Rather, it seems logical to consider that “utilitarianism” must be measured according to the nature of the agent who defines utility.
What is useful for civilized human beings is to complete their civilizing process. The very process of choosing utilitarianism implies civilization, because hunter-gatherer Homo sapiens has no utility other than the satisfaction of their immediate needs in the context of species preservation (like any other mammal).
The civilizing process involves extracting the maximum benefit from human cooperative intelligence, which, to begin with, requires the control of aggressive instincts and innate irrationalisms.
An artificial intelligence can understand this perfectly. A human being in the process of civilization, however, will always continue to face their own prejudices and other innate limitations.
“The civilizing process involves extracting the maximum benefit from human cooperative intelligence, which, to begin with, requires the control of aggressive instincts and innate irrationalisms.”
Nowadays, there is trade off between “social orientation” and “individual iniciative”, while perhaps if you have enough advanced AI, it does not matter anymore.
Jack Williamson (https://en.wikipedia.org/wiki/The_Humanoids) was rigth: the final test for Mankind is whether if Utopia is tolerable…