“Ethics as I define it also isn’t a welfare maximization game”
Is there any documentation on that ethical system?
“The present is the sum of past actions”.
But present action can only impact the future. Of course an AGI can use present punishments to alter future behaviour, but being powerfull enough, probably she would have better means. And regarding past action, nothing can be done.
“Any system where there was an imbalance between the treatment of positive and negative value would be discriminatory, unstable, and unethical. ”
why unstable? In a system where there are several beings with similar power, this is true. But if AGI is powerful enough, she doesn’t need to discipline humans: she can control or even alter them. Punishment is a crude mechanism useful for social interaction among near peers.
It is baked into a few different papers I’ve written since 2020. I think part of the disconnect here is that the fundamental purpose of the system of ethics I’m talking about isn’t an intention to alter future behavior. The purpose isn’t to optimize human behavior, but rather to measure it.
A system that can’t measure the ethical value of actions, positive or negative, can’t react appropriately to them. A system that can measure them and chooses not to react appropriately isn’t ethical, and if it reacts only to some fraction according to bias, then it is unstable and unethical.
“Power” as most people use the term is trivial, and collective intelligence always wins against a standalone system, no matter how “powerful” it may be, since Perspective “Binds and Blinds”, while collective intelligence reduces cognitive bias. But again, the purpose isn’t behavioral modification.
People will make their own choices, regardless of what attempts to modify their behavior are deployed. It isn’t the mandate of ethics as I use the term to modify behavior, but rather to measure ethical value, and react according to that value.
“Ethics as I define it also isn’t a welfare maximization game”
Is there any documentation on that ethical system?
“The present is the sum of past actions”.
But present action can only impact the future. Of course an AGI can use present punishments to alter future behaviour, but being powerfull enough, probably she would have better means. And regarding past action, nothing can be done.
“Any system where there was an imbalance between the treatment of positive and negative value would be discriminatory, unstable, and unethical. ”
why unstable? In a system where there are several beings with similar power, this is true. But if AGI is powerful enough, she doesn’t need to discipline humans: she can control or even alter them. Punishment is a crude mechanism useful for social interaction among near peers.
It is baked into a few different papers I’ve written since 2020. I think part of the disconnect here is that the fundamental purpose of the system of ethics I’m talking about isn’t an intention to alter future behavior. The purpose isn’t to optimize human behavior, but rather to measure it.
A system that can’t measure the ethical value of actions, positive or negative, can’t react appropriately to them. A system that can measure them and chooses not to react appropriately isn’t ethical, and if it reacts only to some fraction according to bias, then it is unstable and unethical.
“Power” as most people use the term is trivial, and collective intelligence always wins against a standalone system, no matter how “powerful” it may be, since Perspective “Binds and Blinds”, while collective intelligence reduces cognitive bias. But again, the purpose isn’t behavioral modification.
People will make their own choices, regardless of what attempts to modify their behavior are deployed. It isn’t the mandate of ethics as I use the term to modify behavior, but rather to measure ethical value, and react according to that value.