âEA-according-to-their-own valuesâ, i.e. E, is just instrumental rationality, right?
ETA: or maybe youâre thinking instead of something like actually internalizing/âadopting their explicit values as ends, which does seem like an important separate step?
I was meaning âinstrumental rationality applied to whatever part of their values is other-affectingâ.
I think this is especially important to pull out explicitly relative to regular instrumental rationality, because the feedback loops are less automatic (so a lot of the instrumental rationality people learn by default is in service of their prudential goals).
âEA-according-to-their-own valuesâ, i.e. E, is just instrumental rationality, right?
ETA: or maybe youâre thinking instead of something like actually internalizing/âadopting their explicit values as ends, which does seem like an important separate step?
I was meaning âinstrumental rationality applied to whatever part of their values is other-affectingâ.
I think this is especially important to pull out explicitly relative to regular instrumental rationality, because the feedback loops are less automatic (so a lot of the instrumental rationality people learn by default is in service of their prudential goals).