Lock in can also apply to “value-precursors” that determine how one goes about moral reflection, or which types of appeals one ends up finding convincing. I think these would get locked in to some degree (because something has to be fixed for it to be meaningful to talk about goalposts at all), and by affecting the precursors, moral or meta-philosophical reflection before aligned AGI can plausibly affect the outcomes post-AGI. It’s not very clear however whether that’s important, and from whose perspective it is important, because some of the things that mask as moral uncertainty might be humans having underdetermined values.
There’s some related discussion here.
Lock in can also apply to “value-precursors” that determine how one goes about moral reflection, or which types of appeals one ends up finding convincing. I think these would get locked in to some degree (because something has to be fixed for it to be meaningful to talk about goalposts at all), and by affecting the precursors, moral or meta-philosophical reflection before aligned AGI can plausibly affect the outcomes post-AGI. It’s not very clear however whether that’s important, and from whose perspective it is important, because some of the things that mask as moral uncertainty might be humans having underdetermined values.