Right, this is basically the “aligned to what?” question, where the typical answer is simply “aligned to the user” or “intent aligned” rather than aligned to some specific values. Which means we are going to “foom” society as it current exists more or less, which I think could be quite catastrophic. “Better futures” or flourishing futures” work also tries to get at this, and I was trying to point o similar things in this work.
Right, this is basically the “aligned to what?” question, where the typical answer is simply “aligned to the user” or “intent aligned” rather than aligned to some specific values. Which means we are going to “foom” society as it current exists more or less, which I think could be quite catastrophic. “Better futures” or flourishing futures” work also tries to get at this, and I was trying to point o similar things in this work.
And thanks for sharing, will check this out!