This is an extremely difficult and compelling problem.
On the one hand, I’ve long been rather obsessed with cosmopolitanism/pluralism/lacking fingerprints. I think lock-in is sufficiently bad that I’ve frequently tried to convince people to just not have positive goals at all and only have negative goals.
On the other hand, fear of the responsibility of power doesn’t necessarily hold up to scrutiny, you can copenhagen ethics your way out of taking literally any actions ever (except for maybe, like, voting in a uniform-weighted democracy).
I think you need to have a lot of trust for complaints of this type to matter at all, i.e. trust that the complainer is deeply committed to social choice ethics and isn’t making a thinly veiled bid for power themselves that just happens to not be going very well at this point in time. We shouldn’t expect solutions to the whole “losers or minorities are incentivized to make appeals to sanctity of process/structure/institutional integrity, but you never know if they’ll care just as much about that stuff if they ever pivot to winning or being a majority” problem to magically appear because of machine learning progress, right?
This is an extremely difficult and compelling problem.
On the one hand, I’ve long been rather obsessed with cosmopolitanism/pluralism/lacking fingerprints. I think lock-in is sufficiently bad that I’ve frequently tried to convince people to just not have positive goals at all and only have negative goals.
On the other hand, fear of the responsibility of power doesn’t necessarily hold up to scrutiny, you can copenhagen ethics your way out of taking literally any actions ever (except for maybe, like, voting in a uniform-weighted democracy).
I think you need to have a lot of trust for complaints of this type to matter at all, i.e. trust that the complainer is deeply committed to social choice ethics and isn’t making a thinly veiled bid for power themselves that just happens to not be going very well at this point in time. We shouldn’t expect solutions to the whole “losers or minorities are incentivized to make appeals to sanctity of process/structure/institutional integrity, but you never know if they’ll care just as much about that stuff if they ever pivot to winning or being a majority” problem to magically appear because of machine learning progress, right?