Posts or comments on personal Twitter accounts, Facebook walls, etc. should not be assumed to represent any official or consensus MIRI position, unless noted otherwise. I’ll echo Rob’s comment here that “a good safety approach should be robust to the fact that the designers don’t have all the answers”. If an AI project hinges on the research team being completely free from epistemic shortcomings and moral failings, then the project is doomed (and should change how it’s doing alignment research).
I suspect we’re on the same page about it being important to err in the direction of system designs that don’t encourage arms races or other zero-sum conflicts between parties with different object-level beliefs or preferences. See also the CEV discussion above.
Posts or comments on personal Twitter accounts, Facebook walls, etc. should not be assumed to represent any official or consensus MIRI position, unless noted otherwise. I’ll echo Rob’s comment here that “a good safety approach should be robust to the fact that the designers don’t have all the answers”. If an AI project hinges on the research team being completely free from epistemic shortcomings and moral failings, then the project is doomed (and should change how it’s doing alignment research).
I suspect we’re on the same page about it being important to err in the direction of system designs that don’t encourage arms races or other zero-sum conflicts between parties with different object-level beliefs or preferences. See also the CEV discussion above.