Great post Chris, very clear. I’d like to add something of a bummer reply, to anyone reading:
Please don’t work on AI Safety unless what is motivating you is the genuine desire to have a positive impact.
I think there is already a real failure mode where status motivated people are joining the space because (1) of the attention it is getting among the general public. I.e. it is ‘sexy’ and (2) the people they respect are also in the space.
If this kind of person is put in the position of losing status for what one believes is good and true (e.g. Stanislov Petrov) then I don’t trust them to make the right decisions.
Great post Chris, very clear. I’d like to add something of a bummer reply, to anyone reading:
Please don’t work on AI Safety unless what is motivating you is the genuine desire to have a positive impact.
I think there is already a real failure mode where status motivated people are joining the space because (1) of the attention it is getting among the general public. I.e. it is ‘sexy’ and (2) the people they respect are also in the space.
If this kind of person is put in the position of losing status for what one believes is good and true (e.g. Stanislov Petrov) then I don’t trust them to make the right decisions.
Maybe I’ll write a post about this...