My experience is that it is generally good to share a draft, because organisations can be very touchy about irrelevant details that you don’t really care much about and are happy to correct. If you don’t give them this opportunity they will be annoyed and your credibility will be reduced when the truth comes out, even if it doesn’t have any real logical bearing on your conclusions.
To defend the side of the organizations a little, one reason for this is that they may have fairly different threat models from you/evaluators.
A concrete example in our community recently is the Scott Alexander/New York Times kerfuffle, where the seemingly irrelevant detail of Scott’s real last name was actually critical (in a way that the NYT journalist didn’t understand or chose not to understand) to maintaining a within-institution job of being a psychiatrist. There was a similar example with Naomi Wu iirc.
A much more minor example is that I noticed Peter (and others) usually being somewhat touchy and quick to correct people about any misrepresentations related to how much they pay employees, eg seehere. I don’t think his correction at all altered Ben_West’s core point, but from the perspective of leading a growing organization, having correct public numbers on how much new employees are paid may be pretty important for hiring.
To defend the side of the organizations a little, one reason for this is that they may have fairly different threat models from you/evaluators.
A concrete example in our community recently is the Scott Alexander/New York Times kerfuffle, where the seemingly irrelevant detail of Scott’s real last name was actually critical (in a way that the NYT journalist didn’t understand or chose not to understand) to maintaining a within-institution job of being a psychiatrist. There was a similar example with Naomi Wu iirc.
A much more minor example is that I noticed Peter (and others) usually being somewhat touchy and quick to correct people about any misrepresentations related to how much they pay employees, eg see here. I don’t think his correction at all altered Ben_West’s core point, but from the perspective of leading a growing organization, having correct public numbers on how much new employees are paid may be pretty important for hiring.
Yup, I agree with that, and am typically happy to make such requested changes.