I’m not sure why you think 10k people signing it matters (as opposed to which people), or why you assume the factor is 10^(-6).
I think the number of people signing matters because, holding the mean influence per person constant, the more people sign, the greater the influence of the letter. Of course, who signs is also important! 10^-6 is just my direct intuitive guess.
I read this post and I’m not sure the estimate is anywhere close. By that I mean that it could be tens of orders of magnitude off, or even that the sign of the estimate could be wrong and it would be bad for this to get many signatures.
The expected effect has an upper limit of 1, so 10^-13 cannot be an underestimate by tens of orders of magnitude (at most, it can be an underestimate by 13 orders of magnitude). However, it can theoretically be an overestimate by tens of orders of magnitude if it is smaller than 10^-33 (= 10^-(13 + 20)). The mean effect being this low (or negative) would imply FLI’s efforts on this letter to be useless (or harmful) in expectation. I expect FLI’s efforts to be useful in expectation, so I guess signing the letter is also useful.
Moreover, for the reasons Brian Tomasik presented here, I do not think the expected effects of signing can reasonably differ tens of orders of magnitude.
I think it probably would have been more useful to people if you’d discussed more generally why you think this letter might have a good effect rather than trying to quantify existential risk reductions from individual EA forum users’ signatures (which I take to be extremely intractable).
Fair point. I signed the letter 2 days ago without doing any explicit calculations at all. My calculations are just for illustration, but if it is worth doing, it is worth doing with made-up statistics (which mine obviously are; please do not take them too seriously!).
Hi Thomas,
Thanks for sharing your thoughts!
I think the number of people signing matters because, holding the mean influence per person constant, the more people sign, the greater the influence of the letter. Of course, who signs is also important! 10^-6 is just my direct intuitive guess.
The expected effect has an upper limit of 1, so 10^-13 cannot be an underestimate by tens of orders of magnitude (at most, it can be an underestimate by 13 orders of magnitude). However, it can theoretically be an overestimate by tens of orders of magnitude if it is smaller than 10^-33 (= 10^-(13 + 20)). The mean effect being this low (or negative) would imply FLI’s efforts on this letter to be useless (or harmful) in expectation. I expect FLI’s efforts to be useful in expectation, so I guess signing the letter is also useful.
Moreover, for the reasons Brian Tomasik presented here, I do not think the expected effects of signing can reasonably differ tens of orders of magnitude.
Fair point. I signed the letter 2 days ago without doing any explicit calculations at all. My calculations are just for illustration, but if it is worth doing, it is worth doing with made-up statistics (which mine obviously are; please do not take them too seriously!).