Oh, I don’t think the worry hinges on particular infohazards that aren’t public in EA. I’m thinking of a pretty general problem like: “The value of the future from the perspective of your altruistic values, epistemology, and decision theory upon reflection is probably a non-monotonic function of how much you increase wisdom etc. broadly. More ‘wisdom’ or knowledge for actors who are misaligned with you can be quite bad.” And this is at least somewhat borne out by examples like AI movement building, biorisk, and technological progress making factory farming worse.
Huh, I’m a little surprised to hear that, to be honest. To be clear, I mean something more like “visceral”/”rhetorical”/”de facto” convincingness, not whether it purely logically hinges on it.
Also, just thinking of this because I’m reading it right now—if you want to convince more people of your view, a critical review / “rebuttal” of https://www.forethought.org/research/how-to-make-the-future-better might be cool. Would be memetically strong. (I could also imagine reasons why you might not want that, of course).
Oh, I don’t think the worry hinges on particular infohazards that aren’t public in EA. I’m thinking of a pretty general problem like: “The value of the future from the perspective of your altruistic values, epistemology, and decision theory upon reflection is probably a non-monotonic function of how much you increase wisdom etc. broadly. More ‘wisdom’ or knowledge for actors who are misaligned with you can be quite bad.” And this is at least somewhat borne out by examples like AI movement building, biorisk, and technological progress making factory farming worse.
Huh, I’m a little surprised to hear that, to be honest. To be clear, I mean something more like “visceral”/”rhetorical”/”de facto” convincingness, not whether it purely logically hinges on it.
Also, just thinking of this because I’m reading it right now—if you want to convince more people of your view, a critical review / “rebuttal” of https://www.forethought.org/research/how-to-make-the-future-better might be cool. Would be memetically strong. (I could also imagine reasons why you might not want that, of course).
I ended up writing my own version of the list (for AI interventions, not for wisdom/cooperation) in a post, would be curious for your thoughts!