What percent of cosmic resources do you expect to be spent thoughtfully and altruistically? 0%? 10%?
I would guess the thoughtful and altruistic subset of resources dominate in most scenarios where humans retain control.
Then, my main argument for why human control would be good is that the fraction isn’t that small (more like 20% in expectation than 0%) and that unaligned AI takeover seems probably worse than this.
Also, as an aside, I agree that little good public argumentation has been made about the relative value of unaligned AI control vs human control. I’m sympathetic to various discussion from Paul Christiano and Joe Carlsmith, but the public scope and detail is pretty limited thus far.
What percent of cosmic resources do you expect to be spent thoughtfully and altruistically? 0%? 10%?
I would guess the thoughtful and altruistic subset of resources dominate in most scenarios where humans retain control.
Then, my main argument for why human control would be good is that the fraction isn’t that small (more like 20% in expectation than 0%) and that unaligned AI takeover seems probably worse than this.
Also, as an aside, I agree that little good public argumentation has been made about the relative value of unaligned AI control vs human control. I’m sympathetic to various discussion from Paul Christiano and Joe Carlsmith, but the public scope and detail is pretty limited thus far.