Thank you for this thoughtful reply, this comment is basically the reason this update exists. You were right that Hamilton is probably right.
I have written a longer update incorporating Hamilton’s reanalysis and extending the economics in two directions: a quantitative treatment of verification as the binding constraint, and a systematic look at the economic conditions under which a genuinely dangerous autonomous agent actually gets to run.
Curious whether you think the analysis holds up, and whether there are important considerations I have missed!
Thank you for this thoughtful reply, this comment is basically the reason this update exists. You were right that Hamilton is probably right.
I have written a longer update incorporating Hamilton’s reanalysis and extending the economics in two directions: a quantitative treatment of verification as the binding constraint, and a systematic look at the economic conditions under which a genuinely dangerous autonomous agent actually gets to run.
Curious whether you think the analysis holds up, and whether there are important considerations I have missed!