“I mean a global, indefinite moratorium on the development of frontier models until it is safe to proceed.”
I think this is distinctly different from what you claim. In any actual system implementing a pause, the model developer is free “to prove their specific implementations are safe,” and go ahead. The question is what the default is—and you’ve implied elsewhere in this thread that you think that developers should be treated like pre-1938 drug manufacturers, with no rules.
If what you’re proposing is instead that there needs to be a regulatory body like the FDA to administer the rules and review cases when a company claims to have sufficient evidence of safety when planning to create a model, with a default rule that it’s illegal to develop the model until reviewed, instead of a ban with a review for exceptions when a company claims to have sufficient evidence of safety when planning to create a model, I think the gap between our positions is less blurry than it is primarily semantic.
you’ve implied elsewhere in this thread that you think that developers should be treated like pre-1938 drug manufacturers, with no rules.
I think you misread me. I’ve said across multiple comments that I favor targeted regulations that are based on foreseeable harms after we’ve gotten more acquainted with the technology. I don’t think that’s very similar to an indefinite pause, and it certainly isn’t the same as “no rules”.
That makes sense—I was confused, since you said different things, and some of them were subjunctive, and some were speaking about why you disagree with proposed analogies.
Given your perspective, is loss-of-control from more capable and larger models not a foreseeable harm? If we see a single example of this, and we manage to shut it down, would you then be in favor of a regulate-before-training approach?
I think this is distinctly different from what you claim. In any actual system implementing a pause, the model developer is free “to prove their specific implementations are safe,” and go ahead. The question is what the default is—and you’ve implied elsewhere in this thread that you think that developers should be treated like pre-1938 drug manufacturers, with no rules.
If what you’re proposing is instead that there needs to be a regulatory body like the FDA to administer the rules and review cases when a company claims to have sufficient evidence of safety when planning to create a model, with a default rule that it’s illegal to develop the model until reviewed, instead of a ban with a review for exceptions when a company claims to have sufficient evidence of safety when planning to create a model, I think the gap between our positions is less blurry than it is primarily semantic.
I think you misread me. I’ve said across multiple comments that I favor targeted regulations that are based on foreseeable harms after we’ve gotten more acquainted with the technology. I don’t think that’s very similar to an indefinite pause, and it certainly isn’t the same as “no rules”.
That makes sense—I was confused, since you said different things, and some of them were subjunctive, and some were speaking about why you disagree with proposed analogies.
Given your perspective, is loss-of-control from more capable and larger models not a foreseeable harm? If we see a single example of this, and we manage to shut it down, would you then be in favor of a regulate-before-training approach?