I quite like the âImportance of quantity over qualityâ factor and hadnât thought of this before! Itâs slightly entangled with verifiability (if you can cheaply assess whether something is good, then itâs fine to have a large quantity of attempts even if many are bad). But I think quantity vs quality also matters beyond that. Iâll add it as a possible additional factor in the post.
I agree that this factor advantages Data Generation and AI Control. I think Dangerous Capability Evals also benefits from quantity a lot.
I quite like the âImportance of quantity over qualityâ factor and hadnât thought of this before! Itâs slightly entangled with verifiability (if you can cheaply assess whether something is good, then itâs fine to have a large quantity of attempts even if many are bad). But I think quantity vs quality also matters beyond that. Iâll add it as a possible additional factor in the post.
I agree that this factor advantages Data Generation and AI Control. I think Dangerous Capability Evals also benefits from quantity a lot.