I think the 20% figure, albeit a step in the right direction, is in reality a lot less impressive than it first sounds. From OpenAI’s “Introducing Superalignment” post:
We are dedicating 20% of the compute we’ve secured to date over the next four years to solving the problem of superintelligence alignment.
I expect that 20% of OpenAI’s 2023 compute will be but a tiny fraction of their 2027 compute, given that training compute has been growing by something like 4.2x/year.
Well OpenAI just announced that they’re going to spend 20% of their compute on alignment in the next four years so I think it’s paid off prima facie.
I think the 20% figure, albeit a step in the right direction, is in reality a lot less impressive than it first sounds. From OpenAI’s “Introducing Superalignment” post:
I expect that 20% of OpenAI’s 2023 compute will be but a tiny fraction of their 2027 compute, given that training compute has been growing by something like 4.2x/year.