A limit on compute designed to constrain OpenAI, Anthropic, or Google from training a new model sounds like a very high bar. I don’t understand why that could easily be got around?
Spoofing accounts to combine multiple of them together (as in the Clippy story linked, but I’m imagining humans doing it). The kind of bending of the rules that happens when something is merely regulated but not taboo. It’s not just Microsoft and Google we need to worry about. If the techniques and code are out there (open source models are not far behind cutting edge research), many actors will be trying to run them at scale.
These will still be massive, and massively expensive, training runs though—big operations that will constitute very big strategic decisions only available to the best-resourced actors.
In the post-AutoGPT world, this seems like it will no longer be the case. There is enough fervour by AGI accelerationists that the required resources could be quickly amassed by crowdfunding (cf. crypto projects raising similar amounts to those needed).
A limit on compute designed to constrain OpenAI, Anthropic, or Google from training a new model sounds like a very high bar. I don’t understand why that could easily be got around?
Spoofing accounts to combine multiple of them together (as in the Clippy story linked, but I’m imagining humans doing it). The kind of bending of the rules that happens when something is merely regulated but not taboo. It’s not just Microsoft and Google we need to worry about. If the techniques and code are out there (open source models are not far behind cutting edge research), many actors will be trying to run them at scale.
These will still be massive, and massively expensive, training runs though—big operations that will constitute very big strategic decisions only available to the best-resourced actors.
In the post-AutoGPT world, this seems like it will no longer be the case. There is enough fervour by AGI accelerationists that the required resources could be quickly amassed by crowdfunding (cf. crypto projects raising similar amounts to those needed).
Yes, but they will become increasingly cheaper. A taboo is far stronger than regulation.