PSA: if “pause” is not defined but seems to refer to a specific kind of government policy, it most likely means policy regime that stops training runs using compute beyond a certain threshold.
Relatedly, there’s something like a soft pause or slowdown where you slow training runs using compute beyond a certain threshold, but the threshold is moving every year. This could be a pragmatic tweak because compute will likely get cheaper, so it becomes easier for rogue actors to circumvent the compute cap if it never moves. This soft pause idea has been referred to as “moving bright line (of a compute cap).”
PSA: if “pause” is not defined but seems to refer to a specific kind of government policy, it most likely means policy regime that stops training runs using compute beyond a certain threshold.
Relatedly, there’s something like a soft pause or slowdown where you slow training runs using compute beyond a certain threshold, but the threshold is moving every year. This could be a pragmatic tweak because compute will likely get cheaper, so it becomes easier for rogue actors to circumvent the compute cap if it never moves. This soft pause idea has been referred to as “moving bright line (of a compute cap).”