Relatedly, there’s something like a soft pause or slowdown where you slow training runs using compute beyond a certain threshold, but the threshold is moving every year. This could be a pragmatic tweak because compute will likely get cheaper, so it becomes easier for rogue actors to circumvent the compute cap if it never moves. This soft pause idea has been referred to as “moving bright line (of a compute cap).”
Relatedly, there’s something like a soft pause or slowdown where you slow training runs using compute beyond a certain threshold, but the threshold is moving every year. This could be a pragmatic tweak because compute will likely get cheaper, so it becomes easier for rogue actors to circumvent the compute cap if it never moves. This soft pause idea has been referred to as “moving bright line (of a compute cap).”