This is interesting, but it feels like the difference needs a little more grounding. After all, “continuity” is always just an approximation—we are not literally building a continuum of AIs, one for each point along the curve. Progress from GPT-2 to GPT-3 or DALL-E to DALL-E 2 is clearly discrete. It seems like the difference is in how discrete it is, which is more of a quantitative difference than a qualitative difference.
This is interesting, but it feels like the difference needs a little more grounding. After all, “continuity” is always just an approximation—we are not literally building a continuum of AIs, one for each point along the curve. Progress from GPT-2 to GPT-3 or DALL-E to DALL-E 2 is clearly discrete. It seems like the difference is in how discrete it is, which is more of a quantitative difference than a qualitative difference.