For people who are confused by the title, there is a nice paper overview on computerphile here, titled “has generative AI already peaked?”.
If I’m interpreting it right, the authors seem to be indicating based on their experiments that shoving in more compute power and data like openAI is doing with GPT will experience diminishing returns and not lead to significant general reasoning outside of their training set conditions. Or in EA terms, AGI is unlikely to arrive without significant algorithmic breakthroughs.
For people who are confused by the title, there is a nice paper overview on computerphile here, titled “has generative AI already peaked?”.
If I’m interpreting it right, the authors seem to be indicating based on their experiments that shoving in more compute power and data like openAI is doing with GPT will experience diminishing returns and not lead to significant general reasoning outside of their training set conditions. Or in EA terms, AGI is unlikely to arrive without significant algorithmic breakthroughs.