In this framework, AGI is developed by improving and scaling up approaches within the current ML paradigm, not by discovering new algorithmic paradigms.
So the kinda zoomed out idea behind the Compute-centric framwork is that I’m assuming something like the current paradigm is going to lead to human-level AI and further, and I’m assuming that we get there by scaling up and improving the current algorithmic approaches. So it’s going to look like better versions of transformers that are more efficient and that allow for larger context windows...”
Both of these seem to be pretty scaling-maximalist to me, so I don’t think the quote seems wrong, at least to me? It’d be pretty hard to make a model which includes the possibility of the paradigm not getting us to AGI and then needing a period of exploration across the field to find the other breakthroughs needed.
From the summary page on Open Phil:
From this presentation about it to GovAI (from April 2023) at 05:10:
Both of these seem to be pretty scaling-maximalist to me, so I don’t think the quote seems wrong, at least to me? It’d be pretty hard to make a model which includes the possibility of the paradigm not getting us to AGI and then needing a period of exploration across the field to find the other breakthroughs needed.