I think people have made fair points around my bar maybe being generally unreasonable. I.e. itâs the default for any research field that major insights donât appear out of nowhere, and that itâs almost always possible to find similar previous ideas [...]
I think this is largely correct, but that itâs still correct to update negatively on the value of research if past progress has been less good on the spectra of majority and novelty.
I donât understand the last sentence there. In particular, Iâm not sure what you mean âless goodâ in comparison to.
Do you mean if past progress has been less major and novel than expected? If so, then Iâd agree that itâs correct to update negatively if thatâs the case.
But given the point about âthe default for any research fieldâ, it seems unclear to me whether itâs actually been less major and novel than expected. Perhaps instead weâve had roughly the sort and amount of progress that people wouldâve expected ~2015 when thinking that more money and people should flow towards doing longtermist macrostrategy/âGPR?
So here are three things I think you might mean:
âLongtermist macrostrategy/âGPRâs insights have been even less major and novel than one would typically expect. So we should update negatively about the value of more work in this field in particular (including relative to work in other fields) - perhaps itâs unusually intractable.â
âPeople who advocated, funded, or did longtermist macrostrategy/âGPR had failed to recognise that research fields rarely have major insights out of nowhere, and thus overestimated the value of more research in general. So we should update negatively about the value of more research in general, including in relation to this field.â
âPeople who advocated, funded, or did longtermist macrostrategy/âGPR mistakenly thought that that field would be an exception to the general pattern of fields rarely having major, novel insights. Now that we have evidence that they were probably mistaken, we should update negatively about this field in particular (moving towards thinking itâs more like other fields).â
Is one of those an accurate description of your view?
Among your three points, I believe something like 1 (for an appropriate reference class to determine âtypicalâ, probably something closer to âearly-stage fieldsâ than âall fieldsâ). Though not by a lot, and I also havenât thought that much about how much to expect, and could relatively easily be convinced that I expected too much.
I donât think I believe 2 or 3. I donât have much specific information about assumptions made by people who advocated for or funded macrostrategy research, but a priori Iâd find it surprising if they had made these mistakes to a strong extent.
I also havenât thought much about how much one should typically expect in a random field, how that should increase or decrease for this field in the last 5 years just because of how many people and dollars it got (compared to other fields), or how what was produced in the last 5 years in this field compares to that.
But one thing that strikes me is that longtermist macrostrategy/âGPR researchers over the past 5 years have probably had substantially less training and experience than researchers in most academic fields weâd probably compare this to. (I havenât really checked this, but Iâd guess itâs true.)
So maybe if there was less novel or less major insights from this field than we should typically expect of a field with the same amount of people and dollars, this can be explained by the people having less human capital, rather than by the field being intrinsically harder to make progress on?
(It could also perhaps be explained if the unusual approaches that are decently often taken in this field tend to be less effectiveâe.g., more generalist/âshallow work rather than deeper dives into narrower topics, and more blog post style work.)
Interesting thoughts, thanks :)
I donât understand the last sentence there. In particular, Iâm not sure what you mean âless goodâ in comparison to.
Do you mean if past progress has been less major and novel than expected? If so, then Iâd agree that itâs correct to update negatively if thatâs the case.
But given the point about âthe default for any research fieldâ, it seems unclear to me whether itâs actually been less major and novel than expected. Perhaps instead weâve had roughly the sort and amount of progress that people wouldâve expected ~2015 when thinking that more money and people should flow towards doing longtermist macrostrategy/âGPR?
So here are three things I think you might mean:
âLongtermist macrostrategy/âGPRâs insights have been even less major and novel than one would typically expect. So we should update negatively about the value of more work in this field in particular (including relative to work in other fields) - perhaps itâs unusually intractable.â
âPeople who advocated, funded, or did longtermist macrostrategy/âGPR had failed to recognise that research fields rarely have major insights out of nowhere, and thus overestimated the value of more research in general. So we should update negatively about the value of more research in general, including in relation to this field.â
âPeople who advocated, funded, or did longtermist macrostrategy/âGPR mistakenly thought that that field would be an exception to the general pattern of fields rarely having major, novel insights. Now that we have evidence that they were probably mistaken, we should update negatively about this field in particular (moving towards thinking itâs more like other fields).â
Is one of those an accurate description of your view?
Yes, I meant âless than expectedâ.
Among your three points, I believe something like 1 (for an appropriate reference class to determine âtypicalâ, probably something closer to âearly-stage fieldsâ than âall fieldsâ). Though not by a lot, and I also havenât thought that much about how much to expect, and could relatively easily be convinced that I expected too much.
I donât think I believe 2 or 3. I donât have much specific information about assumptions made by people who advocated for or funded macrostrategy research, but a priori Iâd find it surprising if they had made these mistakes to a strong extent.
I also havenât thought much about how much one should typically expect in a random field, how that should increase or decrease for this field in the last 5 years just because of how many people and dollars it got (compared to other fields), or how what was produced in the last 5 years in this field compares to that.
But one thing that strikes me is that longtermist macrostrategy/âGPR researchers over the past 5 years have probably had substantially less training and experience than researchers in most academic fields weâd probably compare this to. (I havenât really checked this, but Iâd guess itâs true.)
So maybe if there was less novel or less major insights from this field than we should typically expect of a field with the same amount of people and dollars, this can be explained by the people having less human capital, rather than by the field being intrinsically harder to make progress on?
(It could also perhaps be explained if the unusual approaches that are decently often taken in this field tend to be less effectiveâe.g., more generalist/âshallow work rather than deeper dives into narrower topics, and more blog post style work.)