As a first draft, roughly, I think the speculation is worthwhile IF AND ONLY IF it’s in a context where it will then be followed up by maker/breaker investigation, on the question of “whether / how this can actually lead to SHIA in the real world”. This includes going back and forth between skeptically searching for flaws, and optimistically searching for workarounds/alternatives/reasons for hope. It also includes thinking about the whole process of getting to the working tech, including
would this even increase intelligence meaningfully, and how would we know
getting researchers and funding for the research at various stages
having intermediate feedback on success
questions about how society will receive it—researchers, regulation, funding, and deployment are all related to this, so if you’re so dismissive of these questions that you don’t consider them at all, there’s a significant chance you’re just barking up the wrong tree in terms of actually getting this done
As a first draft, roughly, I think the speculation is worthwhile IF AND ONLY IF it’s in a context where it will then be followed up by maker/breaker investigation, on the question of “whether / how this can actually lead to SHIA in the real world”. This includes going back and forth between skeptically searching for flaws, and optimistically searching for workarounds/alternatives/reasons for hope. It also includes thinking about the whole process of getting to the working tech, including
would this even increase intelligence meaningfully, and how would we know
getting researchers and funding for the research at various stages
having intermediate feedback on success
questions about how society will receive it—researchers, regulation, funding, and deployment are all related to this, so if you’re so dismissive of these questions that you don’t consider them at all, there’s a significant chance you’re just barking up the wrong tree in terms of actually getting this done
I think that some ideas are born fragile and they need to be incubated and insulated before they are exposed to the horrors of politics.
I’m talking both about politics, but also and mainly about the technical plan.