Yeah, it seems strange to be forced to adopt a scenario where the development of AGI doesn’t create some kind of surprising upset in terms of power.
I suppose a contest that included a singularity might seem too far out for most people. And maybe this is the best we can do insofar as persuading people to engage with these ideas. (There’s definitely a risk that people over update on these kind of scenarios, but it’s not obvious that this will be a huge problem).
Yeah, it seems strange to be forced to adopt a scenario where the development of AGI doesn’t create some kind of surprising upset in terms of power.
I suppose a contest that included a singularity might seem too far out for most people. And maybe this is the best we can do insofar as persuading people to engage with these ideas. (There’s definitely a risk that people over update on these kind of scenarios, but it’s not obvious that this will be a huge problem).