Successful self-replication under no human assistance is the essential step for AI to outsmart the human beings
This seems clearly false. Replication (under their operationalization) is just another programming task that is not especially difficult. There’s no clear link between this task and self improvement, which would be a much harder ML task requiring very different types of knowledge and actions.
However, I do separately think we have passed the level of capabilities where it is responsible to keep improving AIs.
This seems clearly false. Replication (under their operationalization) is just another programming task that is not especially difficult. There’s no clear link between this task and self improvement, which would be a much harder ML task requiring very different types of knowledge and actions.
However, I do separately think we have passed the level of capabilities where it is responsible to keep improving AIs.