Executive summary: Executive summary: The author challenges the view that the ‘sharp left turn’ in evolution happened due to the inability to pass learned information to the next generation, arguing instead that this interpretation is speculative and possibly incorrect, and that alternatives such as the advent of culture should be considered.
Key points:
The post’s claim that overcoming intergenerational information loss was pivotal in human evolution is speculative. Many biological channels emerged to transmit information between generations.
Alternative stories posit cultural evolution itself was the pivotal development, enabling a powerful new evolutionary process. The emergence of cultural replicators and their interactions may represent a qualitative change.
We lack enough understanding of what happened with human culture to validate the post’s core claim about the evolutionary mechanism. This undermines using it to forecast AI progress.
The metaphor between genetic and cultural evolution is limited. Relations between human brains and cultural evolution are unlike those between base and mesa optimizers.
Current AI learning processes are obviously inefficient compared to human learning. We should be cautious about underestimating inefficiency and potential for rapid capability gains.
The evolutionary analysis does not provide clear implications for forecasting AI progress. We need more rigorous
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, andcontact us if you have feedback.
Executive summary: Executive summary: The author challenges the view that the ‘sharp left turn’ in evolution happened due to the inability to pass learned information to the next generation, arguing instead that this interpretation is speculative and possibly incorrect, and that alternatives such as the advent of culture should be considered.
Key points:
The post’s claim that overcoming intergenerational information loss was pivotal in human evolution is speculative. Many biological channels emerged to transmit information between generations.
Alternative stories posit cultural evolution itself was the pivotal development, enabling a powerful new evolutionary process. The emergence of cultural replicators and their interactions may represent a qualitative change.
We lack enough understanding of what happened with human culture to validate the post’s core claim about the evolutionary mechanism. This undermines using it to forecast AI progress.
The metaphor between genetic and cultural evolution is limited. Relations between human brains and cultural evolution are unlike those between base and mesa optimizers.
Current AI learning processes are obviously inefficient compared to human learning. We should be cautious about underestimating inefficiency and potential for rapid capability gains.
The evolutionary analysis does not provide clear implications for forecasting AI progress. We need more rigorous
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.