Executive summary: The term “Emergence” has been used inconsistently in the machine learning field to describe capabilities of large language models, leading to confusion and imprecise claims about the risks and properties of these systems.
Key points:
“Emergence” has been used to differentiate large language models (LLMs) from smaller models, but definitions vary and are sometimes circular.
Some papers cite Emergence as a key risk of LLMs, influencing policymakers, but the term’s meaning is unclear.
“Emerge” already has established uses, including in complex systems theory, adding to the confusion.
Recent papers critique Emergence claims, arguing in-context learning is not Emergent and Emergence depends on chosen metrics.
Imprecise use of Emergence undermines understanding and complicates decision-making around advanced AI systems.
The concept hints at real phenomena like phase transitions in ML systems and surprising capabilities, but terming them Emergent is problematic.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, andcontact us if you have feedback.
Executive summary: The term “Emergence” has been used inconsistently in the machine learning field to describe capabilities of large language models, leading to confusion and imprecise claims about the risks and properties of these systems.
Key points:
“Emergence” has been used to differentiate large language models (LLMs) from smaller models, but definitions vary and are sometimes circular.
Some papers cite Emergence as a key risk of LLMs, influencing policymakers, but the term’s meaning is unclear.
“Emerge” already has established uses, including in complex systems theory, adding to the confusion.
Recent papers critique Emergence claims, arguing in-context learning is not Emergent and Emergence depends on chosen metrics.
Imprecise use of Emergence undermines understanding and complicates decision-making around advanced AI systems.
The concept hints at real phenomena like phase transitions in ML systems and surprising capabilities, but terming them Emergent is problematic.
This comment was auto-generated by the EA Forum Team. Feel free to point out issues with this summary by replying to the comment, and contact us if you have feedback.