Path Breaking Emergence
Path-breaking emergence in artificial intelligence focuses on understanding how complex, unexpected capabilities arise from the interactions of simpler components within large-scale models, particularly deep neural networks and large language models (LLMs). Current research investigates this phenomenon through various lenses, including analyzing training dynamics, exploring the role of model architecture (e.g., transformers, recurrent networks), and developing quantitative metrics to measure emergence. These studies aim to improve our understanding of model behavior, enhance model design and training, and ultimately contribute to safer and more reliable AI systems.
Papers
Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication
Łukasz Kuciński, Tomasz Korbak, Paweł Kołodziej, Piotr Miłoś
The Emergence of Objectness: Learning Zero-Shot Segmentation from Videos
Runtao Liu, Zhirong Wu, Stella X. Yu, Stephen Lin
Defining and Quantifying the Emergence of Sparse Concepts in DNNs
Jie Ren, Mingjie Li, Qirui Chen, Huiqi Deng, Quanshi Zhang