Path Breaking Emergence
Path-breaking emergence in artificial intelligence focuses on understanding how complex, unexpected capabilities arise from the interactions of simpler components within large-scale models, particularly deep neural networks and large language models (LLMs). Current research investigates this phenomenon through various lenses, including analyzing training dynamics, exploring the role of model architecture (e.g., transformers, recurrent networks), and developing quantitative metrics to measure emergence. These studies aim to improve our understanding of model behavior, enhance model design and training, and ultimately contribute to safer and more reliable AI systems.
Papers
Exploring Neuron Interactions and Emergence in LLMs: From the Multifractal Analysis Perspective
Xiongye Xiao, Chenyu Zhou, Heng Ping, Defu Cao, Yaxing Li, Yizhuo Zhou, Shixuan Li, Paul Bogdan
Predicting the Emergence of Solar Active Regions Using Machine Learning
Spiridon Kasapis, Irina N. Kitiashvili, Alexander G. Kosovichev, John T. Stefan, Bhairavi Apte