Path Breaking Emergence
Path-breaking emergence in artificial intelligence focuses on understanding how complex, unexpected capabilities arise from the interactions of simpler components within large-scale models, particularly deep neural networks and large language models (LLMs). Current research investigates this phenomenon through various lenses, including analyzing training dynamics, exploring the role of model architecture (e.g., transformers, recurrent networks), and developing quantitative metrics to measure emergence. These studies aim to improve our understanding of model behavior, enhance model design and training, and ultimately contribute to safer and more reliable AI systems.
Papers
Coin-Flipping In The Brain: Statistical Learning with Neuronal Assemblies
Max Dabagia, Daniel Mitropolsky, Christos H. Papadimitriou, Santosh S. Vempala
Speaking Your Language: Spatial Relationships in Interpretable Emergent Communication
Olaf Lipinski, Adam J. Sobey, Federico Cerutti, Timothy J. Norman