Path Breaking Emergence
Path-breaking emergence in artificial intelligence focuses on understanding how complex, unexpected capabilities arise from the interactions of simpler components within large-scale models, particularly deep neural networks and large language models (LLMs). Current research investigates this phenomenon through various lenses, including analyzing training dynamics, exploring the role of model architecture (e.g., transformers, recurrent networks), and developing quantitative metrics to measure emergence. These studies aim to improve our understanding of model behavior, enhance model design and training, and ultimately contribute to safer and more reliable AI systems.
Papers
Emergence of Maps in the Memories of Blind Navigation Agents
Erik Wijmans, Manolis Savva, Irfan Essa, Stefan Lee, Ari S. Morcos, Dhruv Batra
Communication Drives the Emergence of Language Universals in Neural Agents: Evidence from the Word-order/Case-marking Trade-off
Yuchen Lian, Arianna Bisazza, Tessa Verhoef