Multi-Agent Empowerment and Emergence of Complex Behavior in Groups
Authors: Tristan Shah, Ilya Nemenman, Daniel Polani, Stas Tiomkin
Organizations: Department of Computer Science Texas Tech University United States of America · Department of Physics, Department of Biology, Initiative in Theory and Modeling of Living Systems Emory University United States of America · Department of Computer Science, School of Physics, Engineering and Computer Science University of Hertfordshire United Kingdom
Intrinsic motivations are receiving increasing attention, i.e. behavioral incentives that are not engineered, but emerge from the interaction of an agent with its surroundings. In this work we study the emergence of behaviors driven by one such incentive, empowerment, specifically in the context of more than one agent. We formulate a principled extension of empowerment to the multi-agent setting, and demonstrate its efficient calculation. We observe that this intrinsic motivation gives rise to characteristic modes of group-organization in two qualitatively distinct environments: a pair of agents coupled by a tendon, and a controllable Vicsek flock. This demonstrates the potential of intrinsic motivations such as empowerment to not just drive behavior for only individual agents but also higher levels of behavioral organization at scale.