One-shot learning of paired association navigation with biologically plausible schemas
Authors: M Ganesh Kumar, Cheston Tan, Camilo Libedinsky, Shih-Cheng Yen, Andrew Yong-Yi Tan
Organizations: Integrative Sciences and Engineering Programme, NUS Graduate School, National University of Singapore · The N.1 Institute for Health, National University of Singapore · Engineering Design and Innovation Centre, College of Design and Engineering, National University of Singapore · School of Engineering and Applied Sciences, Harvard University · Institute for Infocomm Research, Agency for Science, Technology and Research · Department of Psychology, National University of Singapore · Institute of Molecular and Cell Biology, Agency for Science, Technology and Research · Department of Physiology, Yong Loo Lin School of Medicine, National University of Singapore · Healthy Longevity Translational Research Programme, Yong Loo Lin School of Medicine, National University of Singapore · Cardiovascular Disease Translational Research Programme, Yong Loo Lin School of Medicine, National University of Singapore · Neurobiology Programme, Life Sciences Institute, National University of Singapore
After learning a multiple paired-association (MPA) navigation task, rodents can rapidly learn new cue-location associations after a single exposure, a phenomenon proposed to be facilitated by cognitive schemas. However, it remains unclear what schemas support this behavior and how they could be implemented in biological neural circuits. Here, we identify a set of schemas sufficient for gradual then one-shot paired-association navigation, and implement them in a fully neural agent using biologically plausible plasticity rules. The agent gradually acquires a low-dimensional spatial metric representation using a path-integration based temporal-difference error, enabling self-localization across different environments. It also contains a memory network that forms one-shot associations between sensory cues and goal locations, implemented using reward-modulated exploratory Hebbian (EH) plasticity. A third network performs vector subtraction between the agent's current and goal location to compute goal-directed actions. Supplementing these schemas with an actor-critic enables one-shot navigation past obstacles. Lastly, learning a working-memory gating mechanism using the temporal-difference error enables one-shot learning even with brief cue and distractor presentation. The model reproduces key behavioral features of rodent learning in the MPA task and generates testable predictions about the neural mechanisms underlying schema-based one-shot learning.
School of Psychological and Cognitive Sciences, Peking University · IDG/McGovern Institute for Brain Research, Peking University · Peking-Tsinghua Center for Life Sciences, Academy for Advanced Interdisciplinary Studies, Peking University +2