Latent Memory

Latent memory research explores how past information is stored and retrieved within artificial systems, mirroring the human brain's ability to access and utilize past experiences. Current work focuses on developing models that effectively leverage this latent information for improved performance in tasks like semantic segmentation, event processing, and lifelong learning, often employing memory networks or hierarchical architectures with mechanisms for memory replay and disentanglement of skills and knowledge. These advancements have significant implications for enhancing the efficiency and robustness of AI systems, particularly in addressing challenges like catastrophic forgetting and improving generalization across diverse tasks and environments.

Papers

June 20, 2024

Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Frontier AI Models
Sunny Duan, Mikail Khona, Abhiram Iyer, Rylan Schaeffer, Ila R Fiete
Language Model Limited Memorization Data Leakage Memorization Effect Latent Sequence Latent Memory

November 2, 2023

MemorySeg: Online LiDAR Semantic Segmentation with a Latent Memory
Enxu Li, Sergio Casas, Raquel Urtasun
Semantic Segmentation Point Cloud LiDAR Point Cloud Lidar Semantic Segmentation 3D Sparse Range View Latent Memory

May 29, 2023

Hierarchical Neural Memory Network for Low Latency Event Processing
Ryuhei Hamaguchi, Yasutaka Furukawa, Masaki Onishi, Ken Sakurada
Dense Prediction Hierarchical Memory Sparse Event Latent Memory

November 12, 2022

LLEDA -- Lifelong Self-Supervised Domain Adaptation
Mamatha Thota, Dewei Yi, Georgios Leontidis
Catastrophic Forgetting Complementary Learning Self Supervised Domain Adaptation Latent Memory

May 6, 2022

SKILL-IL: Disentangling Skill and Knowledge in Multitask Imitation Learning
Bian Xihan, Oscar Mendez, Simon Hadfield
Knowledge Based Better Generalization Unseen Environment Skill Transfer Shared Knowledge Lifelong Learning Latent Memory

Latent Memory

Papers

Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Frontier AI Models

MemorySeg: Online LiDAR Semantic Segmentation with a Latent Memory

Hierarchical Neural Memory Network for Low Latency Event Processing

LLEDA -- Lifelong Self-Supervised Domain Adaptation

SKILL-IL: Disentangling Skill and Knowledge in Multitask Imitation Learning