Memory-Augmented VLMs

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

30 papers in the last four weeks, up 114% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 93

All topics

PMMC: Prospective Multimodal Memory Compilation for Long-Term LVLM Agents
Aug 2, 2026Jingyu Sun, Yan Lin, Yuyang Xue +10Memory-Augmented VLMs Multimodal Memory
The University of Manchester · The University of Newcastle · The University of Edinburgh +5
HAM-VLN: Harnessing Hierarchical Agentic Memory for Zero-Shot Vision-and-Language Navigation
Jul 31, 2026An Liu, Bingxi Liu, Hongyu Ding +6Memory-Augmented VLMs Vision-Language Navigation
Institute of Automation, Chinese Academy of Sciences, Beijing, China · Southern University of Science and Technology, Shenzhen, China · Pengcheng Laboratory, Shenzhen, China +3
ObjectStream: Latent Objects as Memory Anchors for Streaming Video Understanding
Jul 30, 2026Mingkang Dong, Muxin Pu, Jie Li +8Memory-Augmented VLMs Streaming Video Understanding
Universiti Malaya · Monash University · SJTU +5
Seen, Said, or Forgotten? A Causal Audit of Visual KV Memory Across Dialog Turns
Jul 28, 2026Hong Chen, Kang Chen, Yuxuan Fan +4Memory-Augmented VLMs Visual Question Answering
The Hong Kong University of Science and Technology (Guangzhou) · Wenzhou-Kean University
MemVLN: Episodic and Procedural Memory for Vision-and-Language Navigation
Jul 26, 2026Yuqi Liu, Shengju Qian, Tianyuan Qu +5Memory-Augmented VLMs Efficient VLM Inference
1The Chinese University of Hong Kong · 2LIGHTSPEED · 3The University of Hong Kong +1
Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos
Jul 22, 2026Penglei Sun, Yehua Huang, Zhuoli Tao +8Memory-Augmented VLMs Aerial Robotics
Information Hub, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · University of Freiburg, Freiburg, German · Hangzhou City University, Hangzhou, China +3
ChronoStitch: Training-Free Composition of Visual KV Memories for Long-Horizon Temporal Reasoning
Jul 21, 2026Santiram Tiwari, Nishant Sinha, Kunal KislayMemory-Augmented VLMs KV Caching
KGraph AI Solutions Pvt. Ltd., Bangalore, India – 560016
FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulation
Jul 20, 2026Ruicheng Li, Qixiu Li, Ruichun Ma +8Memory-Augmented VLMs Language-Conditioned Robot Manipulation
Tsinghua University · Microsoft Research · Fudan University +1
VLN-AVP: Zero-Shot Vision-Language Navigation with Hybrid Long-Short-Term Memory for Autonomous Valet Parking
Jul 20, 2026Yijian Li, Xiangru Mu, Changze Li +7Memory-Augmented VLMs Autonomous Parking
Shanghai Jiao Tong University, Shanghai, China · Yinwang Intelligent Technology Co., Ltd.
Memory-Supported Synergistic Adaptation for Training-Free Test-Time Medical Image Segmentation
Jul 20, 2026Lingrui Li, Nan Pu, Dong Zhao +4Memory-Augmented VLMs VLM Adaptation
School of Computer Science, University of Nottingham, UK · School of Computer Science and Information Engineering, Hefei University of Technology, China · Information Systems Technology and Design Pillar, Singapore University of Technology and Design, Singapore
ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning
Jul 20, 2026Ting Huang, Zhenyu Zhang, Wenyuan Huang +2Memory-Augmented VLMs Visual Spatial Reasoning
School of Computer Science, Peking University, Beijing, China · School of Intelligent Science and Technology, Nanjing University, Nanjing, China · Beijing Academy of Artificial Intelligence, Beijing, China
VTM-Nav: Hierarchical Visual-Topological Memory for Cross-Episode Object-Goal Navigation
Jul 16, 2026Xiaoran Xu, Yupeng Wu, Tianyu Xue +4Memory-Augmented VLMs Robot Navigation
MAIS, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing, China · Tsinghua University, Beijing, China +1
FOLIO: Focused Semantic Memory for Streaming Video Understanding
Jul 14, 2026Haoyang Fan, Dhruv Parikh, Anvitha Ramachandran +4Memory-Augmented VLMs Streaming Video Understanding
University of Southern California (USC), Los Angeles, CA, USA · Intel Labs, USA · DEVCOM Army Research Office
StoryTeller: Training-Free Narrative Grounding for Long-Form Audio Description
Jul 13, 2026Seung Hyun Hahm, Minh T. Dinh, SouYoung JinMemory-Augmented VLMs Video-Language Models
Dartmouth College, USA
Parse, Search, and Confirmation: Training-Free Aerial Vision-and-Dialog Navigation with Chain-of-Thought Reasoning and Structured Spatial Memory
Jul 13, 2026Yu Qi, Hongyu Li, Shaofei Huang +6Memory-Augmented VLMs UAV Navigation
School of Computer Science and Information Engineering, Hefei University of Technology · School of Artificial Intelligence, Beihang University · University of Macau +2
SLVMBench: Skill Learning from Video Memory
Jul 13, 2026Yudong Yang, Guangzhi Sun, Yixuan Li +1Memory-Augmented VLMs Video-Language Models
Tsinghua University · University of Cambridge
PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning
Jul 11, 2026Wenyuan Wang, Lianyu Hu, Hao Wang +1Memory-Augmented VLMs Physical Reasoning
1Nanyang Technological University · 2Rutgers University · University of Illinois Urbana-Champaign
Memory-Conditioned Tool Calling for Camera-First Visual Agents
Jul 10, 2026Xiaofan Wu, Xi Zeng, Miaoxia Chen +5Memory-Augmented VLMs Tool-Using Vision-Language Agents
Chance AI
TFP: Temporally Conditioned Memory-Fusion Policies for Visuomotor Learning
Jul 9, 2026Yushen Liang, Yue Peng, Baosheng Jin +6Memory-Augmented VLMs Visuomotor Policy Learning
NYU Shanghai, Shanghai, China · University of Electronic Science and Technology of China, Chengdu, China
Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation
Jul 8, 2026Hongyu Qu, Jianzhe Gao, Xiaobin Hu +6Memory-Augmented VLMs Robotic Manipulation
Nanjing University of Science and Technology · Zhejiang University · National University of Singapore
Do You Remember? Toward Memory-Centric Multimodal AI
Jul 7, 2026Xuguang Yu, Weigang Zheng, Minyue YuMemory-Augmented VLMs Multimodal Memory
NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation
Jul 7, 2026Ziye Wang, Modi Shi, Chaojun Ni +5Memory-Augmented VLMs Long-Horizon Robotic Manipulation
The University of Hong Kong · Beihang University · Peking University +2
Latent Visual Cache for Video Reasoning
Jul 1, 2026Yongheng Zhang, Zhipeng Xu, Hao Wu +4Memory-Augmented VLMs Vision-Language Models
1Tencent Youtu Lab · 2Tsinghua University · University of Illinois at Chicago
M2Note: Continual Evolution of Vision Language Models via Mistake Notebook Learning
Jul 1, 2026Haiwen Li, Jing Tang, Rui Chen +2Memory-Augmented VLMs VLM Reasoning
AMAP, Alibaba Group
ComMem: Complementary Memory Systems for Test-Time Adaptation of Vision-Language Models
Jun 27, 2026Guanglong Sun, Shuang Cui, Bo Lei +6Memory-Augmented VLMs Vision-Language Models
School of Life Sciences, IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing, China · Institute of Software Chinese Academy of Sciences, Beijing, China · 3Beijing Academy of Artificial Intelligence, Beijing, China +2
$μ$ VLA: On Recurrent Memory for Partially Observable Manipulation in VLA Models
Jun 10, 2026Egor Cherepanov, Nikita Kachaev, Daniil Zelezetsky +6Memory-Augmented VLMs Recurrent Transformers
CogAI Lab, Moscow, Russia · MIRAI, Moscow, Russia
Key-Gram: Extensible World Knowledge for Embodied Manipulation
May 18, 2026Jingjing Fan, Siyuan Li, Botao Ren +1Memory-Augmented VLMs Language-Conditioned Robot Manipulation
Department of Computer Science and Technology Tsinghua University · Department of Automation Tsinghua University
AtlasVA: Self-Evolving Visual Skill Memory for Teacher-Free VLM Agents
May 18, 2026Pan Wang, Yihao Hu, Xiujin Liu +3Memory-Augmented VLMs Reward Shaping
Ant Group · University of Science and Technology of China · Westlake University +2
MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
May 14, 2026Xiyu Ren, Zhaowei Wang, Yiming Du +11VLM Evaluation Memory-Augmented VLMs
CSE Deparment, HKUST · CUHK · OmniMemory (Shenzhen) Intelligent Technology Co., Ltd. +1
ECHO: Continuous Hierarchical Memory for Vision-Language-Action Models
May 9, 2026Yanbin Hu, Jin Cui, Jiayi Lu +6Memory-Augmented VLMs Long-Horizon Robotic Manipulation
School of Software, Xi’an Jiaotong University · State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · School of Artificial Intelligence, Xi’an Jiaotong University

Aug 2, 2026, cs.AIJ/K move · Enter open · S save

PMMC: Prospective Multimodal Memory Compilation for Long-Term LVLM Agents

Jingyu Sun, Yan Lin, Yuyang Xue, Yifan Wang+9

The University of Manchester · The University of Newcastle · The University of Edinburgh+5

Memory-Augmented VLMs Multimodal Memory Persistent Memory for Language Models Multimodal QA Long-Horizon LLM Agents Memory Consolidation

Open paper AskPDF arXiv

Long-term memory is essential for LVLM agents to maintain consistency and integrate information across extended multimodal interactions. Existing agent memory systems, however, often reduce visual experiences into textual summaries or rely on static retrieve-then-reason pipelines, which are inefficient at query time and brittle when questions require image-text binding, temporal updates, or visual details. We propose Prospective Multimodal Memory Compilation, a framework that shifts part of the memory reasoning process from query time to memory consolidation time. Given accumulated multimodal interactions, a Questioner predicts future question candidates, a Planner compiles question-conditioned multimodal memory programs, and a Doubter verifies whether the planned evidence path can support the predicted answer. The verified question-program pairs form a structured question bank for efficient query-time routing and evidence retrieval. Experiments on multimodal long-term memory benchmarks show that our method improves answer quality and visual evidence recall while reducing query-time token and latency costs. Extensive ablations analyze the effects of self-feedback, dynamic planning, raw-image access, and question bank coverage.

Momentum

Related topics

Latest papers 93