Memory-Augmented VLMs

VLM: Vision-Language Model

Follow this topic Ask about this topic

Momentum

30 papers in the last four weeks, up 150% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 90

All topics

MemVLN: Episodic and Procedural Memory for Vision-and-Language Navigation
Jul 26, 2026Yuqi Liu, Shengju Qian, Tianyuan Qu +5Memory-Augmented VLMs Efficient VLM Inference
1The Chinese University of Hong Kong · 2LIGHTSPEED · 3The University of Hong Kong +1
Memory-Augmented Multimodal Large Language Models for Small Object Understanding in Streaming Aerial Videos
Jul 22, 2026Penglei Sun, Yehua Huang, Zhuoli Tao +8Memory-Augmented VLMs Aerial Robotics
Information Hub, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · University of Freiburg, Freiburg, German · Hangzhou City University, Hangzhou, China +3
ChronoStitch: Training-Free Composition of Visual KV Memories for Long-Horizon Temporal Reasoning
Jul 21, 2026Santiram Tiwari, Nishant Sinha, Kunal KislayMemory-Augmented VLMs KV Caching
KGraph AI Solutions Pvt. Ltd., Bangalore, India – 560016
FM-VLA: Force-based Memory for Vision-Language-Action Models in Contact-Rich Manipulation
Jul 20, 2026Ruicheng Li, Qixiu Li, Ruichun Ma +8Memory-Augmented VLMs Language-Conditioned Robot Manipulation
Tsinghua University · Microsoft Research · Fudan University +1
VLN-AVP: Zero-Shot Vision-Language Navigation with Hybrid Long-Short-Term Memory for Autonomous Valet Parking
Jul 20, 2026Yijian Li, Xiangru Mu, Changze Li +7Memory-Augmented VLMs Autonomous Parking
Shanghai Jiao Tong University, Shanghai, China · Yinwang Intelligent Technology Co., Ltd.
Memory-Supported Synergistic Adaptation for Training-Free Test-Time Medical Image Segmentation
Jul 20, 2026Lingrui Li, Nan Pu, Dong Zhao +4Memory-Augmented VLMs VLM Adaptation
School of Computer Science, University of Nottingham, UK · School of Computer Science and Information Engineering, Hefei University of Technology, China · Information Systems Technology and Design Pillar, Singapore University of Technology and Design, Singapore
ConsiSpace: Learning Geometric Consistency Matters for Video Spatial Reasoning
Jul 20, 2026Ting Huang, Zhenyu Zhang, Wenyuan Huang +2Memory-Augmented VLMs Visual Spatial Reasoning
School of Computer Science, Peking University, Beijing, China · School of Intelligent Science and Technology, Nanjing University, Nanjing, China · Beijing Academy of Artificial Intelligence, Beijing, China
VTM-Nav: Hierarchical Visual-Topological Memory for Cross-Episode Object-Goal Navigation
Jul 16, 2026Xiaoran Xu, Yupeng Wu, Tianyu Xue +4Memory-Augmented VLMs Robot Navigation
MAIS, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing, China · Tsinghua University, Beijing, China +1
FOLIO: Focused Semantic Memory for Streaming Video Understanding
Jul 14, 2026Haoyang Fan, Dhruv Parikh, Anvitha Ramachandran +4Memory-Augmented VLMs Streaming Video Understanding
University of Southern California (USC), Los Angeles, CA, USA · Intel Labs, USA · DEVCOM Army Research Office
StoryTeller: Training-Free Narrative Grounding for Long-Form Audio Description
Jul 13, 2026Seung Hyun Hahm, Minh T. Dinh, SouYoung JinMemory-Augmented VLMs Video-Language Models
Dartmouth College, USA
Parse, Search, and Confirmation: Training-Free Aerial Vision-and-Dialog Navigation with Chain-of-Thought Reasoning and Structured Spatial Memory
Jul 13, 2026Yu Qi, Hongyu Li, Shaofei Huang +6Memory-Augmented VLMs UAV Navigation
School of Computer Science and Information Engineering, Hefei University of Technology · School of Artificial Intelligence, Beihang University · University of Macau +2
SLVMBench: Skill Learning from Video Memory
Jul 13, 2026Yudong Yang, Guangzhi Sun, Yixuan Li +1Memory-Augmented VLMs Video-Language Models
Tsinghua University · University of Cambridge
PhysMRV: Physical Memory Retrieval and Verification for Physics Plausibility Reasoning
Jul 11, 2026Wenyuan Wang, Lianyu Hu, Hao Wang +1Memory-Augmented VLMs Physical Reasoning
1Nanyang Technological University · 2Rutgers University · University of Illinois Urbana-Champaign
Memory-Conditioned Tool Calling for Camera-First Visual Agents
Jul 10, 2026Xiaofan Wu, Xi Zeng, Miaoxia Chen +5Memory-Augmented VLMs Tool-Using Vision-Language Agents
Chance AI
TFP: Temporally Conditioned Memory-Fusion Policies for Visuomotor Learning
Jul 9, 2026Yushen Liang, Yue Peng, Baosheng Jin +6Memory-Augmented VLMs Visuomotor Policy Learning
NYU Shanghai, Shanghai, China · University of Electronic Science and Technology of China, Chengdu, China
Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation
Jul 8, 2026Hongyu Qu, Jianzhe Gao, Xiaobin Hu +6Memory-Augmented VLMs Robotic Manipulation
Nanjing University of Science and Technology · Zhejiang University · National University of Singapore
Do You Remember? Toward Memory-Centric Multimodal AI
Jul 7, 2026Xuguang Yu, Weigang Zheng, Minyue YuMemory-Augmented VLMs Multimodal Memory
NativeMEM: Native Memory Compression for Long-Horizon Robotic Manipulation
Jul 7, 2026Ziye Wang, Modi Shi, Chaojun Ni +5Memory-Augmented VLMs Long-Horizon Robotic Manipulation
The University of Hong Kong · Beihang University · Peking University +2
Latent Visual Cache for Video Reasoning
Jul 1, 2026Yongheng Zhang, Zhipeng Xu, Hao Wu +4Memory-Augmented VLMs Vision-Language Models
1Tencent Youtu Lab · 2Tsinghua University · University of Illinois at Chicago
M2Note: Continual Evolution of Vision Language Models via Mistake Notebook Learning
Jul 1, 2026Haiwen Li, Jing Tang, Rui Chen +2Memory-Augmented VLMs VLM Reasoning
AMAP, Alibaba Group
ComMem: Complementary Memory Systems for Test-Time Adaptation of Vision-Language Models
Jun 27, 2026Guanglong Sun, Shuang Cui, Bo Lei +6Memory-Augmented VLMs Vision-Language Models
School of Life Sciences, IDG/McGovern Institute for Brain Research, Tsinghua University, Beijing, China · Institute of Software Chinese Academy of Sciences, Beijing, China · 3Beijing Academy of Artificial Intelligence, Beijing, China +2
$μ$ VLA: On Recurrent Memory for Partially Observable Manipulation in VLA Models
Jun 10, 2026Egor Cherepanov, Nikita Kachaev, Daniil Zelezetsky +6Memory-Augmented VLMs Recurrent Transformers
CogAI Lab, Moscow, Russia · MIRAI, Moscow, Russia
Key-Gram: Extensible World Knowledge for Embodied Manipulation
May 18, 2026Jingjing Fan, Siyuan Li, Botao Ren +1Memory-Augmented VLMs Language-Conditioned Robot Manipulation
Department of Computer Science and Technology Tsinghua University · Department of Automation Tsinghua University
AtlasVA: Self-Evolving Visual Skill Memory for Teacher-Free VLM Agents
May 18, 2026Pan Wang, Yihao Hu, Xiujin Liu +3Memory-Augmented VLMs Reward Shaping
Ant Group · University of Science and Technology of China · Westlake University +2
MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
May 14, 2026Xiyu Ren, Zhaowei Wang, Yiming Du +11VLM Evaluation Memory-Augmented VLMs
CSE Deparment, HKUST · CUHK · OmniMemory (Shenzhen) Intelligent Technology Co., Ltd. +1
ECHO: Continuous Hierarchical Memory for Vision-Language-Action Models
May 9, 2026Yanbin Hu, Jin Cui, Jiayi Lu +6Memory-Augmented VLMs Long-Horizon Robotic Manipulation
School of Software, Xi’an Jiaotong University · State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · School of Artificial Intelligence, Xi’an Jiaotong University
Persistent Visual Memory: Sustaining Perception for Deep Generation in LVLMs
May 1, 2026Siyuan Huang, Xiaoye Qu, Yafu Li +6Memory-Augmented VLMs VLM Robustness
Shanghai AI Laboratory · Shanghai Jiao Tong University · The Chinese University of Hong Kong +3
ME-IQA: Memory-Enhanced Image Quality Assessment via Re-Ranking
Mar 21, 2026Kanglong Fan, Tianhe Wu, Wen Wen +6Memory-Augmented VLMs Vision-Language Models
City University of Hong Kong, Hong Kong SAR, China · ByteDance Inc., China
Vision-Language Memory for Spatial Reasoning
Nov 25, 2025Zuntao Liu, Yi Du, Taimeng Fu +3Memory-Augmented VLMs Vision-Language Models
Spatial AI & Robotics (SAIR) Lab, University at Buffalo, USA · Stanford University, USA
StreamTTT: Reconciling Real-Time Perception and Long-Term Memory in Streaming VLMs
Date pendingJoya Chen, Zeyun Zhong, Mike Zheng ShouMemory-Augmented VLMs Streaming Video Understanding
National University of Singapore · Karlsruhe Institute of Technology

Jul 26, 2026, cs.CVJ/K move · Enter open · S save

MemVLN: Episodic and Procedural Memory for Vision-and-Language Navigation

Yuqi Liu, Shengju Qian, Tianyuan Qu, Mingxian Lin+4

1The Chinese University of Hong Kong · 2LIGHTSPEED · 3The University of Hong Kong+1

Memory-Augmented VLMs Efficient VLM Inference Efficient VLA Models Vision-Language Navigation

Open paper AskPDF arXiv

Vision-and-Language Navigation in Continuous Environments (VLN-CE) requires agents to maintain long-horizon visual history for trajectory consistency while executing actions with low latency. Existing video-based VLN approaches typically struggle to satisfy both demands simultaneously. To address these challenges, we propose MemVLN, a novel VLN framework that achieves state-of-the-art performance with real-time inference efficiency (14 FPS). MemVLN utilizes a visual encoder to process continuous observations and a Large Language Model (LLM) to interpret instructions and generate actions. Central to our approach is an Episodic Memory management that applies pyramidal resolutions. This mechanism concentrates computation on immediate percepts while retaining compressed long-term history. Complementing to this design, we introduce Procedural Memory for fast action with a compact vocabulary of atomic mid-level actions to bypass auto-regressive decoding latency. Experiments on VLN-CE show that MemVLN-4B surpasses the baseline Qwen3-VL-4B architecture by 5.8% SR in R2R and 9.7% SR in RxR, while achieving a 7

\times

speedup in inference latency.

Momentum

Related topics

Latest papers 90