Temporal Modeling for VLA Models

VLA: Vision-Language-Action

Follow this topic Ask about this topic

Latest papers

36 papers15 papers in the last four weeks, with none the four weeks before. 0.1% of all new papers.

SURE:Spatiotemporal Uncertainty Representation for Efficient Vision-Language-Action Learning
Nov 6, 2026Jingye Zhang, Choo Sin Wai, Dake Zhong +8VLA Model Training Data-Efficient Robot Learning
Tsinghua University
DobotTrack: Target-Grounded Vision-Language-Action Learning for Embodied Person Tracking
Nov 6, 2026Shengjun Deng, Yinghan Zhang, Chengrui Wei +8Multimodal Visual Object Tracking Spatial Grounding for VLA Models
Foshan University · Tsinghua University · Dobot Robotics +1
Asynchronous Robot Policies
Nov 3, 2026Sombit Dey, Luc Van Gool, Danda Pani PaudelVLMs for Robotics Closed-Loop Control of VLA Models
INSAIT, Sofia Univeristy St. Kliment Ohridski
HeLM: Hierarchical Explicit Language Memory for Non-Markovian Manipulation
Nov 2, 2026Gyeonghun Kim, Donghoon Kim, Minsoo Choi +1Memory-Augmented VLMs Vision-Language-Action Models
Seoul National University
Leap-VLA: High-Rate Robot Control from a Low-Rate VLM Backbone
Oct 31, 2026Lin Yang, Yunjie Shen, Zheyu Li +8Closed-Loop Control of VLA Models Efficient VLA Model Inference
Embodied Algorithm Group, Automation PBU, Leapmotor.
PREM: Prediction-Regulated Memory for Robot Manipulation
Oct 31, 2026Xiao Huang, Ya Zhang, Weidi XieMemory-Augmented VLMs Robotic Manipulation
School of Artificial Intelligence, Shanghai Jiao Tong University
HiFOR: Hierarchical Foresight with Action-Guided World Grounding for Vision-Language-Action Model
Oct 29, 2026Rongxing Ding, Hongyu Qu, Kehong Wu +4Vision-Language-Action Models Temporal Modeling for VLA Models
Nanjing University of Science and Technology · National University of Singapore · Shenyang Institute of Automation, Chinese Academy of Sciences +1
PRIME W0: Physical Priors from World Models for Embodied Manipulation
Oct 29, 2026Huabin Peng, Fagang Jin, Yancong Wei +4Robot Learning Robotic Manipulation
Lumos SZ Lab Team · CUHK · THU +2
SaiVLA-JEPA: Evaluating Future Latent Prediction in JEPA-Conditioned VLA Control
Oct 28, 2026Rufeng Xiao, Ruihao Xiao, Wei Chen +1Closed-Loop Control of VLA Models Temporal Modeling for VLA Models
VLA Research Team, Synthoid.ai
Variational Cognitive Memory Abstraction for Long-Horizon Vision-Language-Action Models
Oct 25, 2026Xinyu Liu, Daiying Tian, Chenwei Tang +6Memory-Augmented VLMs Temporal Modeling for VLA Models
College of Computer Science, Sichuan University, and Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education, Chengdu 610065, PR China · Institute of High Performance Computing, Agency for Science, Technology and Research (A*STAR), Singapore 138632, Singapore
TTT in VLA Models: Exploring Training with Human Demonstrations
Oct 23, 2026Qiangong Zhou, Jiafeng Liang, Yimin Dong +2VLA Model Training Vision-Language-Action Models
Standard Robots Co., Ltd.
FocusVLA: Future-Intent Guided Dynamic View Routing for Vision-Language-Action Models
Oct 22, 2026Huixin Xu, Ziya Yu, Peng LiVision-Language-Action Models Vision-Based Robot Control
Nanjing Institute of Software Technology · Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences, Nanjing +2
Memory before Goal: Role of Pre-History Memory for Humanoid Loco-Manipulation
Oct 22, 2026Chenyuan Chen, Ran Ding, Lechen Zhang +2Humanoid Loco-Manipulation Long-Term Memory for Embodied Agents
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE
GeoMem-VLA: Internalizing 3D Scene Understanding into Temporal Memory for Vision-Language-Action Models
Oct 21, 2026Qinfan Zhang, Yifan Luo, Haoyuan Shi +6Vision-Language-Action Models Vision-Based Robot Control
BUAA · X-Humanoid · RUC +3
PLaCA: Learning Patch-Level Future Latent Change for Action Generation
Oct 20, 2026Zhan Yi, Yuchen Wang, Chao Li +2Temporal Modeling for VLA Models World Models for VLA Models
School of Robotics and Automation, Nanjing University, Suzhou, Jiangsu, China
PaceVLA: Adaptive Temporal Action Quantization in Vision-Language-Action Models
Oct 19, 2026Hojin Jeon, Jimin Lee, Taekwan Kim +6Efficient VLA Model Inference Vision-Language-Action Models
KAIST · Korea University · RLWRLD +1
CondenseVLA: Learnable History Condensation for Efficient Multi-Frame VLA
Oct 19, 2026Feiyang Hong, Yujie Wei, Bo Zhao +3Vision-Language-Action Models Efficient VLA Models
Harbin Institute of Technology, Shenzhen · Harbin Institute of Technology · Shanghai Jiao Tong University +1
When Plans Change, Remember: Replanning-Guided Visual Memory for Vision-Language-Action Models
Oct 15, 2026Victoria Smelova, Daniil Kazachkov, Georgiy Kazantsev +6Memory-Augmented VLMs Vision-Language-Action Models
MIRAI · Independent Researcher · Central University +2
What Matters for World Modeling in Vision-Language-Action Models?
Oct 14, 2026Qisen Ma, Yixiang Chen, Yuan Xu +10World Models for VLA Models Temporal Modeling for VLA Models
New Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Alibaba Group +1
Temporal Forcing: 4D Representation Alignment for Vision-Language-Action Models
Aug 31, 2026Xingyu Ding, Yuzhong Zhao, Chunhai Zhao +3Representation Learning Temporal Representation Learning
Nanjing University, Nanjing, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China
StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models
Aug 26, 2026Zhe Liu, Jinghua Hou, Yuxiang Lu +7Temporal Modeling for VLA Models Vision-Language-Action Models
The University of Hong Kong · ACE Robotics
Explicit Language Memory for Long-Horizon Planning in Vision-Language-Action Models
Aug 5, 2026Houze Xu, Jizhong Li, Ziyi YeMemory-Augmented VLMs Vision-Language-Action Models
Fudan University
FibVLA: An Efficient Temporal Vision-Language-Action Model with Fibonacci Sampling
Jul 31, 2026Li Lin, Wujun Xu, Weiwei Meng +3Temporal Modeling for VLA Models Efficient VLA Model Inference
Southeast University, Nanjing, Jiangsu, China · Nanyang Technological University, Singapore.
TS-Mask VLA: 2D Temporal-Spatial Masking for Vision-Language-Action Model with Effective Bridging
Jul 10, 2026Shengzhuo Yang, Ronghao Yu, Chuanjie Lv +5Vision-Language-Action Models Robot Motion Generation
Institute of Cyber-Systems and Control, Zhejiang University, Hangzhou, China
Dual Latent Memory in Vision-Language-Action Models for Robotic Manipulation
Jul 8, 2026Hongyu Qu, Jianzhe Gao, Xiaobin Hu +6Memory-Augmented VLMs Robotic Manipulation
Nanjing University of Science and Technology · Zhejiang University · National University of Singapore
Present but Not Remembered: Auditing How Frozen VLAs Encode, Deploy, and Steer Visual History
Jul 3, 2026Chih-Ting Liao, Xin CaoTemporal Modeling for VLA Models VLM Interpretability
University of New South Wales
MIRTH: Mutual-Information Reasoning with Temporal Hubs for Vision-Language-Action Agents
Jun 30, 2026Hao Sun, Yu Song, Shiyu Teng +2Temporal Modeling for VLA Models Vision-Language-Action Models
College of Information Science and Engineering, Ritsumeikan University, Japan · College of Computer Science and Technology, Zhejiang University, China
DAM-VLA: Decoupled Asynchronous Multimodal Vision Language Action model
Jun 10, 2026Pankhuri Vanjani, Zhuoyue Li, Jakub Suliga +4Robotic Manipulation Multimodal Sensor Fusion
Intuitive Robots Lab, Karlsruhe Institute of Technology (KIT), Germany · NVIDIA · Robotics Institute of Germany
MemoryVLA++: Temporal Modeling via Memory and Imagination in Vision-Language-Action Models
Jun 8, 2026Hao Shi, Weiye Li, Bin Xie +6Long-Horizon Robotic Manipulation World Models for Robotics
Department of Automation, BNRist, Tsinghua University, Beijing, China · Department of Computer Science, The University of Hong Kong, Hong Kong, China · Dexmal, Beijing, China +1
MotionVLA: Injecting Geometric Motion into Vision-Language-Action Model
Jun 6, 2026Shanglin Yuan, Weiheng Zhao, Xianda Guo +4Long-Horizon Robotic Manipulation Visuomotor Policy Learning
Huazhong University of Science and Technology · D-Robotics · Wuhan University

Nov 6, 2026J/K move · Enter open · S save

SURE:Spatiotemporal Uncertainty Representation for Efficient Vision-Language-Action Learning

Jingye Zhang, Choo Sin Wai, Dake Zhong, Zhifang Liu+7

Tsinghua University

VLA Model Training Data-Efficient Robot Learning Uncertainty Estimation for VLA Models Temporal Modeling for VLA Models

Open paper AskPDF arXiv

Vision-language-action (VLA) policies have become a promising paradigm for end-to-end robot control, but their effectiveness still depends heavily on large volumes of demonstration data. In manipulation tasks, this dependence is compounded by structured spatiotemporal uncertainty in the action space: multiple nearby actions or trajectories may successfully solve the same task, while semantically equivalent demonstrations often unfold at different speeds. Standard pointwise supervision treats each demonstrated action as an exact target, imposing an unnecessary learning burden under such uncertainty. We present SURE, a data-efficient VLA training framework that explicitly models both spatial and temporal uncertainty. SURE augments a VLA backbone with a lightweight transposed-convolutional probabilistic action decoder that captures spatial uncertainty through local correlations among neighboring action bins. It further introduces Soft-DTW alignment supervision to accommodate local timing variations between predicted and demonstrated action chunks. Together, these two components reduce sensitivity to demonstrator-specific poses and execution timing, enabling more data-efficient action learning. We evaluate SURE on LIBERO, RoboTwin 2.0, and real-world manipulation tasks. Even with only 10% of the demonstration data or 20% of the training steps, SURE achieves manipulation success rates that match or surpass baseline VLAs.