cs.CVMar 26, 2026

LaMP: Learning Vision-Language-Action Policy with 3D Scene Flow as Latent Motion Prior

Authors: Xinkai WangChenyi WangYifu XuMingzhe YeFucheng ZhangJialin TianXinyu ZhanLifeng Zhu+2 more

Organizations: Southeast University, China · Shanghai Innovation Institute, China · Shanghai Jiao Tong University, China · Noematrix, China

Abstract

We introduce \textbf{LaMP}, a dual-expert Vision-Language-Action framework that embeds dense 3D scene flow as a latent motion prior for robotic manipulation.Existing VLA models regress actions directly from 2D semantic visual features, forcing them to learn complex 3D physical interactions implicitly.This implicit learning strategy degrades under unfamiliar spatial dynamics.LaMP addresses this limitation by aligning a flow-matching \emph{Motion Expert} with a policy-predicting \emph{Action Expert} through gated cross-attention.Specifically, the Motion Expert generates a one-step partially denoised 3D scene flow, and its hidden states condition the Action Expert without full multi-step reconstruction.We evaluate LaMP on the LIBERO, LIBERO-Plus, and SimplerEnv-WidowX simulation benchmarks as well as real-world experiments.LaMP consistently outperforms evaluated VLA baselines across LIBERO, LIBERO-Plus, and SimplerEnv-WidowX benchmarks, achieving the highest reported average success rates under the same training budgets. On LIBERO-Plus OOD perturbations, LaMP shows improved robustness with an average 9.7% gain over the strongest prior baseline.Our project page is available at https://summerwxk.github.io/lamp-project-page/.

Explore similar work

CardsList
  1. GeomVLA: Unifying Scene, Motion, and Action in 3D

    Sep 12, 2026Ziyin Xiong, Nikolaos Gkanatsios, Moritz Reuss +13D MotionPerception-Action Loop