cs.RONov 19, 2026

PhysVAM: Physics-oriented Future Value Action Model for Dynamic Object Manipulation

Authors: Yuxiang Yang, Jingbo Zhang, Jiaru Zhong, Junliang Chen, Yirui Zhou, Guangming Wang, Haitao Lin, Huaiyuan Xu, 

Organizations: Hong Kong Polytechnic University · Robotics X, Tencent · University of Cambridge

Abstract

Predicting future scene or object states does not necessarily reveal how robot-object interactions will advance or hinder a task. This challenge is particularly pronounced in dynamic robotic manipulation, where objects continue moving during perception and execution. Effective action generation therefore requires not only modeling object dynamics but also anticipating how future interactions will shape task progress. To this end, we propose PhysVAM, a Physics-oriented Future Value Action Model that represents anticipated interactions through their effects on future task progress. This value-based formulation provides task-directed foresight without reconstructing future visual states. Conditioned on current observations and historical object and robot motion, PhysVAM jointly learns action generation and multi-horizon future-value prediction. The value branch learns horizon-specific latent representations through future task-value prediction from successful and failed trajectories. These future-value representations are integrated into the action policy through gated cross-attention, guiding action generation toward interactions that facilitate task success. Extensive simulation and real-world experiments demonstrate superior task success, with absolute success-rate improvements of 27.0 and 27.5 percentage points over the strongest baselines in simulation and real-world tasks, respectively. Project page: https://metarobo.github.io/physvam.github.io/.

Figures & tables

Explore similar work

CardsList
  1. HiFOR: Hierarchical Foresight with Action-Guided World Grounding for Vision-Language-Action Model

    Oct 29, 2026Rongxing Ding, Hongyu Qu, Kehong Wu +4Vision-Language-Action ModelsTemporal Modeling for VLAs

  2. ForeAct3D: Policy-Grounded Future World Modeling for VLA Policies

    Oct 3, 2026Zhe Tao, Feiran Wang, Gaowen Liu +2World Models for RoboticsVision-Language-Action Models

  3. TrajWAM: An Efficient Trajectory-Guided World Action Model for Dynamic Robotic Manipulation

    Oct 19, 2026Haohan Geng, Sha Zhang, Weishuo Sun +7Dynamic Robotic ManipulationWorld Action Models