cs.ROOct 16, 2026

Unifying Embodied Foundation Models via a Model-to-Policy Formulation

Authors: Xinyi Hong, Mingyang Ren

Organizations: Department of Statistics, School of Mathematical Sciences, Shanghai Jiao Tong University

Abstract

Vision-language-action (VLA) models and world-action models (WAMs) have emerged as promising approaches to robot learning and control. These models integrate multimodal perception and action generation, but differ in their architectures, output representations, and learning objectives. In this paper, we present a unified, architecture-agnostic probabilistic formulation for embodied foundation models based on stochastic kernels. Our formulation has two key components: (i) we characterize embodied foundation models through conditional output distributions and action-realization kernels, which together induce task-conditioned robot policies; and (ii) we connect pretraining and post-training to policy deployment, accommodating model-specific pretraining objectives and offline or online post-training strategies. We instantiate the formulation for OpenVLA and DreamZero, covering autoregressive action-token prediction and joint video-action generation.

Explore similar work

CardsList
  1. VLA-Forget: Vision-Language-Action Unlearning for Embodied Foundation Models

    Apr 5, 2026Ravi Ranjan, Agoritsa PolyzouVLM UnlearningVision-Language-Action Models

  2. World Action Models: The Next Frontier in Embodied AI

    May 12, 2026Siyin Wang, Junhao Shi, Zhaoyang Fu +11Vision-Language-Action ModelsWorld Action Models