cs.AINov 19, 2026

LoongForge-Embodied: A Unified Framework for Training Heterogeneous Embodied Models

Authors: LoongForge Team

Organizations: Baidu, Inc.

Abstract

Training Vision-Language-Action (VLA) models and World-Action Models (WAMs) is computationally expensive, while their heterogeneous architectures and fragmented training stacks make system optimizations difficult to reuse across models. To address these challenges, we present LoongForge-Embodied, a native-PyTorch framework that unifies and accelerates the training of heterogeneous embodied models. At its core, LoongForge-Embodied introduces a common abstraction layer that decouples model-specific implementations from shared training infrastructure, enabling cross-model reuse without constraining individual architectures or execution requirements. Buildingon this unified infrastructure, the framework combines reusable acceleration mechanisms with model-specific and hardware-aware optimization strategies across computation, execution, memory, data I/O, and distributed communication, including FP8-based communication optimizations for DDP and FSDP. Beyond training acceleration, LoongForge-Embodied integrates a unified data infrastructure with a pipeline for synthesizing robot data from egocentric data, and an efficient evaluation framework that supports concurrency and optimized computation in simulator. Experiments across representative VLA and WAM models demonstrate 1.47x-4.38x end-to-end training throughput improvements over their corresponding open-source baselines, as well as 4.1x-23.2x faster evaluation under the same protocols.

Figures & tables

Appendix figures & tables23 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. ForgeVLA: Federated Vision-Language-Action Learning without Language Annotations

    May 8, 2026Yuhao Zhou, Yunpeng Zhu, Yang Zhou +7Vision-Language ModelsEfficient VLAs

  2. FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence

    Sep 15, 2026Yinhao Li, Weixin Mao, Zihan Lan +22Vision-Language-Action ModelsRobot Learning