cs.ROAug 26, 2026

ConfAL-WM: Confidence-Guided Active Learning for Action-Conditioned World Models

Authors: Xiang Liu, Kunwei Wu, Miao Liu, Sen Cui, Changshui Zhang

Organizations: Tsinghua University · National University of Singapore

Abstract

Action-conditioned world models have become an important foundation for embodied prediction, planning, and synthetic data generation, but their errors under new task and scene distributions are often concentrated in localized spatiotemporal regions such as robot arms, manipulated objects, contact areas, and occluded objects. This paper presents ConfAL-WM, a confidence-guided active learning framework for post-training embodied world models. Building upon EnerVerse-AC (EVAC), we attach a lightweight confidence probe to UNet decoder features and predict dense confidence maps in the latent space. These maps are aggregated into task-, frame-, and patch-level scores, enabling data-budget allocation and localized training enhancement. Our pipeline trains the probe and warms up EVAC on a small target-domain subset. EVAC-v1 then supplies task-level acquisition and optional frame/patch weighting signals; all selected-data models are initialized from the original pretrained EVAC checkpoint for retraining. Experiments on RoboTwin2.0 at the default 40% data budget show that confidence-guided selection improves post-training quality, while dense frame and patch weighting offers complementary reconstruction and semantic gains compared with scalar reward, progress, and judge-based scoring baselines. A quick visual overview of this work is available at https://ConfAL-WM.github.io.

Figures & tables

Appendix figures & tables39 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Causally Debiased Latent Action Model for Embodied Action Conditioned World Models

    Jul 10, 2026Yufan Wei, Kun Zhou, Lingjun Mao +9Latent Action LearningCausal Representation Learning

  2. Cross-Embodiment Robot Foundation World Models with Latent Actions

    Oct 7, 2026Huang Huang, Sriram Yenamandra, Arjun Majumdar +9World Models for RoboticsAction-Conditioned World Models

  3. World-Action Models for Robot Learning and Control: A Survey

    Sep 13, 2026Zuxing Lu, Hongjia Zhai, Guanzhi Wang +13World Action ModelsAction-Conditioned World Models