cs.ROOct 12, 2026

D-World: An Explicit World-Language-Action Model with Recursive Self-Improvement under Dual Control

Authors: Xuan Wen, Baichao Wang

Organizations: Geek+

Abstract

Frontier large language models (LLMs) now reason about space well enough to program robots, yet the world models behind robot policies are implicit, held in network weights or predicted video, and cannot be inspected or corrected directly. We present D-World, an explicit world-language-action model built on the Sense, Plan and Act decomposition. A perception agent writes the scene as an executable digital twin using generated vision and geometry code. A planning agent searches for actions in simulation and, after each executed action chunk, revises the twin's object states and named physical parameters against what the robot measured. A parameter revision is accepted only if replaying the latest chunk does not increase any measured residual beyond its tolerance, and every chunk is checked in the updated twin before it runs. Structural mismatches return to perception for reconstruction. We call this measurement-grounded cycle of correction and revision recursive self-improvement (RSI), in which the LLM stays frozen while the world it acts in improves. We model the choice of actions that both advance the task and expose model error as a dual control problem and show that the cost of incorporating evidence into the twin sets the threshold at which probing pays, so cheap local revision counteracts the turn-off of cautious controllers. Each episode runs a real-to-sim-to-real loop, and its recorded twins can be refitted and re-rendered offline into higher-fidelity environments for post-training. Because perception and planning communicate only through the twin and language, either can be replaced by a learned model, and since inference dominates the loop, the loop speeds up with faster models. On a dual-arm robot, towel and toaster tasks show local revisions, such as one reducing the bread's rendered-depth residual from 22.4 to 1.5 mm, that let execution continue without reconstruction.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. WorldSample: Closed-loop Real-robot RL with World Modelling

    Jul 2, 2026Yuquan Xue, Le Xu, Zeyi Liu +5Robot Skill LearningWorld Models for Robotics

  2. Semantic World Models

    Oct 22, 2025Jacob Berg, Chuning Zhu, Yanda Bao +2World Models for RoboticsWorld Model-Based Planning

  3. Hi-WM: Human-in-the-World-Model for Scalable Robot Post-Training

    Apr 23, 2026Yaxuan Li, Zhongyi Zhou, Yefei Chen +5Robot Policy LearningRobot Policy Adaptation