cs.LGNov 9, 2026

ΣΣ-LeWM: Learning World Models via S-Information for Robot Control

Authors: Xinrui Zu, Michael Przystupa, Zhao Yang, Shujian Yu, Kevin Sebastian Luck

Organizations: Vrije Universiteit Amsterdam, The Netherlands

Abstract

World models have increasingly been applied as a model-based control method for robotics tasks such as manipulation and locomotion. While early world model architectures relied on decoders to prevent mode collapse and learn a predictable latent space, recent works on world models, such as Joint Embedding Predictive Architecture or LeWorldModel, increasingly aim to learn embeddings without a grounding decoder, utilising only a latent forward dynamics predictor and a stabilising entropy term. In this paper, we set out to demonstrate that the further introduction of two additional latent losses to LeWorldModel, a backward dynamics predictor and an inverse dynamics action predictor, enforces further structure on the latent embedding, leading to further gains in both performance and planning efficiency. These are critical properties for improving the applicability of such methods to real-time model-based control of real-world robots. We demonstrate these gains on standard world model benchmarks and two simulated robot manipulation tasks.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LeWorldModel: Stable End-to-End Joint-Embedding Predictive Architecture from Pixels

    Mar 13, 2026Lucas Maes, Quentin Le Lidec, Damien Scieur +2World Model LearningJoint-Embedding Predictive Architecture

  2. Adaptive Latent Capacity for World Models

    Sep 26, 2026Idan Achituve, Lior Dikstein, Idit Diamant +2World Model LearningLatent Dynamics Modeling

  3. Sensorimotor World Models: Perception for Action via Inverse Dynamics

    Jun 18, 2026Petr Ivashkov, Randall Balestriero, Bernhard SchölkopfRepresentation LearningWorld Model-Based Planning