Hierarchical World Models

Follow this topic Ask about this topic

Latest papers

11 papers4 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

WorldStream: Streaming Interactive 3D Worlds with Hierarchical Planning and Persistent State
Oct 20, 2026Xiaoxiao Ma, Weiyang Jin, Yanwen Ma +11Interactive World Models 3D Scene Generation
University of Science and Technology of China · Joy Future Academy, JD
Learning Goal-Conditioned Subgoals through Frozen Hierarchical World Models
Oct 19, 2026Xiang Kaibo, Liu QingfengHierarchical World Models World Model-Based Planning
Department of Industrial and Systems Engineering, Hosei University
MHWA: Multi-timescale Hierarchical World-Action Model
Oct 10, 2026Pengcheng Pan, Guoqing Ma, Yuhan Zhang +4Hierarchical World Models World Model Learning
Laboratory of Brain Atlas and Brain-inspired Intelligence, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China · State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Institute of Automation, Chinese Academy of Sciences, Beijing, China +1
H-JEPA: End-to-End Learning of Hierarchical World Models for Visual Planning
Oct 5, 2026Wancong Zhang, Basile Terver, Michael Rabbat +2World Models for Robotics World Models
NYU · Advanced Machine Intelligence · INRIA Paris +1
Drive-HWM: Hierarchical World Models for Dynamic-Latent Guided Autonomous Driving
Sep 3, 2026Zhaoxin Fan, Tianbao Zhang, Wenjun Wu +5World Models Hierarchical World Models
School of Artificial Intelligence, Beihang University, Beijing, China · Shanghai Jiao Tong University, Shanghai, China · Dim12 AI +3
Orbis 2: A Hierarchical World Model for Driving
Jul 17, 2026Sudhanshu Mittal, Arian Mousakhan, Silvio Galesso +4World Models Hierarchical World Models
University of Freiburg, Germany
Mind the Gap: Promises and Pitfalls of Hierarchical Planning in LeWorldModel
Jul 14, 2026Niccolò Caselli, Francesco Massafra, Samuele Punzo +3Hierarchical Planning Long-Horizon Robotic Manipulation
University of Amsterdam
Self-supervised Hierarchical Visual Reasoning with World Model
May 17, 2026Yuanfei Xu, Lin Liu, Wengang Zhou +2World Model Learning World Models
Department of Electronic Engineering and Information Science, University of Science and Technology of China, Hefei, Anhui, China
Hierarchical Planning with Latent World Models
Apr 3, 2026Wancong Zhang, Basile Terver, Artem Zholus +7Hierarchical Planning Hierarchical Robot Control
FAIR at Meta · New York University · Mila - Québec AI Institute +1
HCLSM: Hierarchical Causal Latent State Machines for Object-Centric World Modeling
Mar 31, 2026Jaber Jaber, Osama JaberHierarchical World Models World Models
RightNow AI
H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Model
Feb 11, 2026Jinbang Huang, Wenyuan Chen, Zhiyuan Li +9Long-Horizon Robotic Manipulation World Models for Robotics
Huawei Noah’s Ark Lab · University of Toronto · University of British Columbia +1

Oct 20, 2026J/K move · Enter open · S save

WorldStream: Streaming Interactive 3D Worlds with Hierarchical Planning and Persistent State

Xiaoxiao Ma, Weiyang Jin, Yanwen Ma, Haoran Li+10

University of Science and Technology of China · Joy Future Academy, JD

Interactive World Models 3D Scene Generation World Model-Based Planning Hierarchical World Models Hierarchical Planning

Open paper AskPDF arXiv

We present WorldStream, an open-ended 3D world model with three simultaneous capabilities: it extends playable terrain beyond any pre-specified map, acts on open-ended language in the running world, and restores visited places with their edits. A hierarchical planner over a typed decision model emits structured decision state: Macro fixes settlement, ecology, transport, and hydrological structure across a group of tiles; Micro specializes that contract into tile semantics under measured terrain and accepted neighbor commitments. Deterministic local code compiles accepted plans into terrain, roads, settlements, vegetation, and entities. Streaming separates their reach: plans run ahead along the predicted corridor, compilation only where movement will soon need it, geometry behind the user released. One world record retains plans, seeds, object identities and mutable state, boundary commitments, and edits by attribute, revised as the user advances and edits; returning tiles recompile from it. The same record grounds interaction: the model acts on existing entities, including stateful NPCs that update as they act, edits the present region, or attaches intent to unplanned regions. Together they yield a world expanding under bounded budgets, connected across independently planned tiles, and interactive.