cs.CVNov 9, 2026

LO-World: Unified BEV Latent Modeling for Joint 4D Occupancy and LiDAR Forecasting

Authors: Zhimin Liao, Ping Wei, Kai Mao, Shuaijia Chen

Organizations: National Key Laboratory of Human-Machine Hybrid Augmented Intelligence Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University

Abstract

LiDAR point clouds and 3D semantic occupancy represent two distinct modalities capturing fine-grained metric geometry and dense volumetric semantics, respectively, holding natural potential for mutual complementarity. However, existing world models typically forecast these modalities independently or cascade them heuristically, missing the opportunity for reciprocal cross-modal regularization. To address this, we propose LO-World, a unified 4D world model that forecasts both modalities within a shared BEV latent space. This single-stream formulation enables dense semantics and metric geometry to mutually reinforce each other, while eliminating multi-pipeline redundancy. Specifically, LO-World couples an efficient hybrid range-voxel autoencoder with a flow-matching generator that caches historical context to reduce iterative sampling latency. Extensive experiments demonstrate that LO-World outperforms prior state-of-the-art baselines, improving occupancy forecasting IoU by 10.9% and reducing LiDAR Chamfer Distance by 30.1%. Meanwhile, it sustains a real-time throughput exceeding 2525~FPS on a single RTX 4090. Our code is available at https://github.com/lzzzzzm/LO-World.

Figures & tables

Explore similar work

CardsList
  1. GEM: Generating LiDAR World Model via Deformable Mamba

    May 8, 2026Yang Wu, Zhaojiang Liu, Qiang Meng +5MambaWorld Model Learning

  2. TriO: Tri-Modal Unsupervised Occupancy World Model for Anything Perception

    Sep 25, 2026Quinlan Sykora, Sourav Biswas, Christopher Diehl +3Unsupervised LearningAutonomous Driving Perception