CrossLiDAR: Controllable Multi-Sensor LiDAR Sequence Generation
Organizations: Computer Vision Center, Universitat Aut`onoma de Barcelona, Spain · Independent Researcher · University of the Basque Country, Spain
Abstract
High-fidelity LiDAR simulation remains a bottleneck for scalable development and validation of autonomous systems. Existing generators can synthesize realistic scans, but they are typically constrained to a single sensor configuration, offer limited control over structure and geometry, and drift in long-horizon 4D generation. We present CrossLiDAR, a unified transformer-based framework capable of generating controllable and spatio-temporally consistent multi-sensor LiDAR sequences. Our approach leverages a rectified flow objective with a Multi-Modal Diffusion Transformer (MM-DiT) backbone, within a compact latent space of range images. To support multiple LiDAR sensors, an Inter-sensor Module enables interaction across sensors, while a ControlNet-style branch provides structural conditioning (e.g., BEV priors or 3D bounding boxes). For modeling the temporal consistency, CrossLiDAR generates short -frame sequences and extends them autoregressively to improve long-horizon coherence. Our model significantly outperforms state-of-the-art baselines, achieving an average improvement of 29.56% in JSD and 15.36% in MMD evaluated on nuScenes and the Waymo Dataset. CrossLiDAR bridges the gap to modern autonomous-driving simulation by enabling calibration-consistent multi-sensor LiDAR rollouts over long horizons for controllable, scenario-based testing.
Figures & tables
| Method | Venue | Range | Points | BEV | |||
| FRD | MMD | FPD | MMD | JSD | MMD | ||
| Voxel | |||||||
| OpenDWM [ 36 ] | CVPR’25 | — | — | 7.55 | 52.23 | 16.25 | 2.29 |
| OpenDWM-DiT [ 46 ] | CVPR’25 | — | — | 8.41 | 105.40 | 10.85 | 1.80 |
| Range | |||||||
| LiDM [ 41 ] | CVPR’24 | 2.29 | 148.83 | 4.67 | 65.76 | 19.34 | 1.00 |
| Method | Venue | Range | Points | BEV | |||
| FRD | MMD | FPD | MMD | JSD | MMD | ||
| Voxel | |||||||
| UniScene [ 19 ] | CVPR’25 | — | — | — | — | 31.55 | 13.61 |
| OpenDWM [ 36 ] | CVPR’25 | — | — | 0.95 | 5.43 | 20.17 | 5.61 |
| OpenDWM-DiT [ 46 ] | CVPR’25 | — | — | 0.49 | 0.50 | 19.90 | 5.73 |
| Range | |||||||
| Method | Venue | TTCE | CTC | Rollout | ||||||
| 1 | 2 | 1 | 2 | 3 | 4 | CD | JSD | MMD | ||
| Voxel | ||||||||||
| OpenDWM [ 36 ] (t=5) | CVPR’25 | 990.17 | 990.74 | 0.37 | 0.52 | 0.65 | 0.68 | 2.81 | 0.53 | 0.57 |
| OpenDWM-DiT [ 46 ] (t=5) | CVPR’25 | 1025.78 | 1026.43 | 0.39 | 0.59 | 0.76 | 0.81 | 0.78 | 0.13 | 0.34 |
| Range-Temporal | ||||||||||
| LiDM [ 41 ] (t=3) | CVPR’24 | 1444.74 | 1444.48 | 0.20 | 0.24 | — | — | 0.53 | 0.52 | 1.81 |
| Method | Venue | TTCE | CTC | Rollout | ||||||
| 3 | 4 | 1 | 2 | 3 | 4 | CD | JSD | MMD | ||
| Voxel | ||||||||||
| UniScene [ 19 ] | CVPR’25 | 2.74 | 3.69 | 0.90 | 1.84 | 3.64 | 3.90 | — | — | — |
| OpenDWM [ 36 ] | CVPR’25 | 2.68 | 3.65 | 1.02 | 2.02 | 3.37 | 5.05 | 1.20 | 0.17 | 9.99 |
| OpenDWM-DiT [ 46 ] | CVPR’25 | 2.71 | 3.66 | 0.89 | 1.79 | 3.06 | 4.64 | 0.68 | 0.17 | 8.80 |
| Range-Temporal | ||||||||||
| Method | Venue | TTCE | CTC | Rollout | Motion | |||||||
| 3 | 4 | 1 | 2 | 3 | 4 | CD | JSD | MMD | BVC | FVD | ||
| OpenDWM [ 36 ] (t=12) | CVPR’25 | 471.34 | 471.40 | 0.42 | 0.55 | 0.66 | 0.73 | 0.11 | 0.38 | 0.17 | — | — |
| OpenDWM-DiT [ 46 ] (t=12) | CVPR’25 | 424.65 | 424.86 | 2.07 | 2.63 | 2.81 | 3.17 | 0.07 | 0.37 | 0.14 | — | — |
| CrossLiDAR | — | 369.63 | 369.74 | 0.05 | 0.07 | 0.08 | 0.09 | 0.07 | 0.12 | 0.02 | 0.79 | 57.42 |
| Method | Venue | TTCE | CTC | Rollout | Motion | ||||||||
| 3 | 4 | 1 | 2 | 3 | 4 | CD | JSD | MMD | BVC | FVD | FVMD | ||
| UniScene [ 19 ] (t=5) | CVPR’25 | 2.74 | 3.69 | 0.90 | 1.84 | 3.64 | 3.90 | — | — | — | — | — | — |
| OpenDWM [ 36 ] (t=16) | CVPR’25 | 2.64 | 3.16 | 0.82 | 1.62 | 2.83 | 4.67 | 0.97 | 0.46 | 0.27 | 0.22 | 3923.11 | 4147.61 |
| OpenDWM-DiT [ 46 ] (t=16) | CVPR’25 | 1.23 | 1.39 | 0.68 | 1.42 | 2.42 | 3.83 | 0.83 | 0.24 | 0.13 | 0.43 | 2835.68 | 2261.98 |
| LiDARCrafter [ 22 ] (t=5) | AAAI’26 | 2.65 | 3.56 | 1.12 | 2.38 | 3.02 | 4.81 | — | — | — | — | — | — |
| CrossLiDAR (t=16) | — | 0.41 | 0.50 | 1.09 | 1.22 | 1.36 | 1.47 | 0.47 | 0.22 | 0.26 | 0.88 | 307.07 | 1672.90 |
| Sensor | VFOV | HFOV | Resolution | Range (m) | Intensity |
| Velodyne HDL-32E | (32, 1080) |
| Sensor | VFOV | HFOV | Resolution | Range (m) | Intensity |
| TOP | |||||
| F/SL/SR/R | — |
| TrainVal | Test | |
| Vehicle | 941.6K | 227K |
| Pedestrian | 499.1K | 121.4K |
| Cyclist | 11.8K | 3.4K |
| Total | 1451.6K | 352K |
| Train | Val | Test | |
| Scenes | 798 | 202 | 150 |
| Frames | 158K | 40K | 30K |
| Clips | 21K | 5K | 5K |
| Method | Compression | Input Size | Transform | Variant | R-FSVD | R-FPVD | CD | EMD | |
| LiDM [ 41 ] | 208 640 | LogNorm | — | 426.71 | 191.74 | 505.98 | 102.68 | ||
| 208 640 | LogNorm | w/o | 1.83 | 0.32 | 2.81 | 16.25 | |||
| RangeLDM [ 13 ] | 224 608 | LogNorm | — | 3.94 | 0.31 | 3.43 | 23.96 | ||
| 224 608 | LogNorm | w/o | 1.26 | 0.19 | 0.98 | 7.39 | |||
| 200 600 | LogNorm | — | 3.55 | 0.27 | 1.27 | 13.11 | |||
| 200 600 | LogNorm | w/o | 1.44 | 0.15 | 0.49 | 4.40 |
| Method | Input Size | Backbone | Range | Points | BEV | |||
| FRD | MMD | FPVD | MMD | JSD | MMD | |||
| LiDM † [ 41 ] | 208 640 | U-Net | 2.29 | 148.83 | 4.67 | 65.76 | 0.19 | 1.00 |
| 200 600 | DiT | 0.45 | 77.91 | 2.52 | 113.33 | 0.15 | 1.00 | |
| RangeLDM † [ 13 ] | 224 608 | U-Net | 10.97 | 979.33 | 122.38 | 1236.59 | 0.22 | 1.63 |
| 200 600 | DiT | 9.07 | 938.83 | 61.47 | 374.81 | 0.19 | 1.16 | |
| CrossLiDAR † (t=5) | 200 600 | DiT + Naive-Stacking | 1.66 | 55.67 | 14.82 | 156.55 | 0.20 | 1.62 |
| Venue | Modality | LiDAR Sensors | LiDAR Frames | Supported Conditions | Diffusion Model | Dataset | Code | Checkpoint | |
| LiDAR Diffusion [ 41 ] | CVPR’24 | LiDAR | 1 | 1 | image,semantic map | U-Net | K | Yes | K |
| RangeLDM [ 13 ] | ECCV’24 | LiDAR | 1 | 1 | inpaint,downsample | U-Net | K,N | Yes | K,N |
| R2DM [ 35 ] | ICRA’24 | LiDAR | 1 | 1 | — | U-Net | K | Yes | K |
| LiDARDM [ 74 ] | ICRA’25 | LiDAR | 1 | multi | map | U-Net | K,W | Yes | K,W |
| UniScene [ 19 ] | CVPR’25 | LiDAR &Camera | 1 | multi | BEV semantic occupancy | Sparse U-Net | N | Yes | N |
| OpenDWM [ 36 ] | CVPR’25 | LiDAR | 1 | multi | BEV,map,text | U-Net/DiT | N | Yes | N |
Autonomous Driving Simulation
Autonomous driving simulation models roads, traffic, sensors, and vehicle behavior to train and evaluate driving systems safely and at scale.
See all 243 papers