cs.CVNov 14, 2026

PALIN: Pixel-Aligned LiDAR-NIR Multimodal 3D Object Detection with Benchmark

Authors: Yanan Zhang, Amit Vishnia, Chengbo Ai, Eleni Christofa, Runan Cheng, Siyuan Meng, Yuanchang Xie, Yu-Min, 

Organizations: Thomas

Abstract

3D object detection is critical for intelligent transportation systems. LiDAR has been widely adopted for accurate geometric measurements; however, purely geometric representations remain ambiguous under sparse observations and occlusions, while cross-sensor multimodal fusion suffers from calibration and synchronization errors. To overcome these challenges, we leverage an Ouster LiDAR to construct PALIN (Pixel-Aligned LiDAR-NIR), a large-scale intrinsically pixel-aligned multimodal dataset jointly capturing geometry and NIR intensity, comprising approximately 8,000 annotated frames from static urban intersections and diverse mobile suburban scenes. Building upon this dataset, we propose CMambaFusion, a novel fusion framework consisting of a four-directional Cross-Mamba module for bidirectional cross-modal interaction and a Gated Concat-Mamba module for joint feature refinement. Extensive experiments demonstrate that PALIN enables effective multimodal learning, and CMambaFusion achieves superior accuracy-efficiency trade-offs over both LiDAR-only and representative fusion baselines.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RESOLVE: A Multi-Resolution and Multi-Modal Dataset for Roadside Cooperative Perception

    Jun 30, 2026Shaozu Ding, Linan Song, Marco De Vincenzi +1Autonomous Driving DatasetsCamera-LiDAR Fusion

  2. SARFusion: Scene-Aware Routing Fusion for Robust Camera-LiDAR 3D Object Detection

    Sep 24, 2026Yuting Zhao, Ziyi Zheng, Shuxiao LiCamera-LiDAR Fusion3D Object Detection