Camera-LiDAR Fusion

Ask about this topic

Overview

Camera–LiDAR fusion studies how to combine cameras’ rich appearance cues with LiDAR’s metric 3D geometry for tasks such as object detection, segmentation, depth completion, occupancy prediction, tracking, and localization. Common approaches project sensor data into a shared image or bird’s-eye-view space, fuse features through attention or gating, or match observations using explicit geometric constraints; sparse LiDAR also serves as a depth prompt for camera models. Methods are commonly evaluated on driving benchmarks such as nuScenes, KITTI, Waymo, and SemanticKITTI, with growing attention to adverse weather, long range, and real-time deployment. A central challenge is making fusion reliable when calibration is imperfect or one sensor is degraded, without sacrificing accuracy, efficiency, or useful modality-specific information.

Latest papers

CardsList

106 papers11 papers in the last four weeks, down 8% on the four weeks before. 0.1% of all new papers.

  1. Post Fusion Bird's Eye View Feature Stabilization for Robust Multimodal 3D Detection

    Mar 5, 2026Trung Tien Dong, Dev Thakkar, Arman Sargolzaei +1Multimodal Robustness3D Object Detection

    College of Engineering, University of South Florida, Tampa, FL 33620, USA

  2. Fusion4CA: Boosting 3D Object Detection via Comprehensive Image Exploitation

    Mar 5, 2026Kang Luo, Xin Chen, Yangyi Xiao +13D Object DetectionCamera-LiDAR Fusion

    IRMV Lab, the Department of Automation, Shanghai Jiao Tong University.

  3. LiDAR Prompted Spatio-Temporal Multi-View Stereo for Autonomous Driving

    Mar 4, 2026Qihao Sun, Jiarun Liu, Ziqian Ni +5Multi-View Depth EstimationDepth Estimation

    Unmanned Vehicle Dept., CaiNiao Inc., Alibaba Group · Harbin Institute of Technology

  4. VLMFusionOcc3D: VLM Assisted Multi-Modal 3D Semantic Occupancy Prediction

    Mar 3, 2026A. Enes Doruk, Hasan F. Ates3D Occupancy PredictionAutonomous Driving Perception

  5. LEAR: Learning Edge-Aware Representations for Event-to-LiDAR Localization

    Mar 2, 2026Kuangyi Chen, Jun Zhang, Yuxi Hu +2LiDAR LocalizationCamera-LiDAR Fusion

    Institute of Visual Computing, Graz University of Technology, 8010 Graz, Austria · Neuromorphic Automation and Intelligence Lab (NAIL), School of Artificial Intelligence and Robotics, Hunan University, Changsha 410012, China

  6. Autonomous Inspection of Power Line Insulators with UAV on an Unmapped Transmission Tower

    Feb 27, 2026Václav Riss, Vít Krátký, Robert Pěnička +1Robotic InspectionIndustrial Inspection

  7. LiREC-Net: A Target-Free and Learning-Based Network for LiDAR, RGB, and Event Calibration

    Feb 25, 2026Aditya Ranjan Dash, Ramy Battrawy, René Schuster +1Lidar-Camera Extrinsic CalibrationCamera-LiDAR Fusion

    RPTU – University Kaiserslautern-Landau · DFKI – German Research Center for Artificial Intelligence

  8. SF3D-RGB: Scene Flow Estimation from Monocular Camera and Sparse LiDAR

    Feb 25, 2026Rajai Alhimdiat, Ramy Battrawy, René Schuster +2Scene Flow Estimation3D Scene Understanding

    Islamic University of Gaza, Gaza, Palestine · German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany

  9. SEF-MAP: Subspace-Decomposed Expert Fusion for Robust Multimodal HD Map Prediction

    Feb 25, 2026Haoxiang Fu, Lingfeng Zhang, Hao Li +7Camera-LiDAR FusionMultimodal Robustness

    National University of Singapore · Shenzhen Tsinghua International Graduate School, Tsinghua Univeristy · Xiaomi EV +4

  10. VGGT-MPR: VGGT-Enhanced Multimodal Place Recognition in Autonomous Driving Environments

    Feb 23, 2026Jingyi Xu, Zhangshuo Qi, Zhongmiao Yan +5Camera-LiDAR FusionAutonomous Driving

    Shanghai Jiao Tong University. · Beijing Institute of Technology. · National University of Defense Technology.

  11. UP-Fuse: Uncertainty-guided LiDAR-Camera Fusion for 3D Panoptic Segmentation

    Feb 22, 2026Rohit Mohan, Florian Drews, Yakov Miron +2Camera-LiDAR FusionPanoptic Segmentation

    University of Freiburg, Germany · Robert Bosch GmbH, Germany · University of Haifa

  12. Enhancing 3D LiDAR Segmentation by Shaping Dense and Accurate 2D Semantic Predictions

    Feb 21, 2026Xiaoyu Dong, Tiankui Xian, Wanshui Gan +1Multimodal Semantic Segmentation3D Semantic Segmentation

    The University of Tokyo, Tokyo, Japan · RIKEN AIP, Tokyo, Japan

  13. A Multi-modal Detection System for Infrastructure-based Freight Signal Priority

    Feb 19, 2026Ziyan Zhang, Chuheng Wei, Xuanpeng Zhao +6Intelligent Transportation SystemsObject Detection

    Center for Environmental Research and Technology (CE-CERT), University of California at Riverside (UCR), Riverside, CA

  14. Preserving Guidance in Cost-Volume Retrieval under Extreme LiDAR Sparsity in Iterative Stereo

    Jul 26, 2025Jinsu Yoo, Sooyoung Jeon, Zanming Huang +2Camera-LiDAR FusionStereo Matching

    The Ohio State University

  15. Long-Tailed 3D Detection via Multi-Modal Fusion

    Dec 18, 2023Yechi Ma, Neehar Peri, Achal Dave +33D Object DetectionLong-Tail Autonomous Driving

    Department of Computer Science, Zhejiang University. · Computing & Mathematical Sciences, Caltech. · Toyota Research Institute. +2

  16. EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentation

    Jun 21, 2021Mingkui Tan, Zhuangwei Zhuang, Sitao Chen +4Camera-LiDAR FusionAutonomous Driving Perception

    School of Software Engineering, South China University of Technology · Pazhou Laboratory, Guangzhou, China · School of Electronic and Information Engineering, South China University of Technology +2