Camera-Radar Fusion

Ask about this topic

Overview

Camera-radar fusion studies how to combine detailed image information with radar measurements that provide geometry and motion cues and can remain useful in poor visibility. Common approaches align features in bird’s-eye view, use cross-attention or learned queries to associate image regions with radar returns, and add temporal fusion, depth estimation, or calibration modules. Methods are evaluated on driving benchmarks such as nuScenes, View-of-Delft, TJ4DRadSet, and K-Radar, for tasks including 3D detection, depth, segmentation, and occupancy, with increasing attention to adverse weather and long-range settings. A central challenge is balancing cameras’ rich but weather-sensitive cues against radar’s sparse, sometimes noisy measurements while maintaining reliable calibration, generalization, and real-time efficiency.

Latest papers

CardsList

49 papers4 papers in the last four weeks, down 20% on the four weeks before. 0.0% of all new papers.

  1. Selection, Not Fusion: Radar-Modulated State Space Models for Radar-Camera Depth Estimation

    May 12, 2026Zhangcheng Hou, Tomoaki OhtsukiCamera-Radar FusionSelective SSMs

    School of Science and Technology, Keio University, Yokohama 223-8522, Japan

  2. REFNet++: Multi-Task Efficient Fusion of Camera and Radar Sensor Data in Bird's-Eye Polar View

    May 12, 2026Kavin Chandrasekaran, Sorin Grigorescu, Gijs Dubbelman +1Camera-Radar FusionBird's-Eye-View Representation

    Elektrobit Automotive GmbH · Transilvania University of Brasov · Eindhoven University of Technology

  3. Control Your Queries: Heterogeneous Query Interaction for Camera-Radar Fusion

    Apr 28, 2026Jialong Wu, Yihan Wang, Matthias RottmannCamera-Radar FusionAutonomous Driving Perception

    1Osnabrück University · 3Aptiv Services Deutschland GmbH · University of Wuppertal

  4. CLLAP: Contrastive Learning-based LiDAR-Augmented Pretraining for Enhanced Radar-Camera Fusion

    Apr 27, 2026Bingyi Liu, Chuanhui Zhu, Hongfei Xue +5Camera-Radar FusionSelf-Supervised Pre-Training

    Wuhan University of Technology · University of North Carolina at Charlotte · The Hong Kong Polytechnic University +2

  5. Radar-Camera BEV Multi-Task Learning with Cross-Task Attention Bridge for Joint 3D Detection and Segmentation

    Apr 14, 2026Ahmet İnanç, Özgür ErkentAutonomous Driving PerceptionMulti-Task Learning

    Hacettepe University, Ankara, Turkey.

  6. VLMaterial: Vision-Language Model-Based Camera-Radar Fusion for Physics-Grounded Material Identification

    Apr 13, 2026Jiangyou Zhu, He ChenCamera-Radar FusionMaterials Property Prediction

    Department of Inforation Engineering, The Chinese University of Hong Kong, Hong Kong SAR, China

  7. DinoRADE: Full Spectral Radar-Camera Fusion with Vision Foundation Model Features for Multi-class Object Detection in Adverse Weather

    Apr 9, 2026Christof Leitgeb, Thomas Puchleitner, Max Peter Ronecker +1Object DetectionAutonomous Driving Perception

    Infineon Technologies AG, Austria · Graz University of Technology, Austria · Virtual Vehicle Research GmbH, Austria

  8. Multi-Modal Sensor Fusion using Hybrid Attention for Autonomous Driving

    Apr 6, 2026Mayank Mayank, Bharanidhar Duraisamy, Florian Geiß +1Camera-Radar Fusion3D Object Detection

    Research and Development, Mercedes-Benz AG, Germany · Department of Computer Science, University of Freiburg, Germany

  9. mmAnomaly: Leveraging Visual Context for Robust Anomaly Detection in the Non-Visual World with mmWave Radar

    Apr 1, 2026Tarik Reza Toha, Shao-Jung, Lu +2Anomaly DetectionAnomaly Localization

    Louie · University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA

  10. Tightly-Coupled Radar-Visual-Inertial Odometry

    Mar 24, 2026Morten Nissov, Mohit Singh, Kostas AlexisRobot LocalizationCamera-Radar Fusion

    All authors are with the Department of Engineering Cybernetics, O. S. Bragstads Plass 2D, Norwegian University of Science and Technology (NTNU), Trondheim, Norway.

  11. RadarXFormer: Robust Object Detection via Cross-Dimension Fusion of 4D Radar Spectra and Images for Autonomous Driving

    Mar 16, 2026Yue Sun, Yeqiang Qian, Zhe Wang +3Autonomous Driving Perception3D Object Detection

    Global Institute of Future Technology, Shanghai Jiao Tong University, Shanghai, 200240, China. · School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, 200240, China. · Key Laboratory of System Control and Information Processing, Ministry of Education of China, Shanghai Jiao Tong University, Shanghai, 200240, China. +2

  12. R4Det: 4D Radar-Camera Fusion for High-Performance 3D Object Detection

    Mar 12, 2026Zhongyu Xia, Yousen Tang, Yongtao Wang +23D Object DetectionCamera-Radar Fusion

    Wangxuan Institute of Computer Technology, Peking University · EBTech Co. Ltd

  13. 4DRC-OCC: Robust Semantic Occupancy Prediction Through Fusion of 4D Radar and Camera

    Mar 8, 2026David Ninfa, Andras Palffy, Holger Caesar3D Occupancy PredictionAutonomous Driving Perception

    Cognitive Robotics, Delft University of Technology · Perciv AI

  14. calibfusion: Transformer-Based Differentiable Calibration for Radar-Camera Fusion Detection in Water-Surface Environments

    Mar 3, 2026Yuting Wan, Liguo Sun, Jiuwu Hao +1Camera-Radar FusionObject Detection

  15. physfusion: A Transformer-based Dual-Stream Radar and Vision Fusion Framework for Open Water Surface Object Detection

    Mar 2, 2026Yuting Wan, Liguo Sun, Jiuwu Hao +2Camera-Radar FusionObject Detection

    School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China. · Institute of Automation, Chinese Academy of Sciences, Beijing, China.

  16. RC-GeoCP: Geometric Consensus for 4D Radar-Camera Collaborative Perception

    Feb 28, 2026Xiaokai Bai, Lianqing Zheng, Runwei Guan +3Camera-Radar FusionCooperative Perception

    College of Information Science and Electronic Engineering, Zhejiang University · School of Automotive Studies, Tongji University · Thrust of Artificial Intelligence, Hong Kong University of Science and Technology

  17. Boosting Instance Awareness via Cross-View Correlation with 4D Radar and Camera for 3D Object Detection

    Feb 24, 2026Xiaokai Bai, Lianqing Zheng, Si-Yuan Cao +63D Object DetectionCamera-Radar Fusion

    College of Information Science and Electronic Engineering, Zhejiang University, Hangzhou 310027, China · School of Automotive Studies, Tongji University, Shanghai 201804, China · College of Computer Science and Technology, Zhejiang University, Hangzhou 310027, China, and also with the Jinhua Institute of Zhejiang University, Jinhua 321299, China +1

  18. GaussianCaR: Gaussian Splatting for Efficient Camera-Radar Fusion

    Feb 9, 2026Santiago Montiel-Marín, Miguel Antunes-García, Fabio Sánchez-García +3Camera-Radar FusionAutonomous Driving Perception

    Department of Electronics. University of Alcalá, Spain. · Department of Cognitive Robotics. Delft University of Technology, The Netherlands.

  19. Multi-Sensor Fusion for UAV Classification Based on Feature Maps of Image and Radar Data

    Oct 21, 2024Nikos Sakellariou, Antonios Lalas, Konstantinos Votis +1Camera-Radar FusionImage Classification

    Centre for Research and Technology Hellas, Information Technologies Institute