Overview

The field studies how to combine complementary measurements—such as camera and LiDAR, radar and vision, or wearable motion and physiological signals—when no single sensor provides a complete or reliable picture. Common approaches include probabilistic filters and factor graphs for state estimation, feature- or decision-level fusion, and attention-based networks that learn cross-modal relationships; alignment and uncertainty modeling help account for mismatched timing, geometry, or sensor quality. Methods are evaluated in settings such as autonomous driving on nuScenes and KITTI, robotic manipulation, wearable activity recognition, and satellite image analysis. A central challenge is making fusion robust to missing, degraded, or misaligned sensors: adding modalities can help, but can also introduce noise, negative transfer, extra computation, and poor performance when conditions differ from training.

Latest papers

CardsList

442 papers27 papers in the last four weeks, down 39% on the four weeks before. 0.2% of all new papers.

  1. Comparative Assessment of Multimodal Earth Observation Data for Soil Moisture Estimation

    Feb 20, 2026Ioannis Kontogiorgakis, Athanasios Askitopoulos, Iason Tsardanidis +4Agricultural Remote SensingMultimodal Sensor Fusion

  2. MUOT_3M: A 3 Million Frame Multimodal Underwater Benchmark and the MUTrack Tracking Method

    Feb 20, 2026Ahsan Baidar Bakht, Mohamad Alansari, Muhayy Ud Din +5Visual Object TrackingMultimodal Visual Object Tracking

  3. 3D Scene Rendering with Multimodal Gaussian Splatting

    Feb 19, 2026Chi-Shiang Gau, Konstantinos D. Polyzos, Athanasios Bacharis +23D Reconstruction3D Gaussian Splatting

  4. Boreas Road Trip: A Multi-Sensor Autonomous Driving Dataset on Challenging Roads

    Feb 18, 2026Daniil Lisus, Katya M. Papais, Cedric Le Gentil +4Autonomous Driving DatasetsAutonomous Driving Benchmarks

  5. Axle Sensor Fusion for Online Continual Wheel Fault Detection in Wayside Railway Monitoring

    Feb 18, 2026Afonso Lourenço, Francisca Osório, Diogo Risca +1Fault DiagnosisOnline Anomaly Detection

  6. Combining scEEG and PPG for reliable sleep staging

    Feb 4, 2026Jiawei Wang, Liang Xu, Shuntian Zheng +7Sleep Stage ClassificationWearable Health Monitoring

  7. Multimodal Benchmark for Safety Assessment in Industrial Inspection Scenarios

    Jan 29, 2026Zeyi Liu, Shuang Liu, Jihai Min +7Robotic InspectionIndustrial Inspection

  8. AsyncBEV: Cross-modal Flow Alignment in Asynchronous 3D Object Detection

    Jan 19, 2026Shiming Wang, Holger Caesar, Liangliang Nan +1Autonomous Driving Perception3D Object Detection

  9. CREPES-X: Hierarchical Bearing-Distance-Inertial Direct Cooperative Relative Pose Estimation System

    Dec 31, 2025Zhehan Li, Jiadong Lu, Zheng Wang +6Relative Pose EstimationMulti-Robot Systems

  10. Attention Fusion for Bridge Deck Delamination Detection

    Dec 23, 2025Alireza Moayedikia, Amirhossein MoayedikiaMultimodal Sensor FusionStructural Health Monitoring

  11. HAGI++: Head-Assisted Gaze Imputation and Generation

    Nov 4, 2025Chuhan Jiao, Zhiming Hu, Andreas BullingGaze EstimationTime Series Imputation

  12. Vision-Based Tactile Sensing for the Perception of the Object's Compliance and Hardness

    Oct 14, 2025Muxing Huang, Zibin Chen, Weiliang Xu +5Vision-Based Tactile SensingTactile Sensing

  13. QuantV2X: A Fully Quantized Multi-Agent System for Cooperative Perception

    Sep 3, 2025Seth Z. Zhao, Huizhi Zhang, Zhaowei Li +11V2X CommunicationCooperative Perception

  14. REVELIO: Universal Multimodal Task Load Estimation for Cross-Domain Generalization

    Sep 1, 2025Maximilian P. Oppelt, Andreas Foltyn, Nadine R. Lang-Richter +1Multimodal Domain GeneralizationMultimodal Dataset

  15. M4-SAR: A Multi-Resolution, Multi-Polarization, Multi-Scene, Multi-Source Dataset and Benchmark for optical-SAR Object Detection

    May 16, 2025Chao Wang, Wei Lu, Xiang Li +2Remote SensingObject Detection

  16. DogLegs: Robust Proprioceptive State Estimation for Legged Robots Using Multiple Leg-Mounted IMUs

    Mar 6, 2025Yibin Wu, Jian Kuang, Shahram Khorshidi +4Legged RoboticsRobot State Estimation

  17. Sonicmesh: Enhancing 3D Human Mesh Reconstruction in Vision-Impaired Environments With Acoustic Signals

    Dec 15, 2024Xiaoxuan Liang, Hong Zhou, Zhaolong Wei +33D ReconstructionHuman Mesh Recovery

  18. Multi-Sensor Fusion for UAV Classification Based on Feature Maps of Image and Radar Data

    Oct 21, 2024Nikos Sakellariou, Antonios Lalas, Konstantinos Votis +1Camera-Radar FusionImage Classification

  19. EPMF: Efficient Perception-aware Multi-sensor Fusion for 3D Semantic Segmentation

    Jun 21, 2021Mingkui Tan, Zhuangwei Zhuang, Sitao Chen +4Camera-LiDAR FusionAutonomous Driving Perception