Overview

The field studies how to combine complementary measurements—such as camera and LiDAR, radar and vision, or wearable motion and physiological signals—when no single sensor provides a complete or reliable picture. Common approaches include probabilistic filters and factor graphs for state estimation, feature- or decision-level fusion, and attention-based networks that learn cross-modal relationships; alignment and uncertainty modeling help account for mismatched timing, geometry, or sensor quality. Methods are evaluated in settings such as autonomous driving on nuScenes and KITTI, robotic manipulation, wearable activity recognition, and satellite image analysis. A central challenge is making fusion robust to missing, degraded, or misaligned sensors: adding modalities can help, but can also introduce noise, negative transfer, extra computation, and poor performance when conditions differ from training.

Latest papers

CardsList

442 papers27 papers in the last four weeks, down 39% on the four weeks before. 0.2% of all new papers.

  1. Beyond the Camera: A Tri-Modal Driving World Model for Future RGB, Thermal, and LiDAR Forecasting in Adverse Weather

    Nov 17, 2026Faysal Mehrab Chowdhury, Md. Mahfuzur Rahman, Ahmed Rafi Hasan +3World Models for Autonomous DrivingVideo World Models

  2. Reliability-Driven Feature Correction for Hyperspectral and LiDAR Classification

    Nov 17, 2026Lianming Zhang, Xiaolu Wang, Qiya Song +3Reliability-Aware Multimodal FusionHyperspectral Image Classification

  3. DGV-DLIVO: Degeneracy-Guided Visual Fusion for Direct LiDAR-Inertial-Visual Odometry in Degenerate Tunnel Environments

    Nov 17, 2026Junrui ZhangCamera-LiDAR FusionMultimodal Sensor Fusion

  4. Selective Sensor Acquisition for Multimodal Place Recognition

    Nov 16, 2026Margaux Edwards, Tobias Fischer, Michael MilfordActive Feature AcquisitionMultimodal Sensor Fusion

  5. DoF-Query Transformer for Adaptive Fusion of Egocentric Vision and Forearm HD-sEMG in Continuous Hand Kinematics

    Nov 15, 2026Jiahang Liu, Wenbo Zhang, Junsong Wang +4Multimodal Sensor FusionMultimodal Fusion

  6. Edge-Adaptive Hiera-Seg Model for Building-Integrated Photovoltaic Power Forecasting

    Nov 15, 2026Na YuSolar Power ForecastingEdge Inference

  7. HeteroWear: Sensor-Aware Self-Supervised Learning for Heterogeneous Wearable Activity Recognition

    Nov 13, 2026Yasaman Mohammadpour, Pouya ShaeriWearable SensingHuman Activity Recognition

  8. A Unified Interpretable Semantic Framework for Multi-Modal Fiber Sensing Under Data Scarcity

    Nov 11, 2026Khouloud AbdelliMultimodal Sensor FusionMultimodal Classification

  9. NIF-VIO: Visual--Inertial Odometry Across Inertial and Non-Inertial Reference Frames

    Nov 10, 2026Zichao Shu, Lijun Li, Zhuochen Li +2Visual-Inertial OdometryMultimodal Sensor Fusion

  10. Galilean Robots, Aristotelian Sensors: Joint Spatiotemporal Trajectory Estimation and Extrinsic Calibration

    Nov 9, 2026Abhishek Goudar, Jonathan Kelly, Timothy D. BarfootRobot CalibrationRobot State Estimation

  11. STEP: Spatiotemporal Training with Explicit Prediction for Perceptive Humanoid Locomotion

    Nov 5, 2026Youhao Lyu, Chenghao Sun, Zhenxuan Ding +3Humanoid Robot LocomotionTerrain-Aware Robot Locomotion

  12. FREE-LIVO: Physically Decoupled Yet Tightly Coupled LiDAR-Inertial-Visual Odometry

    Nov 5, 2026Reon Tabata, Kenji Koide, Shuji Oishi +5Asynchronous Multimodal Sensor FusionLiDAR Odometry

  13. Navigational Safety of Marine Surface Vehicles in Restricted Visibility: From Intelligent Vision to Vision-Centered Multi-Sensor Fusion

    Nov 4, 2026Ryan Wen Liu, Fengchuan Song, Tianxiang Wang +7Maritime NavigationMultimodal Sensor Fusion

  14. ReGATE: Recurrent Gated Visual Fusion for Reactive Humanoid-Object Interaction

    Nov 2, 2026Hao Zhu, Jorge Peña-QueraltaRobotic Loco-ManipulationRobotic Manipulation

  15. MultiMental-IAS: A Multimodal Driver Mental State Analysis Dataset for Context-Aware Non-IID Evaluation

    Nov 2, 2026Baran Can Gül, Nagendra Pal Singh, Anjana Arvind NaikCross-Subject GeneralizationMultimodal Dataset

  16. Source-Resolved Collective Cognition in Robotics: Mathematical Foundations for Multimodal and Collective Estimation, and Their Reach across the Cognition Loop

    Nov 2, 2026Juergen GrafSingular Value DecompositionMultimodal Sensor Fusion

  17. Multimodal BVP and Respiration for Automated Pain Recognition with Hankel-FCN

    Nov 1, 2026Valentina Becchetti, Muhammad Umar Khan, Stefanos Gkikas +2Multimodal ClassificationMultimodal Sensor Fusion

  18. Where Does EEG Help Wearable Freezing of Gait Detection?

    Oct 31, 2026Chuntian Chi, Lifang He, Huajie Shao +1Gait AnalysisMultimodal Sensor Fusion

  19. PulmoWorld: An Asynchronous Multimodal Medical World Model for Longitudinal Pneumonia Dynamics

    Oct 28, 2026Cheng Tang, Xinyu Zhang, Jiawei Chen +14Disease Progression ModelingWorld Model Learning

  20. RESPLE2: Inertial-Informed Recursive Non-Uniform Spline Estimation for Multi-Sensor Odometry with Global Refinement

    Oct 27, 2026Ziyu Cao, William Talbot, Song Li +4Robot State EstimationMultimodal Sensor Fusion

  21. SVIn+: Multi-Modal Framework for Robust Underwater State Estimation using 3D Sonar, Visual-Inertial, Water-Pressure, and DVL

    Oct 27, 2026Chinmay Burgul, Xiaoming Zhao, Yewei Huang +4Robot State EstimationUnderwater Robotics

  22. Fed-MAPTrack: Federated Modality-aware Prompt Tuning for RGB-X Tracking

    Oct 26, 2026Xiangyu Liu, Yijie Shen, Yue Yin +3Multimodal Visual Object TrackingMultimodal Federated Learning

  23. MMGNet: Multi-Modal 6-DoF Grasp Synthesis for Cluttered Scenes

    Oct 26, 2026Rui Cao, Jia-Hui Pan, Yichuan Li +46-DOF Grasp Pose EstimationRobotic Grasping

  24. AgriDefend: A $205 Offline Edge Device that Detects Crop Stress Before Visible Symptoms via Multimodal AI Fusion

    Oct 26, 2026George Xu, Nikhil Vincent, Elizabeth S. ForbesPrecision AgricultureAgricultural Remote Sensing

  25. GelSlim 5.0: Unifying Vision and Touch with a Single Fingertip Camera

    Oct 22, 2026Xiangdong Wang, I-Hsuan Huang, Xiaohao Xu +3Tactile Sensing for Robotic ManipulationMultimodal Sensor Fusion