Multimodal Sensor Fusion

Follow this topic Ask about this topic

Momentum

37 papers in the last four weeks, up 131% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 275

All topics

High-Resolution Flood Mapping With Sentinel-1 and Sentinel-2 via Misalignment-Robust Cross-Sensor Learning and Generative Despeckling
Jun 29, 2026David Ma, Jeremy Feinstein, Shreya Pandit +2Remote Sensing Image Segmentation Flood Inundation Mapping
Argonne National Laboratory, Lemont, IL 60439 USA · Ohlone College, Fremont, CA 94539 USA
Seeing Touch from Motion: A Unified Modality-Aware Visuo-Tactile Policy with Tactile Motion Correlation
Jun 29, 2026Shengqi Xu, Guojin Zhong, Yang Liu +7Robot Policy Learning Contact-Rich Robotic Manipulation
Institute of Trustworthy Embodied AI, Fudan University · Shanghai Key Laboratory of Multimodal Embodied AI · NeoteAI +1
Cross-Spectral Stereo Inertial Odometry
Jun 29, 2026Seungsang Yun, Hyunsoo Jang, Tai Hyoung Rhee +3Visual-Inertial Odometry Cross-Modal Feature Matching
Dept. of Mechanical Engineering, Seoul National University (SNU), Seoul, S. Korea
Empirical Evaluation of Multi-Modal Touch Detection in Over-the-Shoulder Video Surveillance
Jun 28, 2026Mohammadreza RashidiMultimodal Sensor Fusion Video Surveillance
Department of Computer Science · AI and Media Analysis Lab · Berlin, Germany
Event-VLA: Action-Conditioned Event Fusion for Robust Vision-Language-Action Model
Jun 28, 2026Jiaxin Liu, Xun Xu, Zhenhao Zhang +5Language-Conditioned Robot Manipulation Vision-Language-Action Models
ShanghaiTech · HKUST(GZ) · UMich +1
PL-LIT: A LiDAR-Inertial-Thermal SLAM Using Point-Line Features and Thermographic Mapping
Jun 28, 2026Jiawei Xia, Yixiao Feng, Yongliang Shi +4Thermal Imaging Simultaneous Localization and Mapping
Tsinghua University · The Hong Kong University of Science and Technology (Guangzhou) · University of California, Berkeley
Empowering a Single-Frequency GNSS Receiver to Achieve High-Precision Positioning with Relative Observations
Jun 28, 2026Xingpeng Wang, Ziwen Qu, Juncheng Chen +8Robot Localization Multimodal Sensor Fusion
State Key Laboratory of Industrial Control Technology, Institute of Cyber Systems and Control, Zhejiang University, Hangzhou, China · Huzhou Institute of Zhejiang University, Huzhou, China
EVLA: An Electro-Aware Multimodal Assistant for Physically-Grounded Driving Reasoning and Control
Jun 27, 2026Yuxin Liu, Zihan Chen, Haoyu Wang +3VLMs for Autonomous Driving End-to-End Autonomous Driving
College of Computer Science and Technology Zhejiang University Hangzhou, Zhejiang, China
IMU-HOI: A Symbiotic Framework for Coherent Human-Object Interaction and Motion Capture via Contact-Conscious Inertial Fusion
Jun 26, 2026Lizhou Lin, Songpengcheng Xia, Zengyuan Lai +3Object Pose Estimation 3D Human Pose Estimation
Shanghai Jiao Tong University
Dual-Learning based Penalized Multi-Align Clustering for Multi-View Incomplete and Disorderly Data
Jun 26, 2026Liang Zhao, Shubin Ma, Bo Xu +1Missing-Modality Learning Cross-Modal Alignment
Dalian University of Technology · Dalian, Liaoning, China · Hainan University +1
A Comparison of Fusion Techniques for Multi-Modal Human Activity Recognition on the HARMES Dataset
Jun 26, 2026Ahmed Mohamady, Robin Burchard, Kristof Van LaerhovenHuman Activity Recognition Multimodal Fusion
University of Siegen, Germany
LXD-SLAM: LiDAR+X Dense SLAM with $\sum_{i=0}^{5}C_5^i$ Configurable Sensor Combinations
Jun 26, 2026Zhong Wang, Lin Zhang, Linfei Li +4Simultaneous Localization and Mapping Multimodal Sensor Fusion
School of Computer Science, Tongji University, Shanghai, 201804, China · School of Surveying and Geo-Informatics, Tongji University, Shanghai, 200092, China · School of Remote Sensing and Information Engineering, Wuhan University, Wuhan, 430072, China
Distributed Air-Gap Flux and Rotor-Current Fusion for Operating-Regime Identification in a 10-MW Kaplan Hydrogenerator
Jun 26, 2026Eduardo Jr Piedad, Rafel Roig, Xavier Escaler +2System Identification Multimodal Sensor Fusion
DOST–Advanced Science and Technology Institute, Quezon City 1101 Philippines · Universitat Politècnica de Catalunya, 08034 Barcelona, Spain
OctoSense: Self-Supervised Learning for Multimodal Robot Perception
Jun 25, 2026Anthony Bisulco, Jeremy Wang, Kostas Daniilidis +2Autonomous Driving Datasets Masked Autoencoders
1General, Robotics, Automation, Sensing and Perception (GRASP) Laboratory, University of Pennsylvania · Computer Science Department, Brown University
Risk-Aware Selective Multimodal Driver Monitoring with Driver-State World Modeling
Jun 25, 2026Daosheng Qiu, Haozhuang Chi, Hao Su +4Selective Prediction World Models
Hubei University, Wuhan, China · Nanyang Technological University, Singapore · Osaka University, Osaka, Japan
Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking
Jun 24, 2026Xiao Wang, Xufeng Lou, Zikang Yan +5Event-Based Vision Multimodal Robustness
School of Electronic and Computer Engineering, Shenzhen Graduate School, Peking University, China
Transformer-based Multisensor Data Fusion of Ultrasonic Guided Wave and FBG-based Strain Measurements for Multitask Aerospace Structural Health Monitoring
Jun 24, 2026Xin Yang, Morteza Moradi, Tongtong Yan +4Multimodal Sensor Fusion Fault Diagnosis
Department of Mechanical Engineering & Division of Mechatronic System Dynamics (LMSD), KU Leuven, Belgium · Center of Excellence in Artificial Intelligence for Structures, Prognostics & Health Management, Aerospace Engineering Faculty, Delft University of Technology, Kluyverweg 1, Delft, 2629 HS, the Netherlands · Department of Civil Engineering, The University of British Columbia, Vancouver, Canada +2
MIL-LC: A Robust Magnetometer-Inertial-LiDAR Fusion Multimodal Localization Framework
Jun 24, 2026Qiyang Lyu, Zhenyu Wu, Wei Wang +2GNSS-Denied Localization LiDAR Localization
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798
SA-LIVO: Efficient LiDAR-Inertial-Visual Odometry with Subspace-Aware Degeneracy Handling
Jun 24, 2026Yinong Cao, Xin He, Yuwei Chen +3Inertial Odometry Robot Localization
Key Laboratory of Space Active Opto-Electronics Technology, Shanghai Institute of Technical Physics, Chinese Academy of Sciences, Shanghai 200083, China. · Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences, Hangzhou 310024, China.
An iterative energy-based multimodal transformer for joint retrieval of wheat soil moisture, leaf area index, and plant height from Sentinel-1 and Sentinel-2 time series
Jun 23, 2026Shubham Kumar Singh, Peilei Fan, Suraj A. Yadav +2Agricultural Remote Sensing Transformer
Department of Urban and Environmental Policy and Program, Tufts University, 503 Boston Ave., Medford, MA 02155 · Electrical and Computer Engineering Department, Mississippi State University, Mississippi, USA, 39762 · Department of Physics, Indian Institute of Technology (BHU), Varanasi, India 221005 +1
ADM-Fusion: Adaptive Deep Multi-Sensor Fusion for Robust Ego-Motion Estimation in Diverse Conditions
Jun 23, 2026Hasan Moughnieh, Ibrahim Ghaddar, Hadi Elham +2Multimodal Robustness Mixture of Experts
Department of Electrical and Computer Engineering, American University of Beirut, Beirut, Lebanon. · Department of Mechanical Engineering, American University of Beirut, Beirut, Lebanon.
AerialFusionMapNet: Online HD Map Construction with Aerial-Onboard BEV Fusion
Jun 23, 2026Daniel Lengerer, Mathias Pechinger, Klaus Bogenberger +1Simultaneous Localization and Mapping HD Map Construction
Technical University of Applied Sciences Augsburg, Germany. · Technical University of Munich, Germany.
When Multi-Sensor Fusion Fails to Generalize: Cattle Posture Classification Under Animal-Level and Temporal Distribution Shift
Jun 23, 2026Leutrim Uka, Severino Pinto, Gundula Hoffmann +1Distribution Shift Robustness Distribution Shift
Institute of Computer Science, University of Potsdam, Potsdam, Germany. · Department of Sensors and Modelling, Leibniz Institute for Agricultural Engineering and Bioeconomy - ATB, Potsdam, Germany. · Department of Data Science in Bioeconomy, Leibniz Institute for Agricultural Engineering and Bioeconomy - ATB, Potsdam, Germany.
NoContactNoWorries: Estimating Contact through Vision and Proprioception for In-Hand Dexterous Manipulation
Jun 23, 2026Soham Patil, Avirup Das, Sourabh Bhosale +1Vision-Based Tactile Sensing Dexterous Manipulation
Robotics Research Center (RRC), International Institute of Information Technology (IIIT), Hyderabad, India · Department of Computer Science, The University of Manchester
SlipSense: Multimodal Sensing for Online Slip Detection in Legged Robots
Jun 23, 2026Iris Szu-Yao Liu, Chien Chern Cheah, Meng Yee Michael ChuahTactile Sensing Robotic Tactile Sensing
School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore · Institute for Infocomm Research, Agency for Science Technology and Research, Singapore
Integrated Sensing and Communications for Real-time Avatar Control in XR over 5G
Jun 22, 2026Nabeel Nisar Bhat, Javad Sameri, Rreze Halili +3Integrated Sensing and Communication Wireless Communications
IDLab, University of Antwerp - imec, Antwerp, Belgium · IDLab, Ghent University - imec, Ghent, Belgium · Light and Lighting Technology Lab, KU Leuven, Ghent, Belgium
Real-Time Multimodal Activity-Aware Error Detection in Robot-Assisted Surgery
Jun 22, 2026Seyed Hamid Reza Roodabeh, Zongyu Li, Homa AlemzadehSurgical Robotics Multimodal Sensor Fusion
Electrical and Computer Engineering Department, School of Engineering and Applied Science, University of Virginia, Charlottesville, VA, United States of America
DVL-DeepONet: A Physics-Guided Operator Learning for Resilient Underwater Navigation
Jun 22, 2026Arup Kumar Sahoo, Itzik KleinUnderwater Robotics Physics-Informed ML
The Hatter Department of Marine Technologies, Leon H. Charney School of Marine Sciences, University of Haifa, Haifa, 3498838, Israel
Neural Conjugate Aggregation: Identifiable Unsupervised Multi-Sensor Regression under Heterogeneous Sensor Bias
Jun 20, 2026Muhammed Faruk Aytin, Zehra Demir, Alper Unal +2Bayesian Inference Uncertainty Calibration
AI and Data Engineering Department, Istanbul Technical University, Istanbul, Türkiye · Eurasia Institute of Earth Sciences, Istanbul Technical University, Istanbul, Türkiye · Civil & Environmental Engineering, University of Washington, Seattle, WA, USA
Resolving Multi-Target Association in OFDM-based ISAC via Vision-aided Multi-Modal Learning
Jun 20, 2026Meng Hua, Chenghong Bian, Deniz GunduzIntegrated Sensing and Communication Wireless Communications
Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, U.K. · Department of Electrical and Computer Engineering, Hong Kong University of Science and Technology, Hong Kong.

Jun 29, 2026, cs.CVJ/K move · Enter open · S save

High-Resolution Flood Mapping With Sentinel-1 and Sentinel-2 via Misalignment-Robust Cross-Sensor Learning and Generative Despeckling

David Ma, Jeremy Feinstein, Shreya Pandit, Arkaprabha Ganguli+1

Argonne National Laboratory, Lemont, IL 60439 USA · Ohlone College, Fremont, CA 94539 USA

Remote Sensing Image Segmentation Flood Inundation Mapping Remote Sensing Synthetic Aperture Radar Remote Sensing Benchmarks Multimodal Sensor Fusion+1

Open paper AskPDF arXiv

Reliable high-resolution flood extent mapping from satellite imagery remains constrained by limited data fidelity and sensor-specific artifacts. Multispectral optical imagery is degraded by clouds, shadows, and urban confounders, while synthetic aperture radar (SAR) imagery is affected by speckle noise and sensor co-registration uncertainty. This work presents an integrated flood mapping framework that jointly addresses these limitations through curated datasets and novel learning strategies. We introduce a new Sentinel-2 (S2) and Sentinel-1 (S1) dataset covering the contiguous United States, featuring pixel-accurate 10 m water masks with emphasis on challenging weather conditions and urban environments that are underrepresented in existing benchmarks. High-quality S2 annotations are manually produced using rigorous geospatial labeling protocols and transferred to SAR imagery through weakly labeled temporally coincident acquisitions. To address SAR-specific artifacts, a shift-invariant loss function is employed to tolerate residual geolocation uncertainty between SAR imagery and optical-derived labels, and a Conditional Variational Autoencoder (CVAE) is trained on multitemporal SAR composites to suppress speckle while preserving flood-relevant spatial structure. Experiments using UNet and UNet++ architectures demonstrate strong multispectral performance (AUPRC up to 0.956) and statistically significant improvements in SAR flood mapping when using shift-invariant loss and CVAE-based despeckling compared to classical filters. These results underscore the importance of dataset fidelity, misalignment-robust training, and demonstrate the viability of generative despeckling for operational flood mapping.

Momentum

Related topics

Latest papers 275