Cross-Modal Fusion

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

15 new papers

A weekly snapshot of new work published in Cross-Modal Fusion.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Cross-Modal Fusion.

Inside this field

Focused directions

Focused topic

Fusion

Within Cross-Modal Fusion

174 papersExplore

Focused topic

Multimodal Fusion

Within Cross-Modal Fusion

126 papersExplore

Focused topic

Temporal Fusion Transformer

Within Cross-Modal Fusion

60 papersExplore

Focused topic

Visible Image Fusion

Within Cross-Modal Fusion

52 papersExplore

Focused topic

Cross-Modal Fusion

Within Cross-Modal Fusion

42 papersExplore

Focused topic

Feature Fusion

Within Cross-Modal Fusion

36 papersExplore

Focused topic

Infrared-Visible Image Fusion

Within Cross-Modal Fusion

28 papersExplore

451 papers

Latest in Cross-Modal Fusion

Browse all topics →

Partial Fusion of Neural Networks: Efficient Tradeoffs Between Ensembles and Weight Aggregation
May 21, 2026Fabian Morelli, Stephan EcksteinNeural Network Ensemble
Thermo-VL: Extending Vision-Language Models to Thermal Infrared Perception
May 21, 2026Rusiru Thushara, Yasiru Ranasinghe, Jay Paranjape +1Large Vision Language Models Visible Image Fusion
ProtoPathway: Biologically Structured Prototype-Pathway Fusion for Multimodal Cancer Survival Prediction
May 20, 2026Amaya Gallagher-Syed, Costantino Pitzalis, Myles J. Lewis +2Cancer Genome Atlas Multimodal Clinical Data
ReMATF: Recurrent Motion-Adaptive Multi-scale Turbulence Mitigation for Dynamic Scenes
May 20, 2026Zhiming Liu, Zhicheng Zou, Nantheera AnantrasirichaiTurbulence Video Quality
Deformba: Vision State Space Model with Adaptive State Fusion
May 20, 2026Hongyu Ke, Jack Morris, Yongkang Liu +4Self-Supervised Vision Transformers Progressive Attention Fusion
LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation
May 20, 2026Daojie Peng, Bingtao Wang, Fulong Ma +2Dense Semantic Segmentation Lidar
USV: Towards Understanding the User-generated Short-form Videos
May 20, 2026Haoyue Cheng, Su Xu, Liwei Jin +3Fine-Grained Video Understanding Video Dataset
FusionSense: Tri-Stage Near-Sensor Learning for Runtime-Adaptive Multimodal Edge Intelligence
May 19, 2026Sanggeon Yun, Ryozo Masukawa, Minhyoung Na +5Multi-Sensor Fusion Multi-Modal Sensing
Tippett-minimum Fusion of Representation-space Diffusion Models for Multi-Encoder Out-of-Distribution Detection
May 19, 2026Neelkamal BhuyanOut-Of-Distribution Detection Out-Of-Distribution
Stage-adaptive Token Selection for Efficient Omni-modal LLMs
May 19, 2026Zijie Xin, Jie Yang, Ruixiang Zhao +4Audio Tokens Cross-Modal Fusion
Rad-VLSM: A Cross-Modal Framework with Semantics-Assisted Prompting for Medical Segmentation and Diagnosis
May 18, 2026Fengyi Zhang, Xujie Zeng, Mohan Liu +2Lesion Medical Image Segmentation
Error-Decomposed Class-Conditional Fusion for Statistically Guaranteed Hard-Category Robust Perception
May 17, 2026Guowei Luo, Ziqi Shi, Zhao XieRobust Perception Fusion
Tactile-based Multimodal Fusion in Embodied Intelligence: A Survey of Vision, Language, and Contact-Driven Paradigms
May 17, 2026Zhixiang Cao, Di Tian, Runwei Guan +11Tactile Perception Multimodal Fusion
Metric-Guided Feature Fusion of Visual Foundation Models for Segmentation Tasks
May 16, 2026Yachan Guo, JoseLuis Gomez Zurita, Danna Xue +2Dense Prediction Feature Fusion
MedMIX: Modality-Internal Expert Fusion for Multimodal Medical Diagnosis
May 15, 2026Seungik Cho, Anqi Li, Wei QiuMultimodal Clinical Data Missing Modalities
Federated Imputation under Heterogeneous Feature Spaces
May 15, 2026Imane Hocine, Chaimaa Medjadji, Sylvain Kubler +2Federated Learning Imputation
BiomedAP: A Vision-Informed Dual-Anchor Framework with Gated Cross-Modal Fusion for Robust Medical Vision-Language Adaptation
May 15, 2026Huanyang Tong, Kai Liu, Fangjun Kuang +1Vision-Language Model Adaptation Multimodal Clinical Data
Multimodal Object Detection Under Sparse Forest-Canopy Occlusion
May 14, 2026Nitik Jain, Mangal KothariCanopy Light Detection And Ranging
HDRFace: Rethinking Face Restoration with High-Dimensional Representation
May 14, 2026Zirui Wang, Xianhui Lin, Yi Dong +7Blind Face Restoration Generative Priors
Vision-Core Guided Contrastive Learning for Balanced Multi-modal Prognosis Prediction of Stroke
May 14, 2026Liren Chen, Lidong Sun, Mingyan Huang +5Multimodal Fusion Stroke
VMU-Diff: A Coarse-to-fine Multi-source Data Fusion Framework for Precipitation Nowcasting
May 14, 2026Chunlei Shi, Hao Li, Yufeng Zhu +6Precipitation Temporal Fusion Transformer
Implicit spatial-frequency fusion of hyperspectral and lidar data via kolmogorov-arnold networks
May 14, 2026Zekun Long, Judy X. Yang, Jing Wang +3Frequency-Spatial Fusion Module Lidar
MuteBench: Modality Unavailability Tolerance Evaluation for Incomplete Multimodal Fusion
May 13, 2026Wugeng Zheng, Ziwen Kan, Tianlong Chen +2Missing Modalities Multimodal Fusion
Uncertainty-Driven Anomaly Detection for Psychotic Relapse Using Smartwatches: Forecasting and Multi-Task Learning Fusion
May 13, 2026Nikolaos Tsalkitzis, Panagiotis P. Filntisis, Petros Maragos +1Anomaly Detection Wearable Devices
NERVE: A Neuromorphic Vision and Radar Ensemble for Multi-Sensor Fusion Research
May 13, 2026Omar Mansour, Pietro Martinello, Ethan Milon +4Multi-Sensor Fusion Radar
Beyond VMAF: Towards Application-Specific Metrics for Teleoperation Video
May 13, 2026Ines Trautmannsheimer, Richard Grauberger, Frank DiermeyerVideo Quality Teleoperation
Efficient Sensor Fusion for Gesture Recognition on Resource-Constrained Devices
May 13, 2026Pietro Bartoli, Christian Veronesi, Tommaso Bondini +2Hand Gesture Recognition Multi-Sensor Fusion
Uncertainty-aware Spatial-Frequency Registration and Fusion for Infrared and Visible Images
May 13, 2026Xingyuan Li, Haoyuan Xu, Xingyue Zhu +4Visible Image Fusion Infrared-Visible Image Fusion
Multitask Multimodal Fusion with Tabular Foundation Models for Peak and Durability Prediction of Pertussis Booster Response
May 13, 2026Divya SitaniVaccination Opinion Dynamics Multimodal Fusion
FRAME: Forensic Routing and Adaptive Multi-path Evidence Fusion for Image Manipulation Detection
May 12, 2026Kaixiang Zhao, Tianrun Yu, Aoxu Zhang +3Multimedia Forensics Digital Forensics
TriBand-BEV: Real-Time LiDAR-Only 3D Pedestrian Detection via Height-Aware BEV and High-Resolution Feature Fusion
May 12, 2026Mohammad Khoshkdahan, Alexey Vinel3D Object Detection Bird'S-Eye View
Fused Gromov-Wasserstein Distance with Feature Selection
May 12, 2026Harlin Lee, Ying Yu, Mingxin Li +1Gromov--Wasserstein Feature Selection
Attention-Based Multimodal Survival Prediction with Cross-Modal Bilinear Fusion
May 12, 2026Hassan Keshvarikhojasteh, Josien P. W. Pluim, Mitko VetaSurvival Predictions Multimodal Clinical Data
Selection, Not Fusion: Radar-Modulated State Space Models for Radar-Camera Depth Estimation
May 12, 2026Zhangcheng Hou, Tomoaki OhtsukiVision-Radar Fusion Depth Estimation
SB-BEVFusion: Enhancing the Robustness against Sensor Malfunction and Corruptions
May 12, 2026Markus Essl, Marta Moscati, Mubashir Noman +4Multi-Sensor Fusion Multimodal Fusion
LatentHDR: Decoupling Exposure from Diffusion via Conditional Latent-to-Latent Mapping for Text/Image-to-Panoramic HDR
May 11, 2026Pedram Fekri, WenChen Li, William Chen +1High Dynamic Range Visible Image Fusion
Beyond the Last Layer: Multi-Layer Representation Fusion for Visual Tokenization
May 11, 2026Xuanyu Zhu, Yan Bai, Yang Shi +4Vision Encoders Visual Tokens
MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentation
May 11, 2026Ziyi Wang, Xianping Ma, Ziyao Wang +2Remote Sensing Image Segmentation Remote Sensing Image Change Captioning
ForceFlow: Learning to Feel and Act via Contact-Driven Flow Matching
May 11, 2026Shuoheng Zhang, Yifu Yuan, Hongyao Tang +7Ground Reaction Forces Contact Forces
Simultaneous Long-tailed Recognition and Multi-modal Fusion for Highly Imbalanced Multi-modal Data
May 11, 2026Heegeon Yoon, Heeyoung KimMultimodal Fusion Extreme Class Imbalance
PolarVSR: A Unified Framework and Benchmark for Continuous Space-Time Polarization Video Reconstruction
May 11, 2026Chenggong Li, Yidong Luo, Junchao Zhang +2Polarization Infrared-Visible Image Fusion
MUSDA: Multi-source Multi-modality Unsupervised Domain Adaptive 3D Object Detection for Autonomous Driving
May 11, 2026Xiaohu Lu, Hamed Khatounabadi, Hayder Radha3D Object Detection Autonomous Driving Perception
DCVD: Dual-Channel Cross-Modal Fusion for Joint Vulnerability Detection and Localization
May 10, 2026Wenxin Tang, Wenbin Li, Junliang Liu +10Vulnerability Detection & Repair Attack Detection
Adaptive 3D Convolution for Remote Sensing Image Fusion
May 10, 2026Siran Peng, Xiangyu Zhu, Shang-Qi Deng +2Visible Image Fusion Hyperspectral Imaging
Geometric Flood Depth Estimation: Fusing Transformer-Based Segmentation with Digital Elevation Models
May 8, 2026Nhut Le, Ehsan Karimi, Maryam RahnemoonfarAerial Imagery Sea-Surface Temperature Data
UMEDA: Unified Multi-modal Efficient Data Fusion for Privacy-Preserving Graph Federated Learning via Spectral-Gated Attention and Diffusion-Based Operator Alignment
May 8, 2026Shih-Yu Lai, Hirozumi Yamaguchi, Shang-Tse Chen +2Federated Learning Heterogeneous Edge Devices
TTF: Temporal Token Fusion for Efficient Video-Language Model
May 8, 2026Simin Huo, Ning LIVideo-Language Models Qwen3-Embedding-8B
DPG-CD: Depth-Prior-Guided Cross-Modal Joint 2D-3D Change Detection
May 8, 2026Luqi Zhang, Zhen Dong, Bisheng YangChange Detection Multimodal Fusion
Bringing Multimodal Large Language Models to Infrared-Visible Image Fusion Quality Assessment
May 7, 2026Yuchen Guo, Junli Gong, Yao Lu +3Visible Image Fusion Infrared-Visible Image Fusion
Dual-Scale Temporal Fusion Reveals Structured Predictability in Subseasonal-to-Seasonal Temperature Prediction
May 7, 2026Elnaz Bashir, Jiali Wang, Lin YanSpatio-Temporal Forecasting Spatiotemporal
Fusion in Your Way: Aligning Image Fusion with Heterogeneous Demands via Direct Preference Optimization
May 7, 2026Weijian Su, Songqian Zhang, Yuqi Han +3Visible Image Fusion Infrared-Visible Image Fusion
Adding Thermal Awareness to Visual Systems in Real-Time via Distilled Diffusion Models
May 7, 2026Yuchen Guo, Junli Gong, Wenjun Dong +2Visible Image Fusion Robust Perception
DART: A Vision-Language Foundation Model for Comprehensive Rope Condition Monitoring
May 6, 2026Anju Rani, Daniel Ortiz-Arroyo, Petar DurdevicInspection Vision Foundation Models
GTF: Omnidirectional EPI Transformer for Light Field Super-Resolution
May 6, 2026Kunyu Li, Fei Wang, Lichao Zhang +2Generative Super-Resolution Epipolar Structures
DALight-3D: A Lightweight 3D U-Net for Brain Tumor Segmentation from Multi-Modal MRI
May 6, 2026Nand Kumar Mishra, Dhruv Mishra, Dr Manu Pratap SinghBrain Tumor Segmentation U-Net
Audio-Visual Intelligence in Large Foundation Models
May 5, 2026You Qin, Kai Liu, Shengqiong Wu +12Audio-Visual Reasoning Multimodal Foundation Model
Unified Multimodal Visual Tracking with Dual Mixture-of-Experts
May 5, 2026Lingyi Hong, Jinglun Li, Xinyu Zhou +6Multi-Object Tracking Multimodal Fusion
RPBA-Net: An Interpretable Residual Pyramid Bilateral Affine Network for RAW-Domain ISP Enhancement
May 5, 2026Yucheng Xin, Wu Chen, Xiang Chen +7Image Processing Infrared-Visible Image Fusion
TemPose-TF-ASF: Two-Stage Bidirectional Stroke Context Fusion for Badminton Stroke Classification
May 4, 2026Tzu-Yu Liu, Duan-Shin LeeBadminton Multimodal Fusion
Momentum-Anchored Multi-Scale Fusion Model for Long-Tailed Chest X-Ray Classification
May 4, 2026Duy Hoang Khuong, Duy Nguyen Huu, Ngu Huynh Cong VietMedical Image Classification Chest X-Ray

May 21, 2026 · cs.LGJ/K move · Enter open · S save

Partial Fusion of Neural Networks: Efficient Tradeoffs Between Ensembles and Weight Aggregation

Fabian Morelli, Stephan Eckstein

Ensembles of neural networks typically outperform individual networks but incur large computational costs, whereas weight aggregation produces less costly, yet also less accurate, aggregate models. We introduce partial fusion of networks, which interpolates between ensembles and weight aggregation and thus allows for a flexible tradeoff between computational cost and performance. A direct way to achieve this is to extend existing weight aggregation methods based on neuron-level similarity between different networks, where partial fusion then only aggregates weights of neurons which are most similar. We showcase one particular method to jointly identify which neurons are most similar and match them via partial optimal transport. Further, we consider the more general perspective of weight aggregation and partial fusion as generalized pruning of ensemble models, where neurons cannot just be deleted, but also linearly combined. Finally, we show that generalized pruning applied to a single network yields similar benefits as partial fusion by allowing for a tradeoff between isolating, deleting, and linearly combining neurons based on similarity. Our code is available at https://github.com/Fabian-Mor/partial_fusion_nn.

Neural Network Ensemble Heterogeneous Pruning Scores Fusion Pruning Trade-Off

Open paper Ask about it PDF