Multimodal

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

Focused topic

Multimodal Learning

Within Multimodal

456 papersExplore

Focused topic

Cross-Modal Learning

Within Multimodal

432 papersExplore

Focused topic

Multi-Modal Large Language Models

Within Multimodal

376 papersExplore

Focused topic

Multimodal Reasoning

Within Multimodal

224 papersExplore

Focused topic

Multimodal Benchmarks

Within Multimodal

171 papersExplore

Focused topic

Unified Multimodal Models

Within Multimodal

100 papersExplore

Focused topic

Cross-Modal Attention

Within Multimodal

75 papersExplore

Focused topic

Input Modality

Within Multimodal

73 papersExplore

Focused topic

Modality Gap

Within Multimodal

73 papersExplore

Focused topic

Multimodal Generation

Within Multimodal

73 papersExplore

Focused topic

Cross-Modal Alignment

Within Multimodal

66 papersExplore

Focused topic

Video Multimodal Large Language Models

Within Multimodal

58 papersExplore

1,965 papers

Latest in Multimodal

Browse all topics →

DPG-CD: Depth-Prior-Guided Cross-Modal Joint 2D-3D Change Detection
May 8, 2026Luqi Zhang, Zhen Dong, Bisheng YangChange Detection Multimodal Fusion
Fine-tuning a vision-language model for fracture-surface morphology recognition
May 8, 2026Quanliang Liu, Jungtaek Kim, Kangwook Lee +1Vision-Language Multimodal Reasoning
Do Joint Audio-Video Generation Models Understand Physics?
May 8, 2026Zijun Cui, Xiulong Liu, Hao Fang +8Joint Audio-Video Generation Audio-Visual Consistency
MIST: Multimodal Interactive Speech-based Tool-calling Conversational Assistants for Smart Homes
May 7, 2026Maximillian Chen, Xuanming Zhang, Michael Peng +3Voice Agents Smart Homes
McNdroid: A Longitudinal Multimodal Benchmark for Robust Drift Detection in Android Malware
May 7, 2026Md Mahmuduzzaman Kamol, Jesus Lopez, Saeefa Rubaiyet Nowmi +5Malware Families Huawei
Are We Making Progress in Multimodal Domain Generalization? A Comprehensive Benchmark Study
May 7, 2026Hao Dong, Hongzhao Li, Shupan Li +3Multimodal Domain Generalization Multimodal Benchmarks
Cross-Modal Navigation with Multi-Agent Reinforcement Learning
May 7, 2026Shuo Liu, Xinzichen Li, Christopher AmatoMultimodal Agents Multi-Agent Reinforcement Learning
MINER: Mining Multimodal Internal Representation for Efficient Retrieval
May 7, 2026Weien Li, Rui Song, Zeyu Li +8Retrieval Layer Multimodal Retrieval
From Review to Design: Ethical Multimodal Driver Monitoring Systems for Risk Mitigation, Incident Response, and Accountability in Automated Vehicles
May 7, 2026Bilal Khana, Waseem Shariff, Rory Coyne +2Autonomous Driving Ethics
Debiased Multimodal Personality Understanding through Dual Causal Intervention
May 7, 2026Yangfu Zhu, Zitong Han, Nianwen Ning +4Personality Causal Intervention
Attributions All the Way Down? The Metagame of Interpretability
May 7, 2026Hubert Baniecki, Przemyslaw Biecek, Fabian FumagalliModel Interpretability Game Theory
Data Language Models: A New Foundation Model Class for Tabular Data
May 7, 2026Eda Erol, Giuliano Pezzoli, Ozer Cem KelahmetTabular Learning Tabular Data
Band Together: Untargeted Adversarial Training with Multimodal Coordination against Evasion-based Promotion Attacks
May 7, 2026Guanmeng Xian, Ning Yang, Philip S. YuAdversarial Transferability Adversarial Training
CrossCult-KIBench: A Benchmark for Cross-Cultural Knowledge Insertion in MLLMs
May 7, 2026Zhen Zeng, Leijiang Gu, Feng Li +2Cross-Cultural Study Multi-Modal Large Language Models
Boosting Self-Supervised Tracking with Contextual Prompts and Noise Learning
May 7, 2026Yaozong Zheng, Qihua Liang, Bineng Zhong +4Self-Supervised Multi-Object Tracking
Revisiting Uncertainty: On Evidential Learning for Partially Relevant Video Retrieval
May 7, 2026Jun Li, Peifeng Lai, Xuhang Lou +5Videos Multimodal Retrieval
PRISM: Iterative Cross-Modal Posterior Refinement for Dynamic Text-Attributed Graphs
May 7, 2026Trimble Chang, Yihang Liu, Mingjing Han +1Text-Attributed Graph Cross-Modal Learning
T2I-VeRW: Part-level Fine-grained Perception for Text-to-Image Vehicle Retrieval
May 7, 2026Xiao Wang, Ziwen Wang, Weizhe Kong +5Re-Identification Composed Image Retrieval
When Language Overwrites Vision: Over-Alignment and Geometric Debiasing in Vision-Language Models
May 7, 2026Harshvardhan Saini, Samyak Jha, Yiming Tang +1Large Language Model Hallucination Hallucination Mitigation
TableVista: Benchmarking Multimodal Table Reasoning under Visual and Structural Complexity
May 7, 2026Zheyuan Yang, Liqiang Shang, Junjie Chen +6Multimodal Learning Vista
ICU-Bench:Benchmarking Continual Unlearning in Multimodal Large Language Models
May 7, 2026Yuhang Wang, Wenjie Mei, Junkai Zhang +3Large Language Model Unlearning Robust Multimodal Learning
Minimizing Modality Gap from the Input Side: Your Speech LLM Can Be a Prosody-Aware Text LLM
May 7, 2026Wenqian Cui, Xiao-Hui Li, Daxin Tan +2Speech Large Language Models Speech Encoder
Null Space Constrained Contrastive Visual Forgetting for MLLM Unlearning
May 7, 2026Yuhang Wang, Zhenxing Niu, Haoxuan Ji +3Catastrophic Forgetting Multimodal Learning
Training-Free Dense Hand Contact Estimation with Multi-Modal Large Language Models
May 7, 2026Daniel Sungho Jung, Kyoung Mu Lee3D Hand Multi-Modal Large Language Models
Align3D-AD: Cross-Modal Feature Alignment and Dual-Prompt Learning for Zero-shot 3D Anomaly Detection
May 7, 2026Letian Bai, Xuanming Cao, Juan Du +1Zero-Shot Anomaly Detection 3D Object Understanding
Steering Visual Generation in Unified Multimodal Models with Understanding Supervision
May 7, 2026Zeyu Liu, Zanlin Ni, Yang Yue +5Unified Multimodal Models LLM Post-Training Methods
Adaptive Physical-Facial Representation Fusion via Subject-Invariant Cross-Modal Prompt Tuning for Video-Based Emotion Recognition
May 7, 2026Xiwen Luo, Jia Li, Rencheng Song +2Emotion Recognition Remote Photoplethysmography
The Cost of Context: Mitigating Textual Bias in Multimodal Retrieval-Augmented Generation
May 7, 2026Hoin Jung, Xiaoqian WangMulti-Source Retrieval-Augmented Generation Multi-Modal Large Language Models
Causal Probing for Internal Visual Representations in Multimodal Large Language Models
May 7, 2026Zehao Deng, Tianjie Ju, Zheng Wu +5Visual Representations Multimodal Learning
AstroAlertBench: Evaluating the Accuracy, Reasoning, and Honesty of Multimodal LLMs in Astronomical Classification
May 7, 2026Claire Chen, Jiabao Sean Xiao, Shuze Daniel Liu +7Multimodal Benchmarks Multimodal Classification
Text-to-CAD Retrieval: a Strong Baseline
May 7, 2026Honghu Pan, Zibo Du, Daxiang Liu +2Text-To-Cad Computer-Aided Design
Direct Product Flow Matching: Decoupling Radial and Angular Dynamics for Few-Shot Adaptation
May 6, 2026Hongxu Chen, Yanghao Wang, Bowei Zhu +6Few-Shot Learning Cross-Modal Alignment
ICPR 2026 Competition on Privacy-Preserving Person Re-Identification from Top-View RGB-Depth Camera (TVRID)
May 6, 2026Raphaël Delécluse, Hazem Wannous, Laurent GuimasRe-Identification Rgb-Depth Cameras
HNC: Leveraging Hard Negative Captions towards Models with Fine-Grained Visual-Linguistic Comprehension Capabilities
May 6, 2026Esra Dönmez, Pascal Tilli, Hsiu-Yu Yang +2Image-Text Pairs Fine-Grained Perception
To Fuse or to Drop? Dual-Path Learning for Resolving Modality Conflicts in Multimodal Emotion Recognition
May 6, 2026Yangchen Yu, Qian Chen, Jia Li +5Emotion Recognition Cross-Modal Learning
Benchmarking LLMs on the Massive Sound Embedding Benchmark (MSEB)
May 6, 2026Cyril Allauzen, Tom Bagby, Georg Heigold +2Large Audio Language Models Audio Latent
JASTIN: Aligning LLMs for Zero-Shot Audio and Speech Evaluation via Natural Language Instructions
May 6, 2026Leying Zhang, Bowen Shi, Haibin Wu +2Speech Evaluation Instruction-Tuned Models
DiffCap-Bench: A Comprehensive, Challenging, Robust Benchmark for Image Difference Captioning
May 6, 2026Yuancheng Wei, Haojie Zhang, Linli Yao +7Remote Sensing Image Change Captioning Multimodal Benchmarks
Information Coordination as a Bridge: A Neuro-Symbolic Architecture for Reliable Autonomous Driving Scene Understanding
May 6, 2026Shuo Liu, Lei Shi, Haowen Liu +3Autonomous Driving Collaborative Perception
A cross-modal network for facial expression recognition
May 6, 2026Chunwei Tian, Jingyuan Xie, Qi Zhang +3Facial Expression Recognition Multimodal Deep Learning
UnAC: Adaptive Visual Prompting with Abstraction and Stepwise Checking for Complex Multimodal Reasoning
May 5, 2026Yifan Wang, Yun FuMultimodal Reasoning Universal Multimodal
CC-OCR V2: Benchmarking Large Multimodal Models for Literacy in Real-world Document Processing
May 5, 2026Zhipeng Xu, Junhao Ji, Zulong Chen +10Optical Character Recognition Deepseek-Ocr
JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation
May 5, 2026Lin Song, Wenbo Li, Guoqing Ma +16Universal Multimodal Text-To-Image
RoboAlign-R1: Distilled Multimodal Reward Alignment for Robot Video World Models
May 5, 2026Hao Wu, Yuqi Li, Yuan Gao +10Video World Models LLM Post-Training Methods
Multimodal Learning on Low-Quality Data with Conformal Predictive Self-Calibration
May 5, 2026Xun Jiang, Yufan Gu, Disen Hu +5Robust Multimodal Learning Conformal Prediction
A Robust Unsupervised Domain Adaptation Framework for Medical Image Classification Using RKHS-MMD
May 5, 2026Sapna Sachan, Rakesh Kumar Sanodiya, Amulya Kumar MahtoMedical Image Classification Domain Adaptation
Unified Multimodal Visual Tracking with Dual Mixture-of-Experts
May 5, 2026Lingyi Hong, Jinglun Li, Xinyu Zhou +6Multi-Object Tracking Multimodal Fusion
MILE: Mixture of Incremental LoRA Experts for Continual Semantic Segmentation across Domains and Modalities
May 5, 2026Shishir Muralidhara, Didier Stricker, René SchusterLow-Rank Adaptation Multimodal Benchmarks
Information Density as a Quantitative Measure for AI-enabled Virtual Sensing: Feasibility and Limits
May 5, 2026Hrishikesh Dutta, Roberto Minerva, Reza Farahbakhsh +1Sparse Recovery Urban Environments
MHPR: Multidimensional Human Perception and Reasoning Benchmark for Large Vision-Languate Models
May 5, 2026Kangkang Wang, Qinting Jiang, Wanping Zhang +2Multimodal Reasoning Benchmarks Large Vision Language Models
MASRA: MLLM-Assisted Semantic-Relational Consistent Alignment for Video Temporal Grounding
May 5, 2026Ran Ran, Jiwei Wei, Shuchang Zhou +5Video Temporal Grounding Cross-Modal Alignment
ReasonAudio: A Benchmark for Evaluating Reasoning Beyond Matching in Text-Audio Retrieval
May 5, 2026Honglei Zhang, Yuting Chen, Chenpeng Hu +2Audio Reasoning Benchmark
A-CODE: Fully Atomic Protein Co-Design with Unified Multimodal Diffusion
May 5, 2026Chaoran Cheng, Jiaqi Guan, Milong Ren +5Protein Design Molecular Generation
Can Multimodal Large Language Models Understand Pathologic Movements? A Pilot Study on Seizure Semiology
May 5, 2026Lina Zhang, Tonmoy Monsoor, Mehmet Efe Lorasdagi +8Interictal Epileptiform Discharges Multi-Modal Large Language Models
Stable Multimodal Graph Unlearning via Feature-Dimension Aware Quantile Selection
May 5, 2026Jingjing Zhou, Yongshuai Yang, Qing Qing +5Federated Graph Learning Graph Foundation Model
VEBench:Benchmarking Large Multimodal Models for Real-World Video Editing
May 5, 2026Andong Deng, Dawei Du, Zhenfang Chen +7Video Editing Multimodal Learning
RLDX-1 Technical Report
May 5, 2026Dongyoung Kim, Huiwon Jang, Myungkyu Koo +65Generalizable Robotic Manipulations Vision-Language-Action Models
Sentinel2Cap: A Human-Annotated Benchmark Dataset for Multimodal Remote Sensing Image Captioning
May 4, 2026Lucrezia Tosato, Gianluca Lombardi, Ronny HanschRemote Sensing Image Change Captioning Remote Sensing
LiDAR Teach, Radar Repeat: Robust Cross-Modal Navigation in Degenerate and Varying Environments
May 4, 2026Renxiang Xiao, Yichen Chen, Yuanfan Zhang +5Lidar Light Detection And Ranging
MULTITEXTEDIT: Benchmarking Cross-Lingual Degradation in Text-in-Image Editing
May 4, 2026Liwei Cheng, Shibo Feng, Lunjie Zhou +2Multilingual Benchmark Cross-Lingual Consistency

May 8, 2026 · cs.CVJ/K move · Enter open · S save

DPG-CD: Depth-Prior-Guided Cross-Modal Joint 2D-3D Change Detection

Luqi Zhang, Zhen Dong, Bisheng Yang

State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, No.129, Luoyu Road, Wuhan, Hubei, 430079, China

Urban spatial evolution is manifested not only through horizontal expansion but also through vertical structural changes. Consequently, jointly capturing 2D semantic changes and 3D height changes is essential for urban morphology analysis and emergency management. In practical scenarios, collecting 3D observations is often constrained by high acquisition costs and the inability to support frequent updates. The multi-temporal cross-modal input consisting of pre-event Digital Surface Model (DSM) and post-event imagery provides a practical solution for 3D change detection in high-frequency urban monitoring, disaster assessment, and emergency response scenarios. However, this setting remains challenging as imagery and DSM data exhibit significant spectral-geometric representation gaps. Moreover, modality differences may be confused with actual changes, and robust change detection requires effective fusion of semantic and geometric features from multi-temporal data. In this paper, we propose DPG-CD, a depth-prior-guided multi-temporal cross-modal fusion framework for joint 2D semantic and 3D height change detection. Specifically, an estimated depth prior is introduced into the imagery to mitigate the modality gap with DSM. A gated fusion mechanism then selectively injects geometric cues from depth prior while preserving discriminative spectral representations. Subsequently, a multi-stage cross-temporal cross-modal feature fusion architecture is employed to extract change-aware features. Finally, a multi-task decoder jointly predicts 2D semantic changes and 3D height changes, complemented by an auxiliary DSM prediction task to improve structural consistency and height estimation accuracy. Experiments on two public datasets, Hi-BCD and 3DCD, and a new dataset, NYC-MMCD, demonstrate that DPG-CD outperforms state-of-the-art methods on both 2D and 3D change detection tasks.

Change Detection Multimodal Fusion Cross-Modal Learning Urban Environments Change

Open paper Ask about it PDF