Multimodal

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

Focused topic

Multimodal Learning

Within Multimodal

456 papersExplore

Focused topic

Cross-Modal Learning

Within Multimodal

432 papersExplore

Focused topic

Multi-Modal Large Language Models

Within Multimodal

376 papersExplore

Focused topic

Multimodal Reasoning

Within Multimodal

224 papersExplore

Focused topic

Multimodal Benchmarks

Within Multimodal

171 papersExplore

Focused topic

Unified Multimodal Models

Within Multimodal

100 papersExplore

Focused topic

Cross-Modal Attention

Within Multimodal

75 papersExplore

Focused topic

Input Modality

Within Multimodal

73 papersExplore

Focused topic

Modality Gap

Within Multimodal

73 papersExplore

Focused topic

Multimodal Generation

Within Multimodal

73 papersExplore

Focused topic

Cross-Modal Alignment

Within Multimodal

66 papersExplore

Focused topic

Video Multimodal Large Language Models

Within Multimodal

58 papersExplore

1,965 papers

Latest in Multimodal

Browse all topics →

MAG: MAnifold Guided Semi-Supervised Multi-modal In-Context Learning
Aug 13, 2026Zirui Cheng, Xun Xu, Tiankai Chen +7Multi-Modal Large Language Models Robust Multimodal Learning
The Role of Natural Language Understanding in Multimodal Video-Based Dengue Diagnosis
Aug 13, 2026Danial Sharifrazi, Saadat Behzadi, Julakha Jahan Jui +5Malaria Disease Detection
Diagram-MMU: A Multi-Modal Benchmark for Scientific Diagrams
Aug 12, 2026Weihao Bo, Shan Zhang, Yanpeng Sun +7Diagrams Multimodal Benchmarks
Generation as Auxiliary Supervision: Enhancing Visual Understanding at Zero Inference Overhead via Decoupled Embedding Prediction
Aug 12, 2026Zhongbin Guo, Jiahao Xie, Dongling Xiao +5Cross-Modal Learning Process-Level Supervision
Context Blindness in DPO: Mitigating Object Hallucination in MLLMs via Context-Calibrated Preference Optimization
Aug 12, 2026Byungoh Ko, Jinyoung Park, Jongha Kim +3Large Language Model Hallucination Hallucination Mitigation
Do You See What You Draw? A Semantic Closed-Loop Framework for Holistic Evaluation of Unified Multimodal Models
Aug 12, 2026Hao Zhang, Jiaxin Qi, Zhijiang Tang +1Unified Multimodal Models Visual Generation
Warping Earth Observations for better ice labeling in the Marginal Marginal Ice Zone
Aug 12, 2026Tom Kelly, Martin S. J. RogersSatellite Data Remote Sensing Image Segmentation
GeoBridge: Decoupled Semantic Conditioning for Generative Image Geolocalization
Aug 12, 2026Zhiyang Dou, Xumeng Han, Fengde Peng +4Image Geolocalization Geometry-Aware Foundation Model
LEMUR: Latent Entropy-aware Multimodal Unlearning via Visual-anchored Reasoning Redirection
Aug 12, 2026Xinhao Zhong, Yuxia Qiao, Junhao Li +3Efficient Latent Reasoning Unlearning Aims
Learning from Multimodal Pseudo-Labels for Robust Open-Vocabulary Instance and Panoptic Segmentation
Aug 12, 2026Duy Tran Thanh, Yeejin Lee, Byeongkeun KangPanoptic Segmentation Open-Vocabulary
Motion-as-Prompt: Enhancing Motion Reasoning in Multimodal Large Language Models via Motion-Guided Cross-Frame Visual Prompting
Aug 12, 2026Xikai Sun, Kebin Liu, Haotian Wang +3Video Multimodal Large Language Models Multimodal Learning
MBA: Multimodal Benchmark and Agents for Real-World Business Ideation
Aug 12, 2026Hojun Choi, Jaeyo Shin, Suin Lee +1Multimodal Agents Multimodal Benchmarks
ProtoHGF-Net: Prototype HyperGraph Fusion with Intra-modal Calibration for RGBT Object Detection
Aug 12, 2026Xiangqi Chen, Xiuling Zhang, Chengzhuan Yang +7Rgbt Object Detection
CookVoice: Unified Framework for Style Controllable Multi-Modal Human Voice Generation
Aug 12, 2026Haowei Lou, Hye-Young Paik, Dai Jia +2Singing Voice Conversion Joint Audio-Video Generation
Dual-Domain Cross-Modal Decoding for Clinical Text-Guided Medical Image Segmentation
Aug 11, 2026Md Maklachur Rahman, Tracy HammondMedical Image Segmentation Multimodal Clinical Data
MultiModal Code-Switching: Interleaving Visual Objects into Language for Explicit Object-Level Alignment
Aug 11, 2026Changhao Xiang, Shangyu Xing, Zhen Wu +2Multimodal Pretraining Modality Alignment
PRMU: A Corpus-Free Benchmark for Person-Centric Knowledge Unlearning in Multimodal Large Language Models
Aug 11, 2026Huafeng Chen, Yueming Lyu, Ziyuan Chen +4Large Language Model Unlearning Multi-Modal Large Language Models
Watching Synthetic Videos: Aligning Cross-modal Representations with Visual Synthesis for Zero-shot Video Captioning
Aug 11, 2026Liangyu Fu, Junbo Wang, Yuke Li +3Text-To-Video Models Video Captioning
On the Limitations of Cross-Lingual Consistency in Multilingual Text-to-image Generation
Aug 11, 2026Sicheng Zhang, Zhonghao Yan, Binzhu Xie +4Cross-Lingual Consistency Text-To-Image
TimeRoute: Time-Aware Modality Routing and Diffusion for Multi-Modal Recommendation
Aug 11, 2026Pengyu Zhang, Yangqin Jiang, Klim Zaporojets +2Multimodal Recommendation Input Modality
Evidence-Grounded Trustworthy Multimodal Reasoning and Evaluation Benchmark in Complex Urban Scenes
Aug 11, 2026Zhaoyang Wei, Bowen Jiang, Xumeng Han +6Multimodal Reasoning Visual Reasoning
ProTAGAD: A Foundation Model for TAG Anomaly Detection with Decoupled Topological and Textual Prototypes
Aug 11, 2026Ziyan Wang, Liwen Wu, Cheng Xie +3Generalist Graph Anomaly Detection Text-Attributed Graph
Bridging Severe Cross-Modal Misalignment: End-to-End Visible-Infrared Object Detection via Explicit Feature-Domain Affine Registration
Aug 11, 2026Qi Ming, Yuyang Wang, Mingjing Zhao +7Infrared Small Target Detection Object Detection
VERDICT: Training-Free Step-Wise Verification of Multimodal Reasoning via Disagreement-Aware Consensus
Aug 11, 2026Rohit Sinha, Kunal Tilaganji, Tanuja Ganu +3Verification-Triggered Multimodal Multimodal Reasoning
DINO-A: Adapting Self-Distillation Vision Transformers to General Audio Representation Learning
Aug 11, 2026Tomasz Radzikowski, Mateusz Modrzejewski, Przemysław RokitaAudio Latent Dino
Rethinking Text-Based Image Retrieval in Specific Domain
Aug 11, 2026Jingyang Tan, Sheng Yang, Yuanpeng Chen +4Fine-Grained Perception Multimodal Retrieval
When Vision Becomes Text: Visual Token Pruning via Cross-Modal Residual Guidance in VLMs
Aug 11, 2026Congyang Ou, Ruike Song, Yang Zhou +3Visual Token Pruning Cross-Modal Learning
Rationale-Guided Learning for Multimodal Emotion Recognition
Aug 11, 2026Sujung Oh, Jung Uk Kim, Sangmin LeeEmotion Recognition Multimodal Reasoning
UniMod: Enhancing Multi-Modal Medical Diagnosis through Cross-Modality and Within-Modality Alignment
Aug 10, 2026Zijian Gu, Weikai Lin, Shuang Zhou +2Multimodal Clinical Data Cross-Modality
Multimodal Item Parameter Estimation using Simulated Response Probabilitie
Aug 10, 2026Christopher Ormerod, YoungKoung KimItem Response Theory Multiple-Choice Questions
Multimodal Model Diffing for Feature Discovery and Control
Aug 10, 2026Hunar Batra, Lachin Naghashyar, Ashkan Khakzar +4Multi-Modal Large Language Models
DistMoE: Private-data Rehearsal-free Routing in Mixture-of-Experts for Distributed Instruction Tuning
Aug 10, 2026Mainak Singha, Niccolò Biondi, Elisa Ricci +1Multimodal Instruction Tuning Mixture-of-Experts Models
PragMatch: Separating Pragmatic Incongruity from Cross-Modal Mismatch in Large Vision-Language Models
Aug 10, 2026Zhanna Mukhametsharip, Vera Demberg, Varsha SureshLarge Vision Language Models Humor
Hallucination-Free GUI Grounding via Regression-Free Layout-Aware Matching
Aug 10, 2026Yuke Li, Xuehan HouGraphical User Interface Layouts
TeaMatch: Teachable Cross-Modal Representation Learning for 2D-3D Matching
Aug 10, 2026Chongjian Wang, Junjie GaoCross-Modal Learning Teaming
Hyperbolic Multimodal Continual Learning
Aug 10, 2026Jiahong Liu, Ming Shen, Xiaohao Liu +4Efficient Continual Learning Continual Learning Methods
Towards Expressive and Faithful Audio-to-Image Generation: A Unified Multimodal Dataset and Synthesis Framework
Aug 10, 2026Dongxu Ge, Shansong Liu, Cheng Gong +3Joint Audio-Video Generation Audio-Visual Consistency
MMArch: Benchmarking Multimodal Reasoning Grounded in Architectural Evidence
Aug 10, 2026Chenxu Du, Kang An, Tengyue Wang +8Multimodal Reasoning
GRASP: Granularity-Aware Region Alignment and Semantic Prototype Learning for Fine-Grained Cross-Modal Understanding in Drone Views
Aug 10, 2026Jiahui Cui, Yan Zhao, Kan Wei +4Aerial Vision-Language Navigation Cross-Modal Learning
SafeSceneReason: A Multimodal Reasoning Benchmark Connecting Industrial Hazards with Accident Knowledge
Aug 10, 2026Yuanchi Zhu, Kang An, Tengyue Wang +11Multimodal Reasoning Benchmarks Multimodal Reasoning
Omni2LoRA: Coherence-Preserving Parametric Memory for Efficient Omni Language Models
Aug 10, 2026Puneet Mathur, Manan Suri, Dinesh ManochaMulti-Modal Large Language Models Omni
Right Answer, Wrong Heat: Explanation-Aware Evaluation and Thermal-Grounded Feedback for MLLMs on Infrared Images
Aug 10, 2026Yongsong Huang, Xiaofeng Liu, Tomo Miyazaki +2Multi-Modal Large Language Models Infrared
Visual Distortion Detection in UGC Images Using Large Multimodal Models
Aug 10, 2026Ziheng Jia, Yingji Liang, Jiaying Qian +1Synthetic Image Detection Distortion
MELLON - Multimodal Enhanced LLM for Online Navigation
Aug 10, 2026Ruiyu Li, Haoyang Cai, Zhitong Guo +1Web Agents Multi-Modal Large Language Models
GeoUniPR: A Geometry-Consistent Unified Framework for Cross-Modal Place Recognition
Aug 10, 2026Wonbong Kim, Jiatong Xiao, Rui Li +5Visual Place Recognition Lidar
Investigating Multimodal Informativity under Different Partner Visibility Conditions in Video-Mediated Dialogue
Aug 9, 2026Esam Ghaleb, Hugh Mee Wong, Kristina KobrockMultimodal Learning Visibility
TomaMMU: A Comprehensive Multimodal Understanding Benchmark for Tomato Leaf Diseases
Aug 9, 2026Gia-Han Truong, Khang Nguyen Quoc, Luyl-Da QuachApple Tree Leaf Disease Segmentation Dataset Tomato Diseases
UniSpace: Unified Visual Representation and Scalable Multimodal Modeling
Aug 9, 2026Jinbo Yan, Limeng Qiao, Jie Qin +3Unified Multimodal Models Self-Supervised Vision Transformers
Discovering Diverse Planning Policies for Multimodal Embodied Agents with Quality-Diversity Optimization
Aug 9, 2026Pengfei Xu, Yong Liu, Xiaoya Nan +2Classical Planning Multimodal Agents
EsaacSim: A Multimodal Event Camera Add-on for NVIDIA Isaac Sim
Aug 9, 2026Ignacio Bugueno-Cordova, Malte Kuhlmann, Nicolás Navarro-Guerrero +2Nvidia Isaac Sim Multimodal Learning
From Speech to Interaction: Analyzing Multimodal Systems in Cocktail-Party Scenarios
Aug 9, 2026Thai-Binh Nguyen, Zhaolin Li, Jan Niehues +1Speech Separation Multimodal Learning
Aero Realtime: Fully Aligned Input-Output Streams for Low-Latency Streaming Multimodal Generation
Aug 9, 2026Kaichen Zhang, Wei Huang, Keming Wu +2Multimodal Generation Joint Audio-Video Generation
StructReward: Efficient Structured Process Rewards for Self-Correcting Multimodal Reasoning
Aug 8, 2026Yifan Li, Ruxin Sun, Tongzhou ZhaoReliable Medical Process-Level Reward Model Evaluation Framework Multimodal Reasoning
NeuPAT: Neuron-aware Plasticity Allocation Tuning for Language-Preserving MLLMs
Aug 8, 2026Jiayue Jin, Jingwei Zhang, Chen Wang +2Large Language Model Adaptation Multi-Modal Large Language Models
ZOMP: Zeroth-Order Multi-Modal Prompt Tuning for Vision-Language Models
Aug 8, 2026Sajjad Ghiasvand, Yifan Yang, Mahnoosh Alizadeh +1Prompt Tuning Few-Shot Contrastive Language-Image Pre-Training Adaptation
Evidence-Grounded Forensic Reasoning for Detecting and Grounding Multi-Modal Media Manipulation
Aug 8, 2026Yichun Yeh, Yiheng Li, Xiaobo Hu +2Fake News Detection Multimodal Reasoning
Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoning
Aug 8, 2026Shi-Yu Tian, Zhuo-Xia Wang, Xuan-Yi Zhu +6Spatial Reasoning Neuro-Symbolic Framework
TongGuOCR: A Layout-Aware and Token-Augmented OCR MLLM for Chinese Historical Documents
Aug 8, 2026Zhongheng Zhou, Yi Sun, Huiguo He +6Optical Character Recognition Longbench
Vision-Language Grounding as Bidirectional Concept Correspondence
Aug 8, 2026Jieyu Zhang, Ziqi Gao, Luke Zettlemoyer +1Vision-Language Model Grounding Vision-Language Alignment
CONFER: Conflict-Aware Evidence Negotiation for Regime-Calibrated Weak Supervision in Multimodal Emotion Recognition
Aug 8, 2026Bojing Hou, Ruohao Li, Yitong Zhu +2Emotion Recognition Robust Multimodal Learning

Aug 13, 2026 · cs.LGJ/K move · Enter open · S save

MAG: MAnifold Guided Semi-Supervised Multi-modal In-Context Learning

Zirui Cheng, Xun Xu, Tiankai Chen, Fady Rezk+6

College of Design and Engineering, National University of Singapore · Institute for Infocomm Research, ASTAR, Singapore

Few-shot in-context learning (ICL) with multi-modal large language models (MLLMs) enables task adaptation without parameter updates, but its performance is highly sensitive to the quality and coverage of the selected demonstrations. While unlabeled multi-modal data is abundant, it remains elusive how to exploit them for ICL. We propose MAG (MAnifold-Guided semi-supervised in-context demonstra- tion selection), an efficient framework that leverages unlabeled data to improve multi-modal ICL. MAG formulates demonstration selection as a semi-supervised propagation problem on a multi-modal graph and adopts a two-stage strategy: (i) relevance score propagation identifies a compact set of high-impact unlabeled samples for pseudo-labeling, reducing MLLM inference cost; (ii) multi-modal relevance is used to select the final demonstrations. We show that textual represen- tations are more effective for relevance propagation, while both visual and textual modalities are crucial for high-quality demonstration selection. Experiments on eight multi-modal benchmarks demonstrate that MAG consistently outperforms strong baselines in label-scarce regimes, achieving significant gains with a limited pseudo-labeling budget.

Multi-Modal Large Language Models Robust Multimodal Learning In-Context Learning Few-Shot Learning LLM Inference Efficiency Relevance

Open paper Ask about it PDF