Multimodal

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

Focused topic

Multimodal Learning

Within Multimodal

456 papersExplore

Focused topic

Cross-Modal Learning

Within Multimodal

432 papersExplore

Focused topic

Multi-Modal Large Language Models

Within Multimodal

376 papersExplore

Focused topic

Multimodal Reasoning

Within Multimodal

224 papersExplore

Focused topic

Multimodal Benchmarks

Within Multimodal

171 papersExplore

Focused topic

Unified Multimodal Models

Within Multimodal

100 papersExplore

Focused topic

Cross-Modal Attention

Within Multimodal

75 papersExplore

Focused topic

Input Modality

Within Multimodal

73 papersExplore

Focused topic

Modality Gap

Within Multimodal

73 papersExplore

Focused topic

Multimodal Generation

Within Multimodal

73 papersExplore

Focused topic

Cross-Modal Alignment

Within Multimodal

66 papersExplore

Focused topic

Video Multimodal Large Language Models

Within Multimodal

58 papersExplore

1,965 papers

Latest in Multimodal

Browse all topics →

The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue
Jun 1, 2026Sherzod Hakimov, Mattia D'Agostini, Ivan Samodelkin +1Vision-Language Natural Language Descriptions
G2LoRA: Gradient Orthogonal Low-Rank Adaptation Framework for Graph Continual Learning on Text-Attributed Graphs
Jun 1, 2026Yuhan Wang, Yibo Ding, Yutong Ye +4Efficient Continual Learning Video-Text Alignment
Boosting Multimodal Federated Learning via Chained Modality Optimization
Jun 1, 2026Zixin Zhang, Fan Qi, Shuai Li +2Fedavg Multimodal Learning
Density-Aware Translation of Spurious Correlations in Zero-Shot VLMs
Jun 1, 2026Afsaneh Hasanebrahimi, Hanxun Huang, Christopher Leckie +1Zero-Shot Inference Modality Gap
TRON: Targeted Rule-Verifiable Online Environments for Visual Reasoning RL
Jun 1, 2026Tianze Yang, Yucheng Shi, Ruitong Sun +3Multimodal Reasoning Benchmarks Visual Reasoning
Compliance-Scored Best-of-N Guardrail Orchestration for Multimodal Document Generation in Payments Dispute Defense
Jun 1, 2026Nataraj Agaram Sundar, Tejas MorabiaCompliance Streaming Guardrails
A Sonar-Visual Dataset for Cross-Modal Underwater Robot Perception
May 31, 2026Weitung Chen, Phil Tinn, Per Gunnar Auran +2Underwater Image Enhancement Forward-Looking Sonar
HOLA: Holistic Multi-Modal Alignment for Open-Set 3D Recognition
May 31, 2026Koby Aharonov, Oren Shrout, Ayellet Tal3D Scene Understanding Multimodal Alignment
Beyond Visual Memory: Mechanistic Diagnostics of Latent Visual Reasoning
May 31, 2026Garvin Guo, Yu Chen, Xiang Wang +4Latent Visual Reasoning Visual Memory
DeepIPCv3: Event-Aware Multi-Modal Sensor Fusion for Sudden Pedestrian Crossing Avoidance
May 31, 2026Oskar Natan, Andi Dharmawan, Aufaclav Zatu Kusuma Frisky +2Multi-Sensor Fusion Autonomous Driving
NeuroAlign: Hierarchical Multimodal Fusion of Dynamic and Structural Neuroimaging for MCI Analysis
May 31, 2026Xiongri Shen, Zhenxi Song, Jiaqi wang +13Neuroimaging Models Multimodal Alignment
Connecting the Dots: Benchmarking Reflective Memory in Long-Horizon Dialogue
May 31, 2026Jingjie Lin, Bingbing Wang, Zihan Wang +4Conversational Benchmarks Multimodal Reasoning Benchmarks
Distilling Neuro-Symbolic Programs into 3D Multi-modal LLMs
May 31, 2026Wentao Mo, Yang Liu3D Spatial Reasoning Neuro-Symbolic Framework
Mitigating Manifold Departure: Uncertainty-Aware Subspace Rectification for Trustworthy MLLM Decoding
May 31, 2026Yingxuan Zhuang, Jingxiao Yang, Miao Pan +7Large Language Model Hallucination Hallucination Mitigation
Reusing Fusion-Time Spectral Reliability for Adaptive Fusion and Expert Routing in RGB-Infrared Object Detection
May 31, 2026Yefeng WuObject Detection Cross-Modal Learning
PMC-InterCPT: Rethinking Biomedical Interleaved Data for Multimodal Continued Pretraining
May 31, 2026Guanghao Zhu, Zeyu Liu, Zhitian Hou +9Multimodal Clinical Data Multimodal Pretraining
ProductWebGen: Benchmarking Multimodal Product Webpage Generation
May 31, 2026Zhihong Liu, Siqi Kou, Zheng Li +5Multimodal Generation Multimodal Learning
Large Language Models in Transportation Systems Management and Operations: From Text Reasoning to Multi-modal Decision Support
May 31, 2026Siyan Li, Zehao Wang, Jiachen Li +3Multi-Modal Large Language Models Decision Support
Towards Understanding Modality Interaction in Multimodal Language Models via Partial Information Decomposition
May 31, 2026Wanlong Fang, Tianle Zhang, Wen Tao +1Multi-Modal Large Language Models Sensory Feedback
MLLM-Microscope: Unlocking Hidden Structure Within Multimodal Large Language Models
May 30, 2026Ravil Mussabayev, Rustam MussabayevMulti-Modal Large Language Models Multimodal Transformers
MMDG-Bench: A Benchmark for Multimodal Domain Generalization
May 30, 2026Qianshan Zhan, Qian Wang, Da Li +2Multimodal Domain Generalization Multimodal Benchmarks
Benchmarks for Vision-Language Models in Urban Perception Should Be Reliability-Aware and Negotiated
May 30, 2026Rashid MushkaniEvaluation Benchmarks Multimodal Benchmarks
CASTLE2026 Team WDL Technical Report
May 30, 2026Zhengyang Li, Zhenglin Du, Yi Wen +3Video Question Answering Egocentric Video
CR-JEPA: Cross-Modal Joint-Embedding Predictive Learning for Remote Sensing Image Retrieval
May 30, 2026Md Aminur Hossain, Ayush V. Patel, Nitant Dube +1Remote Sensing Cross-Modal Learning
Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Synthesis with Modality and Metadata Conditioning
May 30, 2026Muhammad Nabi Yasinzai, Remika Mito, Mangor PedersenMedical Image Generation Magnetic Resonance Imaging
T-CLIP: Enabling Thermal Perception for Contrastive Language-Image Pretraining
May 30, 2026Tayeba Qazi, Ayush Maheshwari, Prerana Mukherjee +1Cross-Modal Learning Perceptual Understanding
Through the PRISM: Principle-Aware, Interpretable, and Multi-Scale Evaluation of Visual Designs
May 30, 2026Mona Gandhi, KJ Joseph, Srinivasan Parthasarathy +1Multimodal Reasoning Evaluation Benchmarks
Sandboxed Coding Agents are Competitive Omni-modal Task Solvers
May 30, 2026Dongping Chen, Xuanao Huang, Zhihan Hu +3Multimodal Agents Omni-Modal
Decomposed On-Policy Distillation for Vision-Language Reasoning: Steering Gradients for Visual Grounding
May 30, 2026Hee Suk Yoon, Eunseop Yoon, Jaehyun Jang +6Vision-Language On-Policy Distillation
Escaping the Mode Lottery: Multi-Response Training Improves Language Model Generalization
May 30, 2026Hasan Amin, Kian Ahrabian, Ming Yin +1Multi-Modal Large Language Models Lotteries
DREAM-S: Speculative Decoding with Searchable Drafting and Target-Aware Refinement for Multimodal Generation
May 30, 2026Zining Liu, Yunhai Hu, Tianhua Xia +4Speculative Decoding Autoregressive Generation
Do Text Edits Generalize to Visual Generation? Benchmarking Cross-Modal Knowledge Editing in UMMs
May 30, 2026Xin Gao, Cheng Yang, Chufan Shi +1Unified Multimodal Models Multimodal Knowledge Editing
LLMs Need Encoders for Semantic IDs Too
May 29, 2026Xiangyi Chen, Zelun Wang, Xinyi Li +3Multi-Modal Large Language Models Encoders
Hyperbolic and Evidence-Prioritized Experts for Large Vision-Language Models
May 29, 2026Zijie Zhou, Dandan Zhu, Hangxiangpan Wang +3Large Vision Language Models Cross-Modal Learning
MindZero: Learning Online Mental Reasoning With Zero Annotations
May 29, 2026Shunchi Zhang, Jin Lu, Chuanyang Jin +3Theory-Of-Mind Reasoning Agentic Reasoning
TIGER: Traceable Inference with Graph-Based Evidence Routing for Mitigating Hallucinations in Multimodal Generation
May 29, 2026Kaixiang Zhao, Tianrun Yu, Shawn Huang +3Multimodal Generation Multilingual Fact-Checking
Representation Forcing for Bottleneck-Free Unified Multimodal Models
May 29, 2026Yuqing Wang, Zhijie Lin, Ceyuan Yang +10Unified Multimodal Models Generative Models
How can embedding models bind concepts?
May 29, 2026Arnas Uselis, Darina Koishigarina, Seong Joon OhFrozen Contrastive Language-Image Pre-Training Visual Encoder Cross-Modal Learning
PaintBench: Deterministic Evaluation of Precise Visual Editing
May 29, 2026Kai Xu, Ellis Brown, Shrikar Madhu +3Image Editing Multimodal Benchmarks
VisionPulse: Dynamic Visual Sparsity for Efficient Multimodal Reasoning
May 29, 2026Hengbo Xu, Shengjie Jin, Yanbiao Ma +1Multimodal Reasoning Visual Token Pruning
FAM-Bench: A Multimodal Benchmark for Condition-Aware Food-as-Medicine Reasoning
May 29, 2026Mingyang Mao, Bhargav Rishi Medisetti, Utkarsh Grover +4Multimodal Benchmarks Artificial Intelligence Systems
UF-AMA: A unified framework for cross-domain emotion recognition via adaptive multimodal alignment
May 29, 2026Zheng Wang, Shuo Wang, Junhong WangEmotion Recognition Cross-Modal Fusion
MIMO: Multilingual Information Retrieval via Monolingual Objectives
May 29, 2026Youngjoon Jang, Seongtae Hong, Heuiseok LimCross-Lingual Alignment Multi-Modal Large Language Models
Best-Arm Identification-Based Trust Region Selection for Bayesian Optimization on Multimodal Functions
May 29, 2026Nobuo Namura, Sho TakemoriBayesian Optimization Trust Region
Variational Adapter for Cross-modal Similarity Representation
May 29, 2026WenZhang Wei, Zhipeng Gui, Dehua Peng +2Cross-Modal Alignment Cross-Modal Learning
AMix-2: Establishing Protein as a Native Modality in Large Language Models
May 29, 2026Keyue Qiu, Yixin Wu, Lihao Wang +19Protein Design Protein Data Bank
MultiAct: Text-to-Motion Generation from Composite Text via Tailored Attention Guidance
May 29, 2026Nathan Sala, Ofir Abramovich, Ariel Shamir +3Text-To-Motion Generation Multimodal Generation
Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR
May 29, 2026Ruina Hu, Chen Wang, Lai Wei +5Visual Evidence Multimodal Reasoning Benchmarks
Benchmarking Multimodal LLMs on Code Generation for Complex Interactive Webpages
May 29, 2026Fan Wu, Lishuai Dong, Cuiyun Gao +4Web Code Generation
DiffCrossGait: Trajectory-Level Alignment for 2D-3D Cross-Modal Gait Recognition via Latent Diffusion
May 29, 2026Zhiyang Lu, Ming ChengGait Recognition Cross-Modal Alignment
Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding
May 29, 2026Xiang Fang, Daizong Liu, Wanlong Fang +4Temporal Grounding Cross-Modal Alignment
Your Multimodal Speech Model Says I Have a Face for Radio
May 28, 2026Maya K. Nachesa, Vlad Niculae, Vagrant GautamMultimodal Learning Audio-Visual Consistency
Archon: A Unified Multimodal Model for Holistic Digital Human Generation
May 28, 2026Chong Bao, Shichen Liu, Lijun Yu +9Multimodal Generation Pre-Trained Video Diffusion Models
LoMo: Local Modality Substitution for Deeper Vision-Language Fusion
May 28, 2026Feng Han, Zhixiong Zhang, Zheming Liang +2Large Vision Language Models Cross-Modal Learning
xModel-KD: Cross-modal Knowledge Distillation for 3D Scene Perception using LiDAR
May 28, 2026Thenukan Pathmanathan, Kanchan Keisham, Thangarajah Akilan3D Semantic Segmentation 3D Scene Understanding
Multimodal Music Recommendation System using LLMs
May 28, 2026Srikar Prabhas Kandagatla, Sreehitha R. Narayana, Chandana Magapu +6Multimodal Recommendation Conversational Music Recommendation
MuPHI: Learning Implicit Multimodal Harm Reasoning via Semantically Grounded Reward Optimization
May 28, 2026Anisha Saha, Varsha Suresh, Teodora Kamova +3Multimodal Reasoning Cross-Modal Learning
OVA-IB: One vs All Information Bottleneck for Multi-Modal Alignment
May 28, 2026Tianchao Li, Shujian Yu, Xinrui Zu +4Multimodal Alignment Modality Alignment
Towards Verifiable Multimodal Deep Research: A Multi-Agent Harness for Interleaved Report Generation
May 28, 2026Chenghao Zhang, Guanting Dong, Yufan Liu +3Multimodal Learning Deep Research
MIRAGE: Adaptive Multimodal Gating for Whole-Brain fMRI Encoding
May 28, 2026Abdulkadir Gokce, Badr AlKhamissi, Martin SchrimpfNeuroimaging Models Brain Magnetic Resonance Imaging

Jun 1, 2026 · cs.CVJ/K move · Enter open · S save

The Image Reconstruction Game: Drawing Common Ground Through Iterative Multimodal Dialogue

Sherzod Hakimov, Mattia D'Agostini, Ivan Samodelkin, David Schlangen

Computational Linguistics, Department of Linguistics University of Potsdam, Germany · German Research Center for Artificial Intelligence (DFKI), Berlin, Germany

We introduce the Image Reconstruction Game, a fully automated benchmark in which a vision-language model issues corrective instructions to an image generator across multiple turns, making accumulated common ground directly observable as a rendered image. Benchmarking two Describer models crossed with two Generator models across seven image categories, we find that the describer is the dominant factor in reconstruction quality, while the generator determines whether iterative refinement helps or hurts. Mathematical and geometric images pose the greatest challenge. The describer's token budget strongly affects convergence: shorter budgets yield sparser first renderings with more room for visible improvement, while longer budgets raise absolute quality but leave less to fix. Stronger describers use a richer correction vocabulary spanning spatial, numeric, and structural categories, while weaker describers concentrate on surface properties and tend to stop after a few turns. Human validation shows that the best automated judge reaches only slight-to-fair agreement with human preferences, and automated scores require human recalibration to be used reliably.

Vision-Language Natural Language Descriptions Iterative Refinement Multimodal Learning Dialogue

Open paper Ask about it PDF