Multimodal

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

1,965 papers

Latest in Multimodal

Browse all topics →
CardsList

  1. CrossWeaver: Cross-modal Weaving for Arbitrary-Modality Semantic Segmentation

    Apr 3, 2026Zelin Zhang, Kedi Li, Huiqi Liang +3Multimodal FusionCross-Modal Learning

  2. MAVFusion: Efficient Infrared and Visible Video Fusion via Motion-Aware Sparse Interaction

    Apr 2, 2026Xilai Li, Weijun Jiang, Xiaosong Li +5Visible Image FusionMotion-Focused Representations

  3. When Sinks Help or Hurt: Unified Framework for Attention Sink in Large Vision-Language Models

    Apr 1, 2026Jiho Choi, Jaemin Kim, Sanghwan Kim +2Large Vision Language ModelsCross-Modal Attention

  4. CoLA: Cross-Modal Low-rank Adaptation for Multimodal Downstream Tasks

    Apr 1, 2026Wish Suharitdamrong, Tony Alex, Muhammad Awais +1Vision-Language Model AdaptationLow-Rank Adaptation

  5. TSHA: A Benchmark for Visual Language Models in Trustworthy Safety Hazard Assessment Scenarios

    Mar 31, 2026Qiucheng Yu, Ruijie Xu, Mingang Chen +2HazardLarge Language Model Safety

  6. Unsafe by Reciprocity: How Generation-Understanding Coupling Undermines Safety in Unified Multimodal Models

    Mar 28, 2026Kaishen Wang, Heng HuangUnified Multimodal ModelsLarge Language Model Safety

  7. Context-specific Credibility-aware Multimodal Fusion with Conditional Probabilistic Circuits

    Mar 27, 2026Pranuthi Tenali, Sahil Sidheekh, Saurabh Mathur +3Multimodal FusionUncertainty-Aware Fusion

  8. SemConFlow: Semantic Grounding of Holistic Co-Speech Gesture Generation with Contrastive Flow-Matching

    Mar 27, 2026Lanmiao Liu, Esam Ghaleb, Aslı Özyürek +1Co-Speech Gesture GenerationContrastive Alignment

  9. Colon-Bench: An Agentic Workflow for Scalable Dense Lesion Annotation in Full-Procedure Colonoscopy Videos

    Mar 26, 2026Abdullah Hamdi, Changchun Yang, Xin GaoColonoscopyPolyp Segmentation

  10. GeoHeight-Bench: Towards Height-Aware Multimodal Reasoning in Remote Sensing

    Mar 26, 2026Xuran Hu, Zhitong Xiong, Zhongcheng Hong +3Remote SensingEarth Observation

  11. VideoTIR: Accurate Understanding for Long Videos with Efficient Tool-Integrated Reasoning

    Mar 26, 2026Zhe Gao, Shiyu Shen, Taifeng Chai +7Video UnderstandingVideos

  12. ReLope: KL-Regularized LoRA Probes for Multimodal LLM Routing

    Mar 25, 2026Yaopei Zeng, Congchao Wang, Blake JianHang Chen +1Large Language Model RoutingMulti-Modal Large Language Models

  13. UniICL: Systematizing Unified Multimodal In-context Learning through a Capability-Oriented Taxonomy

    Mar 25, 2026Yicheng Xu, Jiangning Zhang, Zhucun Xue +5In-Context LearningUnified Multimodal Models

  14. OmniACBench: A Benchmark for Evaluating Context-Grounded Acoustic Control in Omni-Modal Models

    Mar 25, 2026Seunghee Kim, Bumkyu Park, Kyudan Jung +5Omni-ModalMultimodal Benchmarks

  15. SpecEyes: Accelerating Agentic Multimodal LLMs via Speculative Perception and Planning

    Mar 24, 2026Haoyu Huang, Jinfa Huang, Zhongwei Wan +3Multimodal AgentsMulti-Modal Large Language Models

  16. DetPO: In-Context Learning with Multi-Modal LLMs for Few-Shot Object Detection

    Mar 24, 2026Gautam Rajendrakumar Gare, Neehar Peri, Matvei Popov +3Open-Vocabulary Object DetectionObject Detection

  17. From Content to Audience: A Multimodal Annotation Framework for Broadcast Television Analytics

    Mar 24, 2026Paolo Cupini, Francesco PierriAudience EngagementMultimodal Learning

  18. ForeSea: AI Forensic Search with Multi-modal Queries for Video Surveillance

    Mar 24, 2026Hyojin Park, Yi Li, Janghoon Cho +8Video Question AnsweringMultimodal Query

  19. UniMotion: A Unified Framework for Motion-Text-Vision Understanding and Generation

    Mar 23, 2026Ziyi Wang, Xinshun Wang, Shuang Chen +2Text-To-Motion GenerationUnified Multimodal Models

  20. Guideline-grounded retrieval-augmented generation for ophthalmic clinical decision support

    Mar 23, 2026Shuying Chen, Sen Cui, Zhong CaoOphthalmologyClinical Reasoning

  21. ProactiveBench: Benchmarking Proactiveness in Multimodal Large Language Models

    Mar 19, 2026Thomas De Min, Subhankar Roy, Stéphane Lathuilière +2Multi-Modal Large Language ModelsProactive

  22. HiMu: Hierarchical Multimodal Frame Selection for Long Video Question Answering

    Mar 19, 2026Dan Ben-Ami, Gabriele Serussi, Kobi Cohen +1Video Question AnsweringMultimodal Query

  23. Correlation-Weighted Multi-Reward Optimization for Compositional Generation

    Mar 19, 2026Jungmyung Wi, Hyunsoo Kim, Donghyun KimMultimodal Generation

  24. LoGSAM: Parameter-Efficient Cross-Modal Grounding for MRI Segmentation

    Mar 18, 2026Mohammad Robaitul Islam Bhuiyan, Sheethal Bhat, Melika QahqaieBrain Tumor SegmentationMagnetic Resonance Imaging

  25. From Passive Observer to Active Critic: Reinforcement Learning Elicits Process Reasoning for Robotic Manipulation

    Mar 16, 2026Yibin Liu, Yaxing Lyu, Daqi Gao +5Generalizable Robotic ManipulationsVideo Multimodal Large Language Models

  26. DamageArbiter: A Multimodal Arbitration Framework for Disaster Damage Assessment from Street-View Imagery

    Mar 16, 2026Yifan Yang, Lei Zou, Wenjing Gong +6Post-Disaster Damage AssessmentArbitration

  27. Beyond Medical Diagnostics: How Medical Multimodal Large Language Models Think in Space

    Mar 14, 2026Quoc-Huy Trinh, Xi Ding, Yang Liu +7Multi-Modal Large Language ModelsMultimodal Clinical Data

  28. Overcoming the Modality Gap in Context-Aided Forecasting

    Mar 12, 2026Vincent Zhihao Zheng, Étienne Marcotte, Arjun Ashok +4Llm-Based Forecasting MethodsSynthetic Data Augmentation

  29. GRADE: Benchmarking Discipline-Informed Reasoning in Image Editing

    Mar 12, 2026Mingxin Liu, Ziqian Fan, Zhaokai Wang +13Image EditingUnified Multimodal Models

  30. CoMMET: A Psychologically Grounded Benchmark for Evaluating Theory of Mind in Multimodal LLMs

    Mar 12, 2026Ruirui Chen, Weifeng Jiang, Chengwei Qin +3Social ReasoningMultimodal Dataset

  31. Beyond Sequential Distance: Inter-Modal Distance Invariant Position Encoding

    Mar 11, 2026Lin Chen, Bolin Ni, Qi Yang +5Cross-Modal AttentionRotary Position Embedding

  32. Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion

    Mar 6, 2026Lijiang Li, Zuwei Long, Yunhang Shen +6Multi-Modal Large Language ModelsMultimodal Foundation Model

  33. Multimodal Behavior Tree Generation: A Small Vision-Language Model for Robot Task Planning

    Mar 6, 2026Riccardo Andrea Izzo, Cristiano Battistini, Gianluca Bardaro +1Large Vision Language ModelsRobot Planning

  34. Wiki-R1: Incentivizing Multimodal Reasoning for Knowledge-based VQA via Data and Sampling Curriculum

    Mar 5, 2026Shan Ning, Longtian Qiu, Xuming HeKnowledge-Based Visual Question AnsweringKnowledge-Based Visual Question Answering Benchmarks

  35. Feature-level Interaction Explanations in Multimodal Transformers

    Mar 4, 2026Yeji Kim, Housam Khalifa Bashier Babiker, Mi-Young Kim +1Multimodal TransformersExplainability

  36. Design-MLLM: A Reinforcement Alignment Framework for Verifiable and Aesthetic Interior Design

    Mar 4, 2026Yuxuan Yang, Xiaotong Mao, Jingyao WangFurniturevlaMllm-Based

  37. MPFlow: Multi-modal Posterior-Guided Flow Matching for Zero-Shot MRI Reconstruction

    Mar 4, 2026Seunghoi Kim, Chen Jin, Henry F. J. Tregidgo +2Magnetic Resonance Imaging ReconstructionMultimodal Pretraining

  38. Designing UNICORN: a Unified Benchmark for Imaging in Computational Pathology, Radiology, and Natural Language

    Mar 3, 2026Michelle Stegeman, Lena Philipp, Fennie van der Graaf +20Pathology Foundation ModelsMultimodal Clinical Data

  39. MUSE: A Run-Centric Platform for Multimodal Unified Safety Evaluation of Large Language Models

    Mar 3, 2026Zhongxi Wang, Yueqian Lin, Jingyang Zhang +3Large Language Model SafetyLarge Language Model Evaluation

  40. MINT: Multimodal Imaging-to-Speech Knowledge Transfer for Early Alzheimer's Screening

    Feb 27, 2026Vrushank Ahire, Yogesh Kumar, Anouck Girard +1Mild Cognitive ImpairmentAlzheimer

  41. PRIMA: Pre-training with Risk-integrated Image-Metadata Alignment for Medical Diagnosis via LLM

    Feb 26, 2026Yiqing Wang, Chunming He, Ming-Chen Lu +4Multimodal Clinical DataMulti-Modal Representation Learning

  42. InCoM: Intent-Driven Perception and Structured Coordination for Mobile Manipulation

    Feb 26, 2026Jiahao Liu, Cui Wenbo, Zhongpu Xia +3Real-World Manipulation TasksGlobal Coordination

  43. OmniGAIA: Towards Native Omni-Modal AI Agents

    Feb 26, 2026Xiaoxi Li, Wenxiang Jiao, Jiarui Jin +10Omni-ModalMultimodal Agents

  44. BrepCoder: A Unified Multimodal Large Language Model for Multi-task B-rep Reasoning

    Feb 25, 2026Mingi Kim, Yongjun Kim, Jungwoo Kang +1Computer-Aided Design3D Models

  45. MMLoP: Multi-Modal Low-Rank Prompting for Efficient Vision-Language Adaptation

    Feb 24, 2026Sajjad Ghiasvand, Haniyeh Ehsani Oskouie, Mahnoosh Alizadeh +1Vision-Language Model AdaptationPrompt Tuning

  46. Unlocking Multimodal Document Intelligence: From Current Triumphs to Future Frontiers of Visual Document Retrieval

    Feb 23, 2026Yibo Yan, Jiahao Huo, Guanbo Feng +12Visual Document RetrievalMultimodal Documents

  47. VectorGym: A Multi-Task Benchmark for SVG Code Generation, Sketching and Editing

    Feb 22, 2026Joan Rodriguez, Haotian Zhang, Abhay Puri +14Scalable Vector GraphicSketches

  48. Audio-Visual Continual Test-Time Adaptation without Forgetting

    Feb 20, 2026Sarthak Kumar Maharana, Akshay Mehra, Bhavya Ramakrishna +2Cross-Modal LearningState-Of-The-Art

  49. OpenEarthAgent: A Unified Framework for Tool-Augmented Geospatial Agents

    Feb 19, 2026Akashah Shabbir, Muhammad Umer Sheikh, Muhammad Akhtar Munir +8Cloud-Aware Earth Observation SequencesSatellite Imagery

  50. SpectralGCD: Spectral Concept Selection and Cross-modal Representation Learning for Generalized Category Discovery

    Feb 19, 2026Lorenzo Caselli, Marco Mistretta, Simone Magistri +1Generalized Category DiscoveryCross-Modal Learning

  51. Xray-Visual Models: Scaling Vision models on Industry Scale Data

    Feb 18, 2026Shlok Mishra, Tsung-Yu Lin, Linda Wang +24Vision Foundation ModelsCross-Modal Learning

  52. LaViDa-R1: Advancing Reasoning for Unified Multimodal Diffusion Language Models

    Feb 15, 2026Shufan Li, Yuchen Zhu, Jiuxiang Gu +6Universal MultimodalDiffusion Language Models

  53. Cross-Modal Robustness Transfer (CMRT): Training Robust Speech Translation Models Using Adversarial Text

    Feb 12, 2026Abderrahmane Issam, Yusuf Can Semerci, Jan Scholtes +1Simultaneous Speech TranslationCross-Modal Learning

  54. UReason: Benchmarking Reasoning-to-Generation Alignment in Unified Multimodal Models

    Feb 9, 2026Cheng Yang, Chufan Shi, Bo Shui +7Unified Multimodal Models

  55. MMEarth-Bench: Global Model Adaptation via Multimodal Test-Time Training

    Feb 6, 2026Lucia Gordon, Serge Belongie, Christian Igel +1Benchmark DatasetsMultimodal Learning

  56. Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMs

    Feb 5, 2026Qi Li, Yanzhe Zhao, Yongxin Zhou +4Multi-Modal Large Language ModelsMultimodal Retrieval

  57. Stage-wise Attention-Guided Region Sequencing for Adversarial Attacks on Large Vision-Language Models

    Feb 4, 2026Jaehyun Kwak, Nam Cao, Boryeong Cho +3Adversarial ExamplesLarge Vision Language Models

  58. Conditional Flow Matching for Visually-Guided Acoustic Highlighting

    Feb 3, 2026Hugo Malard, Gael Le Lan, Daniel Wong +3Cross-Modal LearningConditional Flow Matching

  59. LaVPR: Benchmarking Language and Vision for Place Recognition

    Feb 3, 2026Ofer Idan, Dan Badur, Yosi Keller +1Visual Place RecognitionCross-Modal Learning

  60. Superman: Unifying Skeleton and Vision for Human Motion Perception and Generation

    Feb 2, 2026Xinshun Wang, Peiming Li, Ziyi Wang +5Human Motion GenerationSkeleton