Multimodal

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

65 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-14

18 new papers

A weekly snapshot of new work published in Multimodal.

Period ending 2026-09-07

26 new papers

A weekly snapshot of new work published in Multimodal.

Inside this field

Focused directions

1,965 papers

Latest in Multimodal

Browse all topics →
CardsList

  1. Toward Multimodal Conversational AI for Age-Related Macular Degeneration

    Apr 28, 2026Ran Gu, Benjamin Hou, Mélanie Hébert +5OphthalmologyMultimodal Clinical Data

  2. Learning Generalizable Multimodal Representations for Software Vulnerability Detection

    Apr 28, 2026Zeming Dong, Yuejun Guo, Qiang Hu +5Vulnerability Detection & RepairCode Quality

  3. Refinement via Regeneration: Enlarging Modification Space Boosts Image Refinement in Unified Multimodal Models

    Apr 28, 2026Jiayi Guo, Linqing Wang, Jiangshan Wang +6Text-To-ImageUnified Multimodal Models

  4. HotComment: A Benchmark for Evaluating Popularity of Online Comments

    Apr 28, 2026Yafeng Wu, Yunyao Zhang, Liliang Ye +4PopularityReddit

  5. DualFact+: A Multimodal Fact Verification Framework for Procedural Video Understanding

    Apr 28, 2026Cennet Oguz, Yasser Hamidullah, Josef van Genabith +1Multilingual Fact-CheckingVideo Captioning

  6. Learning from Medical Entity Trees: An Entity-Centric Medical Data Engineering Framework for MLLMs

    Apr 28, 2026Jianghang Lin, Haihua Yang, Deli Yu +6Medical OntologyMultimodal Clinical Data

  7. Combating Visual Neglect and Semantic Drift in Large Multimodal Models for Enhanced Cross-Modal Retrieval

    Apr 28, 2026Guosheng Zhang, Linkai Liu, Keyao Wang +3Multimodal RetrievalCross-Modal Learning

  8. Personalized Cross-Modal Emotional Correlation Learning for Speech-Preserving Facial Expression Manipulation

    Apr 28, 2026Tianshui Chen, Yujie Zhu, Jianman Lin +4Facial Expression RecognitionCross-Modal Alignment

  9. M3^3-VQA: A Benchmark for Multimodal, Multi-Entity, Multi-Hop Visual Question Answering

    Apr 28, 2026Jiatong Ma, Longteng Guo, Yuchen Liu +4Knowledge-Based Visual Question AnsweringMultimodal Reasoning

  10. Beyond Accuracy: Benchmarking Cross-Task Consistency in Unified Multimodal Models

    Apr 27, 2026Weixing Wang, Liudvikas Zekas, Anton Hackl +5Unified Multimodal ModelsMultimodal Learning

  11. Assessing Y-Axis Influence: Bias in Multimodal Language Models on Chart-to-Table Translation

    Apr 27, 2026Seok Hwan Song, Azher Ahmed Efat, Wallapak TavanapongChartTabular Learning

  12. Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence

    Apr 27, 2026NVIDIA, :, Amala Sanjay Deshmukh +216Omni-ModalOmni

  13. Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generation

    Apr 27, 2026Zhiheng Liu, Weiming Ren, Xiaoke Huang +12Unified Multimodal ModelsVision Encoders

  14. X2SAM: Any Segmentation in Images and Videos

    Apr 27, 2026Hao Wang, Limeng Qiao, Chi Zhang +4Video Object SegmentationVideo Multimodal Large Language Models

  15. Majorization-Guided Test-Time Adaptation for Vision-Language Models under Modality-Specific Shift

    Apr 27, 2026Lixian Chen, Yanhui Chen, Junyi LinVision-Language Model AdaptationStable Test-Time Adaptation

  16. MIMIC: A Generative Multimodal Foundation Model for Biomolecules

    Apr 27, 2026Siavash Golkar, Jake Kovalic, Irina Espejo Morales +28DnaMultimodal Foundation Model

  17. Omni-o3: Deep Nested Omnimodal Deduction for Deliberative Audio-Visual Reasoning

    Apr 27, 2026Zhicheng Zhang, Wentao Gu, Weicheng Wang +5Audio-Visual ReasoningMultimodal Reasoning

  18. MultiDx: A Multi-Source Knowledge Integration Framework towards Diagnostic Reasoning

    Apr 27, 2026Yimin Deng, Zhenxi Lin, Yejing Wang +9Clinical ReasoningDiagnostic Benchmark

  19. minAction.net: Energy-First Neural Architecture Design -- From Biological Principles to Systematic Validation

    Apr 27, 2026Martin G. FraschNeuromorphic HardwareFree Energy Principle

  20. QEVA: A Reference-Free Evaluation Metric for Narrative Video Summarization with Multimodal Question Answering

    Apr 27, 2026Woojun Jung, Junyeong KimSummarizationVideo-Language Models

  21. DeepTaxon: An Interpretable Retrieval-Augmented Multimodal Framework for Unified Species Identification and Discovery

    Apr 27, 2026Jiawei Wang, Ming Lei, Yaning Yang +8TaxonomyMultimodal Retrieval

  22. Hierarchical Prototype-based Domain Priors for Multiple Instance Learning in Multimodal Histopathology Analysis

    Apr 27, 2026Xuemei Qiu, Dawei Fan, Yebin Huang +2Computational PathologyMultiple Instance Learning

  23. AMAVA: Adaptive Motion-Aware Video-to-Audio Framework for Visually-Impaired Assistance

    Apr 26, 2026Benjamin Klein, Kazi Ruslan Rahman, Sanchita GhoseMotion-Focused RepresentationsBlind Spots

  24. Exploring Audio Hallucination in Egocentric Video Understanding

    Apr 26, 2026Ashish Seth, Xinhao Mei, Changsheng Zhao +9Audio-Visual ReasoningHallucination Rate

  25. ShredBench: Evaluating the Semantic Reasoning Capabilities of Multimodal LLMs in Document Reconstruction

    Apr 26, 2026Zichun Guo, Yuling Shi, Wenhao Zeng +6Visual Document RetrievalMulti-Modal Large Language Models

  26. VitaminP: cross-modal learning enables whole-cell segmentation from routine histology

    Apr 26, 2026Yasin Shokrollahi, Karina B. Pinao Gonzales, Elizve N. Barrientos Toro +5Computational PathologyLesion Segmentation

  27. Multimodal QUD: Inquisitive Questions from Scientific Figures

    Apr 26, 2026Yating Wu, William Rudman, Venkata S Govindarajan +2Multimodal QueryKnowledge-Based Visual Question Answering

  28. Talker-T2AV: Joint Talking Audio-Video Generation with Autoregressive Diffusion Modeling

    Apr 26, 2026Zhen Ye, Xu Tan, Aoxiong Yin +8Joint Audio-Video GenerationAutoregressive Diffusion

  29. EmoTrans: A Benchmark for Understanding, Reasoning, and Predicting Emotion Transitions in Multimodal LLMs

    Apr 25, 2026He Hu, Tengjin Weng, Zebang Cheng +5Emotion RecognitionMulti-Modal Large Language Models

  30. OceanPile: A Large-Scale Multimodal Ocean Corpus for Foundation Models

    Apr 25, 2026Yida Xue, Ningyu Zhang, Tingwei Wu +5Multimodal DatasetMulti-Modal Large Language Models

  31. Robust Audio-Text Retrieval via Cross-Modal Attention and Hybrid Loss

    Apr 25, 2026Meizhu Liu, Matthew Rowe, Amit Agarwal +8Audio RepresentationCross-Modal Attention

  32. Au-M-ol: A Unified Model for Medical Audio and Language Understanding

    Apr 25, 2026Meizhu Liu, Nistha Mitra, Paul Li +3Large Audio Language ModelsAudio

  33. Contrastive Learning for Multimodal Human Activity Recognition with Limited Labeled Data

    Apr 25, 2026Long Jing, Zhixiong Yang, Yajun Zhang +1Human Activity RecognitionRobust Multimodal Learning

  34. AnalogRetriever: Learning Cross-Modal Representations for Analog Circuit Retrieval

    Apr 25, 2026Yihan Wang, Lei Li, Yao Lai +2Analog CircuitsAnalog

  35. One Identity, Many Roles: Multimodal Entity Coreference for Enhanced Video Situation Recognition

    Apr 25, 2026Balaji Darur, Amanmeet Garg, Makarand TapaswiVideo DatasetCoreference Resolution

  36. UpstreamQA: A Modular Framework for Explicit Reasoning on Video Question Answering Tasks

    Apr 25, 2026Jason Nguyen, Ameet Rao, Alexander Chang +2Video Question AnsweringVideo Understanding

  37. RAG4Outcome: A Retrieval-Augmented Multimodal Framework for Prognostic Prediction in Chronic Osteomyelitis

    Apr 24, 2026Daqian Shi, Pei Han, Jishizhan Chen +4PrognosticsMultimodal Clinical Data

  38. Inter-Stance: A Dyadic Multimodal Corpus for Conversational Stance Analysis

    Apr 24, 2026Xiang Zhang, Xiaotian Li, Taoyue Wang +9Multimodal DatasetMultimodal Learning

  39. Text-Guided Multimodal Unified Industrial Anomaly Detection

    Apr 24, 2026Zewen Li, Shuo Ye, Zitong Yu +2Zero-Shot Anomaly DetectionCross-Modal Learning

  40. MTT-Bench: Predicting Social Dominance in Mice via Multimodal Large Language Models

    Apr 24, 2026Yunquan Chen, Haoyu ChenDominant ParadigmSocial Reasoning

  41. Federated Cross-Modal Retrieval with Missing Modalities via Semantic Routing and Adapter Personalization

    Apr 24, 2026Hefeng Zhou, Xuan Liu, Sicheng Chen +7Cross-Modal LearningMissing Modalities

  42. Can Multimodal Large Language Models Truly Understand Small Objects?

    Apr 24, 2026Fujun Han, Junan Chen, Xintong Zhu +4Multi-Modal Large Language ModelsSmall Language Models

  43. T2MM: An LLM Supported Architecture For Inquiry-Based Modeling

    Apr 24, 2026John Kos, Rudra Singh, Ashok GoelUnified Multimodal Models

  44. Unlocking Optical Prior: Spectrum-Guided Knowledge Transfer for SAR Generalized Category Discovery

    Apr 24, 2026Jingyuan Xia, Ruikang Hu, Ye Li +3Synthetic Aperture RadarDomain Adaptation

  45. ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward

    Apr 23, 2026Jingpei Wu, Xiao Han, Weixiang Shen +3Multimodal ReasoningThinking

  46. Source-Modality Monitoring in Vision-Language Models

    Apr 23, 2026Etha Tianze Hua, Tian Yun, Ellie PavlickInput ModalityMultimodal Learning

  47. DM3^3-Nav: Decentralized Multi-Agent Multimodal Multi-Object Semantic Navigation

    Apr 23, 2026Amin Kashiri, Atharva Jamsandekar, Yasin YazıcıoğluSocial Robot NavigationNavigation

  48. Context Unrolling in Omni Models

    Apr 23, 2026Ceyuan Yang, Zhijie Lin, Yang Zhao +16Unified Multimodal ModelsOmni

  49. UniGenDet: A Unified Generative-Discriminative Framework for Co-Evolutionary Image Generation and Generated Image Detection

    Apr 23, 2026Yanran Zhang, Wenzhao Zheng, Yifei Li +5Ai-Generated Image DetectionLarge-Scale Image Generation

  50. Modulating Cross-Modal Convergence with Single-Stimulus, Intra-Modal Dispersion

    Apr 23, 2026Eghbal A. Hosseini, Brian Cheung, Evelina Fedorenko +1Cross-Modal LearningImplicit Neural Representations

  51. Encoder-Free Human Motion Understanding via Structured Motion Descriptions

    Apr 23, 2026Yao Zhang, Zhuchenyang Liu, Thomas Ploetz +1Human Motion GenerationVideo Multimodal Large Language Models

  52. Do MLLMs Understand Pointing? Benchmarking and Enhancing Referential Reasoning in Egocentric Vision

    Apr 23, 2026Chentao Li, Zirui Gao, Mingze Gao +3Egocentric VisionMulti-Modal Large Language Models

  53. S1-VL: Scientific Multimodal Reasoning Model with Thinking-with-Images

    Apr 23, 2026Qingxiao Li, Lifeng Xu, QingLi Wang +4Multimodal ReasoningMicroscopy

  54. Beyond Single Plots: A Benchmark for Question Answering on Multi-Charts

    Apr 23, 2026Azher Ahmed Efat, Seok Hwan Song, Wallapak TavanapongChartMultimodal Query

  55. MiMIC: Mitigating Visual Modality Collapse in Universal Multimodal Retrieval While Avoiding Semantic Misalignment

    Apr 23, 2026Juan Li, Chuanghao Ding, Xujie Zhang +1Multimodal RetrievalUnified Multimodal Models

  56. Temporal Prototyping and Hierarchical Alignment for Unsupervised Video-based Visible-Infrared Person Re-Identification

    Apr 23, 2026Zhiyong Li, Wei Jiang, Haojie Liu +3Re-IdentificationFine-Grained Video Understanding

  57. Can MLLMs "Read" What is Missing?

    Apr 23, 2026Jindi Guo, Chaozheng Huang, Xi FangMulti-Modal Large Language ModelsReading

  58. OMIBench: Benchmarking Olympiad-Level Multi-Image Reasoning in Large Vision-Language Model

    Apr 22, 2026Qiguang Chen, Chengyu Luan, Jiajun Wu +7Multimodal Reasoning BenchmarksLarge Vision Language Models

  59. V-tableR1: Process-Supervised Multimodal Table Reasoning with Critic-Guided Policy Optimization

    Apr 22, 2026Yubo Jiang, Yitong An, Xin Yang +7Multimodal ReasoningVisual Reasoning

  60. The Expense of Seeing: Attaining Trustworthy Multimodal Reasoning Within the Monolithic Paradigm

    Apr 22, 2026Karan GoyalMultimodal ReasoningMultimodal Learning