Multimodal Understanding

Ask about this topic

Momentum

10 papers in the last four weeks, up 233% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 413

All topics
CardsList

  1. Gaze Heads: How VLMs Look at What They Describe

    Jun 12, 2026Rohit Gandikota, David BauImage CaptioningVisual Attention

    Northeastern University

  2. When Irrelevant Text Matters: Affine Margin Shifts in Multimodal Large Language Models

    Jun 12, 2026Yinfeng Wang, Zhiyuan Yao, Zheren Fu +2VLM RobustnessMultimodal Large Language Models

    University of Science and Technology of China Hefei, China

  3. Latent World Recovery for Multimodal Learning with Missing Modalities

    Jun 10, 2026Hui Wang, Tianyu Ren, Joseph Butler +3Missing-Modality LearningCross-Modal Alignment

    Queen’s University Belfast, Belfast, United Kingdom

  4. Frozen Multimodal Embeddings for AI-Assisted Interview Assessment of Personality and Cognitive Ability

    Jun 10, 2026Kuo-En Hung, Hung-Yue Suen, Shih-Ching Yeh +1Multimodal FusionMultimodal Understanding

    Technology Application and Human Resource Development, National Taiwan Normal University, Taiwan and HRDA.pro, Taiwan · Technology Application and Human Resource Development, National Taiwan University, Taiwan · Computer Science and Information Engineering, National Central University, Taiwan +1

  5. MultiToP: Learning to Patch Visual Tokens to Mitigate Hallucinations in Video Large Multimodal Models

    Jun 10, 2026Yuansheng Gao, Wenbin Xing, Jiahao Yuan +4Video-Language ModelsMultimodal Foundation Models

    Zhejiang University · Sun Yat-sen University · East China Normal University

  6. Information-Theoretic Decomposition for Multimodal Interaction Learning

    Jun 10, 2026Zequn Yang, Yake Wei, Haotian Ni +2Multimodal FusionMultimodal Learning

    Gaoling School of Artificial Intelligence, Renmin University of China, Beijing · Beijing Key Laboratory of Research on Large Models and Intelligent Governance · Engineering Research Center of Next-Generation Intelligent Search and Recommendation, MOE +2

  7. Context-Aware Multimodal Claim Verification in Spoken Dialogues

    Jun 9, 2026Chaewan Chun, Delvin Ce Zhang, Dongwon LeeClaim VerificationAudio Understanding

    The Pennsylvania State University, USA · University of Sheffield, UK

  8. Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks

    Jun 9, 2026Miaoxin Cai, Guanqun Wang, Wei Zhang +6Remote Sensing Image UnderstandingMultimodal Grounding

    National Key Laboratory of Science and Technology on Space-Born Intelligent Information Processing (SBIIP), Beijing Institute of Technology, Beijing 100081, China · Advanced Research Institute of Multidisciplinary Sciences, Beijing Institute of Technology, Beijing 100081, China · School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China +5

  9. Spatial-Omni: Spatial Audio Understanding Integration in Multimodal LLMs via FOA Encoding

    Jun 9, 2026Zhiyuan Zhu, Yixuan Chen, Yiwen Shao +13Multimodal Large Language ModelsAudio Understanding

    Zhejiang University · Tencent Hunyuan

  10. Kwai Keye-VL-2.0 Technical Report

    Jun 9, 2026Kwai Keye Team, Bin Wen, Changyi Liu +50Temporal Video GroundingLong-Context Modeling

  11. CoCoSI: Collaborative Cognitive Map Construction for Spatial Intelligence

    Jun 9, 2026Yiming Zhang, Ruoxuan Cao, Zhihang ZhongMultimodal Large Language ModelsMulti-Agent LLMs

    2Cornell University · 1Shanghai Jiao Tong University

  12. From Senses to Decisions: The Information Flow of Auditory and Visual Perception in Multimodal LLMs

    Jun 8, 2026Wish Suharitdamrong, Muhammad Awais, Xiatian Zhu +1Efficient Multimodal InferenceMultimodal Large Language Models

    Surrey Institute for People-Centred AI (PAI), University of Surrey, UK · Centre for Vision, Speech and Signal Processing (CVSSP), University of Surrey, UK

  13. TABVERSE: Benchmarking Cross-Format Table Understanding in LLMs and VLMs

    Jun 8, 2026Momina Ahsan, Sarfraz Ahmad, Ming Shan Hee +2Document UnderstandingTable QA

    1Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) · 2Singapore University of Technology and Design (SUTD)

  14. Explicit Representation Alignment for Multimodal Sentiment Analysis

    Jun 8, 2026Baode Wang, Ziming Wang, Huacan Wang +2Cross-Modal AlignmentSentiment Analysis

    AgentAlpha

  15. Language as a Sensor: Calibrated Spatial Belief Estimation in 3D Scenes from Natural Language

    Jun 7, 2026Aryan Naveen, Jason Xinyu Liu, Luca Carlone +1Vision-Language GroundingSemantic Mapping

    MIT Laboratory for Information & Decision Systems · MIT Computer Science & Artificial Intelligence Laboratory

  16. When Video Misreads: Closed-Loop Distillation of Reading Heuristics for Exploratory Manipulation Trace QA

    Jun 7, 2026Haizhou Ge, Yufei Jia, Yue Li +5Robotic ManipulationVideo Reasoning

    Tsinghua University · DISCOVER Robotics

  17. TVI-CoT: Text-Visual Interleaved Chain-of-Thought Reasoning for Multimodal Understanding

    Jun 7, 2026Lianyu Hu, Xiaoyu Ma, Zeqin Liao +1Multimodal Large Language ModelsMultimodal Reasoning

    College of Computing and Data Science of Nanyang Technological University, Singapore.

  18. When Correct Decisions Hide Internal Stress: Decision-State Probing in Multimodal Language Models

    Jun 7, 2026Haoran Zhao, Soyeon Caren Han, Eduard HovyMultimodal RobustnessMultimodal Large Language Models

    1The University of Melbourne

  19. ChronoPhyBench: Do MLLMs Truly Understand the World or Merely Exploit Language Priors?

    Jun 6, 2026Bin Zhu, Yanhao Jia, Kexin Zhao +12Physical ReasoningMultimodal QA

    Peking University, Shenzhen Graduate School · 2Peng Cheng Laboratory · Rabbitpre Intelligence +3

  20. VisualFLIP: Do Predictions Depend on Task-Critical Visual Evidence in Multimodal Reasoning?

    Jun 5, 2026Didi Zhu, Changrui Chen, Stefanos Zafeiriou +1VLM EvaluationMultimodal Grounding

    Imperial College London

  21. Watch, Remember, Reason: Human-View Video Understanding with MLLMs

    Jun 5, 2026Jiahao Meng, Yue Tan, Qi Xu +12Streaming Video UnderstandingVideo-Language Models

    School of Intelligence Science and Technology, Peking University · Wuhan University · Shanghai Jiao Tong University +7

  22. M3^3Exam: Benchmarking Multimodal Memory for Realistic User-Agent Interactions

    Jun 5, 2026Zhengjun Huang, Wenxuan Liu, Zhoujin Tian +6Multimodal GroundingEfficient Multimodal Inference

    The Hong Kong University of Science and Technology · Peng Cheng Laboratory · Beijing University of Chemical Technology +4

  23. FLOWREADER: Min-Cost Flow Optimization for Multi-Modal Long Document Q&A

    Jun 5, 2026Ambuj Mehrish, Sebastiano VasconMultimodal RAGMultimodal QA

    Ca’ Foscari University of Venice

  24. MMLongEmbed: Benchmarking Multimodal Embedding Models in Long-Context Scenarios

    Jun 5, 2026Haitian Wang, Ruoxi Sun, Quantong Qiu +5Multimodal IRMultimodal Embedding

    Soochow University, Suzhou, China · Ant Group, Beijing, China

  25. GRAMformer: Any-Order Modality Interactions via Volumetric Multimodal Cross-Attention

    Jun 4, 2026Giordano Cicchetti, Eleonora Grassucci, Danilo ComminielloCross-AttentionMultimodal Fusion

    Dept. of Information Engineering, Electronics, and Telecommunications, Sapienza University of Rome, Italy

  26. To Be Multimodal or Not to Be: Query-Adaptive Audio-Visual Person Retrieval via Active Modality Detection

    Jun 4, 2026Erfan Loweimi, Mengjie Qian, Kate Knill +7Missing-Modality LearningAudio-Visual Understanding

    University of Cambridge, UK · Southwest Jiaotong University, China · University of Surrey, UK +1

  27. Beyond Generative Decoding: Discriminative Hidden-State Readout from a Native Omni-Modal LLM for Multimodal Sentiment Analysis

    Jun 4, 2026Bin Wen, Tien-Ping TanEfficient Multimodal InferenceSentiment Analysis

    School of Computer Sciences, Universiti Sains Malaysia, Penang, Malaysia.

  28. WorldBench: A Challenging and Visually Diverse Multimodal Reasoning Benchmark

    Jun 4, 2026Yida Yin, Harish Krishnakumar, Chung Peng Lee +9Multimodal Large Language ModelsMultimodal Reasoning

    Princeton University · NYU · University of Waterloo +1

  29. Almieyar-Oryx-BloomBench: A Bilingual Multimodal Benchmark for Cognitively Informed Evaluation of Vision-Language Models

    Jun 4, 2026Mohammad Mahdi Abootorabi, Omid Ghahroodi, Anas Madkoor +4VLM EvaluationMultilingual VLM Evaluation

    Qatar Computing Research Institute (QCRI), Hamad Bin Khalifa University

  30. RePercENT: Scaling Disentangled Representation Learning Beyond Two Modalities

    Jun 3, 2026Vasiliki Rizou, Pascal Frossard, Dorina ThanouDisentangled Representation LearningCross-Modal Representation Learning

    EPFL